A Review of Multimodal Approach for Gesture Recognition of Human Behavior

[摘要] Agesture is a form of non verbal or non vocal communication in which visible bodily actions communicate particular messages. Gestures include movement of the face, hands or other parts of the body.  Gestures allow persons to speak a variety of feelings and thoughts, from condescension and hostility to approval and affection, often together with body language in addition to words when they speak.  An emotion plays a crucial role in person to person interaction. In recent years, there has been a growing interest in improving all aspects of interaction between humans and computers. Human expression is used to interact with the computers. This paper explores a ways of human-computer interaction that enable the computer to be more aware of the user’s emotional expressions we present an approach for the emotion recognition from a facial expression, hand and body posture. Our model uses multimodal emotion recognition system in which we use two different models for facial expression recognition and for hand gesture recognition and then combining the result of both classifiers using a third classifier which give the resulting emotion. 

[学科分类] 建筑学

[关键词] Multimodal approach;Face Detection;Facial expression recognition system;Hand gesture recognition system;PCA;Cam Shift Algorithm