Browse Prior Art Database

Method and System for Customizing Culture-Based Translation of Nonverbal Communication in Video Conference Systems

IP.com Disclosure Number: IPCOM000239192D
Publication Date: 2014-Oct-20
Document File: 4 page(s) / 120K

Publishing Venue

The IP.com Prior Art Database

Abstract

A method and system is disclosed for customizing culture-based translation of nonverbal communication in video conference systems.

This text was extracted from a PDF file.
This is the abbreviated version, containing approximately 44% of the total text.

Page 01 of 4

Method and System for Customizing Culture-Based Translation of Nonverbal Communication in Video Conference Systems

Human communication includes both verbal and nonverbal information. Nonverbal information includes vocalics / paralanguage, proxemics, haptics, kinesics, gesturing, and body posture. These various forms of nonverbal communication are often referred to as body language.

Body language is implicitly learned and can vary by culture. While many forms of body language are carried out at a subconscious or low-awareness level, body language is nonetheless significant to communication and relationships. As such, there is significant risk that body language could be misinterpreted in intercultural communication exchanges. Furthermore, even within a community, body language is not interpreted consistently. While there are a set of universally recognized gestures (such as smiling or laughing when happy, and frowning or crying when sad), many are influenced by our social settings.

Consider the difficulty that two people from different cultures experience in communicating when in one culture, maintaining a direct gaze conveys trustworthiness and sincerity, and in another culture, maintaining a direct gaze conveys distrust.

As another example, consider a scenario where, in the course of conversation, a participant from one culture is cold and reacts by folding his/her arms and retracting his/her fingers to form fists. In another participant's culture, crossing one's arms is interpreted as a defensive posture and closed fists is interpreted as a sign of repressed aggression.

There is accordingly need for a method and system for appropriate interpretation of body language across cultures.

Disclosed is a method and system for customizing culture-based translation of nonverbal communication in a video conference. The method and system enable participants in a video conference session to customize their personal interpretation of body language mappings with associated emotional states/body postures.

The method and system combine the following set of capabilities. Initially, the method and system recognize the body language of each participant in a video conference system and encode it in the conference stream metadata. Thereafter, the method and system use automated facial expression analysis software to recognize and interpret the emotional state of each video conference participant. Based on cultural norms, the system provides standard culture-based mappings between body language and associated emotional states/body postures. In addition, the system enables participants in the video conference session to configure their personal body language mappings with corresponding emotional states/body postures. Subsequently, the system generates avatars in the video stream that show specific cues and gestures. The avatars can be accompanied by a word or short phrase that describes the specific emotional states/body postures.

For the duration of...