Utterance independent bimodal emotion recognition in spontaneous communication | |
Tao, Jianhua; Pan, Shifeng; Yang, Minghao; Li, Ya; Mu, Kaihui; Che, Jianfeng | |
刊名 | EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING |
2011 | |
关键词 | Bimodal emotion recognition Utterance Independent Multistream Hidden Markov Model Fused Hidden Markov Model Inversion |
英文摘要 | Emotion expressions sometimes are mixed with the utterance expression in spontaneous face-to-face communication, which makes difficulties for emotion recognition. This article introduces the methods of reducing the utterance influences in visual parameters for the audio-visual-based emotion recognition. The audio and visual channels are first combined under a Multistream Hidden Markov Model (MHMM). Then, the utterance reduction is finished by finding the residual between the real visual parameters and the outputs of the utterance related visual parameters. This article introduces the Fused Hidden Markov Model Inversion method which is trained in the neutral expressed audio-visual corpus to solve the problem. To reduce the computing complexity the inversion model is further simplified to a Gaussian Mixture Model (GMM) mapping. Compared with traditional bimodal emotion recognition methods (e.g., SVM, CART, Boosting), the utterance reduction method can give better results of emotion recognition. The experiments also show the effectiveness of our emotion recognition system when it was used in a live environment. |
WOS标题词 | Science & Technology ; Technology |
类目[WOS] | Engineering, Electrical & Electronic |
研究领域[WOS] | Engineering |
关键词[WOS] | FACIAL EXPRESSION ANALYSIS ; AUDIOVISUAL AFFECT RECOGNITION ; HIDDEN MARKOV-MODELS ; IMAGE SEQUENCES ; SPEECH ; DATABASES |
收录类别 | SCI |
语种 | 英语 |
WOS记录号 | WOS:000294848600001 |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/3238] |
专题 | 自动化研究所_模式识别国家重点实验室_人机语音交互团队 |
作者单位 | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
推荐引用方式 GB/T 7714 | Tao, Jianhua,Pan, Shifeng,Yang, Minghao,et al. Utterance independent bimodal emotion recognition in spontaneous communication[J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING,2011. |
APA | Tao, Jianhua,Pan, Shifeng,Yang, Minghao,Li, Ya,Mu, Kaihui,&Che, Jianfeng.(2011).Utterance independent bimodal emotion recognition in spontaneous communication.EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING. |
MLA | Tao, Jianhua,et al."Utterance independent bimodal emotion recognition in spontaneous communication".EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING (2011). |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论