Local and correlation attention learning for subtle facial expression recognition
Wang, Shaocong1,2; Yuan, Yuan3; Zheng, Xiangtao1; Lu, Xiaoqiang1
刊名Neurocomputing
2020
关键词Facial expression recognition Feature extraction Neural network Attention mechanism
ISSN号09252312;18728286
DOI10.1016/j.neucom.2020.07.120
产权排序1
英文摘要

Subtle facial expression recognition (SFER) aims to classify facial expressions with very low intensity into corresponding human emotions. Subtle facial expression can be regarded as a special kind of facial expression, whose facial muscle movements are more difficult to capture. In the last decade, various methods have been developed for common facial expression recognition (FER). However, most of them failed to automatically find the most discriminative parts of facial expression and the correlation of muscle movements when human makes facial expression, which makes them unsuitable for SFER. To better solve SFER problem, an attention mechanism based model focusing on salient local regions and their correlations is proposed in this paper. The proposed method: 1) utilizes multiple attention blocks to attend to distinct discriminative regions and extract corresponding local features automatically, 2) a correlation attention module is integrated in the model to extract global correlation feature over the salient regions, and finally 3) fuses the correlation feature and local features in an efficient way for the final facial expression classification. By this way, the useful but subtle local information can be utilized in more detail, and the correlation of different local regions is also extracted. Extensive experiment on the LSEMSW and CK+ datasets shows that the method proposed in this paper achieves superior results, which demonstrates its effectiveness. © 2020 Elsevier B.V.

语种英语
出版者Elsevier B.V., Netherlands
内容类型期刊论文
源URL[http://ir.opt.ac.cn/handle/181661/93716]  
专题西安光学精密机械研究所_光学影像学习与分析中心
通讯作者Zheng, Xiangtao
作者单位1.Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; Shaanxi; 710119, China;
2.University of Chinese Academy of Sciences, Beijing; 100049, China;
3.Center for OPTical IMagery Analysis and Learning(OPTIMAL), Northwestern Polytechnical University, Xi'an; 710072, China
推荐引用方式
GB/T 7714
Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,et al. Local and correlation attention learning for subtle facial expression recognition[J]. Neurocomputing,2020.
APA Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,&Lu, Xiaoqiang.(2020).Local and correlation attention learning for subtle facial expression recognition.Neurocomputing.
MLA Wang, Shaocong,et al."Local and correlation attention learning for subtle facial expression recognition".Neurocomputing (2020).
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace