Local and correlation attention learning for subtle facial expression recognition | |
Wang, Shaocong1,2; Yuan, Yuan3; Zheng, Xiangtao1; Lu, Xiaoqiang1 | |
刊名 | Neurocomputing
![]() |
2020 | |
关键词 | Facial expression recognition Feature extraction Neural network Attention mechanism |
ISSN号 | 09252312;18728286 |
DOI | 10.1016/j.neucom.2020.07.120 |
产权排序 | 1 |
英文摘要 | Subtle facial expression recognition (SFER) aims to classify facial expressions with very low intensity into corresponding human emotions. Subtle facial expression can be regarded as a special kind of facial expression, whose facial muscle movements are more difficult to capture. In the last decade, various methods have been developed for common facial expression recognition (FER). However, most of them failed to automatically find the most discriminative parts of facial expression and the correlation of muscle movements when human makes facial expression, which makes them unsuitable for SFER. To better solve SFER problem, an attention mechanism based model focusing on salient local regions and their correlations is proposed in this paper. The proposed method: 1) utilizes multiple attention blocks to attend to distinct discriminative regions and extract corresponding local features automatically, 2) a correlation attention module is integrated in the model to extract global correlation feature over the salient regions, and finally 3) fuses the correlation feature and local features in an efficient way for the final facial expression classification. By this way, the useful but subtle local information can be utilized in more detail, and the correlation of different local regions is also extracted. Extensive experiment on the LSEMSW and CK+ datasets shows that the method proposed in this paper achieves superior results, which demonstrates its effectiveness. © 2020 Elsevier B.V. |
语种 | 英语 |
出版者 | Elsevier B.V., Netherlands |
内容类型 | 期刊论文 |
源URL | [http://ir.opt.ac.cn/handle/181661/93716] ![]() |
专题 | 西安光学精密机械研究所_光学影像学习与分析中心 |
通讯作者 | Zheng, Xiangtao |
作者单位 | 1.Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; Shaanxi; 710119, China; 2.University of Chinese Academy of Sciences, Beijing; 100049, China; 3.Center for OPTical IMagery Analysis and Learning(OPTIMAL), Northwestern Polytechnical University, Xi'an; 710072, China |
推荐引用方式 GB/T 7714 | Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,et al. Local and correlation attention learning for subtle facial expression recognition[J]. Neurocomputing,2020. |
APA | Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,&Lu, Xiaoqiang.(2020).Local and correlation attention learning for subtle facial expression recognition.Neurocomputing. |
MLA | Wang, Shaocong,et al."Local and correlation attention learning for subtle facial expression recognition".Neurocomputing (2020). |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论