Face Detection with End-to-End Integration of a ConvNet and a 3D Model | |
Li, Yunzhu ; Sun, Benyuan ; Wu, Tianfu ; Wang, Yizhou | |
2016 | |
关键词 | Face detection Face 3D model ConvNet Deep learning Multi-task learning RECOGNITION |
英文摘要 | This paper presents a method for face detection in the wild, which integrates a ConvNet and a 3D mean face model in an end-to-end multi-task discriminative learning framework. The 3D mean face model is predefined and fixed (e.g., we used the one provided in the AFLW dataset). The ConvNet consists of two components: (i) The face proposal component computes face bounding box proposals via estimating facial key-points and the 3D transformation (rotation and translation) parameters for each predicted key-point w.r.t. the 3D mean face model. (ii) The face verification component computes detection results by pruning and refining proposals based on facial key-points based configuration pooling. The proposed method addresses two issues in adapting state-of-the-art generic object detection ConvNets (e.g., faster R-CNN) for face detection: (i) One is to eliminate the heuristic design of predefined anchor boxes in the region proposals network (RPN) by exploiting a 3D mean face model. (ii) The other is to replace the generic RoI (Region-of-Interest) pooling layer with a configuration pooling layer to respect underlying object structures. The multi-task loss consists of three terms: the classification Softmax loss and the location smooth l(1)-losses of both the facial key-points and the face bounding boxes. In experiments, our ConvNet is trained on the AFLW dataset only and tested on the FDDB benchmark with fine-tuning and on the AFW benchmark without fine-tuning. The proposed method obtains very competitive state-of-the-art performance in the two benchmarks.; CPCI-S(ISTP); leo.liyunzhu@pku.edu.cn; sunbenyuan@pku.edu.cn; tianfu_wu@ncsu.edu; Yizhou.Wang@pku.edu.cn; 420-436; 9907 |
语种 | 英语 |
出处 | 14th European Conference on Computer Vision (ECCV) |
DOI标识 | 10.1007/978-3-319-46487-9_26 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/460043] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Li, Yunzhu,Sun, Benyuan,Wu, Tianfu,et al. Face Detection with End-to-End Integration of a ConvNet and a 3D Model. 2016-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论