Face reconstruction fused with generic morphable model

doi:10.3788/OPE.20182601.0184

CORC > 长春光学精密机械与物理研究所 > 中国科学院长春光学精密机械与物理研究所

	Face reconstruction fused with generic morphable model
	Gao, Zhan-Yu; Gu, Ying-Ying; Lu, Yao-Yu; Xu, Zhen-Bang; Wu, Qing-Wen
刊名	Guangxue Jingmi Gongcheng/Optics and Precision Engineering
	2018
卷号	26 期号:1 页码:184-192
关键词	Three dimensional computer graphics Deformation Image reconstruction Image segmentation Information fusion Mesh generation Nearest neighbor search Object detection Radial basis function networks Stereo image processing
ISSN号	1004924X
DOI	10.3788/OPE.20182601.0184
英文摘要	Stereo reconstruction from image pairs is a genetic method for 3D acquisition of human faces. Depending on available imagery and reconstruction algorithm, the resulting 3D reconstructions may have deficits. We improve generic morphable model and fused with stereo reconstruction to remedy such deficits. Firstly, we obtain the face bounding box by Max-Margin Object Detection, and recognition the face feature points directly from a sparse subset of pixel intensities by the Ensemble of Regression Treesmethod. Secondly, through the color PCA model to generate the shape and color of the 3D facial statistical model, the ISOMAP algorithm is used to convert the 3D mesh to 2D surface and extract the texture information to get the facial model.Finally, the surface registration with two step non-rigid change on source mesh: we mean the global deformation in the source by using few anchor points on the source mesh, and using the Radial Basis Function (RBF) to express non-rigid global deformation; and then Procrustes analysis is applied for non-rigid transformation of the source vertex, the k-nearest neighbor transformation through weighted scheme tosmooth the local deformation. The experiment result shows the high-quality scan which is used for cloud comparison with the face model, stereo reconstruction and our deformed face model, after aligning all models with the high quality scan, three RMS facial deformation model values are 2.795 2, 2.102 8, 2.153 4.Comparing to other models, deformed face model has smaller discrepancies dominate more strongly, and the deformed face model is visually more shape consistent to the image. Qualitative and quantitative analysis of the deformed face model shows that the combination of stereo reconstruction with general shape information about human faces is geometrically superior to both the reconstruction based on single image from generic model as well as the stereo reconstruction without consideration of the generic model. 2018, Science Press. All right reserved.
内容类型	期刊论文
源URL	[http://ir.ciomp.ac.cn/handle/181722/60664]
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Gao, Zhan-Yu,Gu, Ying-Ying,Lu, Yao-Yu,et al. Face reconstruction fused with generic morphable model[J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering,2018,26(1):184-192.
APA	Gao, Zhan-Yu,Gu, Ying-Ying,Lu, Yao-Yu,Xu, Zhen-Bang,&Wu, Qing-Wen.(2018).Face reconstruction fused with generic morphable model.Guangxue Jingmi Gongcheng/Optics and Precision Engineering,26(1),184-192.
MLA	Gao, Zhan-Yu,et al."Face reconstruction fused with generic morphable model".Guangxue Jingmi Gongcheng/Optics and Precision Engineering 26.1(2018):184-192.