Face reconstruction fused with generic morphable model

doi:10.3788/OPE.20182601.0184

CIOMP OpenIR

	Face reconstruction fused with generic morphable model
	Gao, Zhan-Yu; Gu, Ying-Ying; Lu, Yao-Yu; Xu, Zhen-Bang; Wu, Qing-Wen
	2018
发表期刊	Guangxue Jingmi Gongcheng/Optics and Precision Engineering
ISSN	1004924X
卷号	26 期号:1 页码:184-192
摘要	Stereo reconstruction from image pairs is a genetic method for 3D acquisition of human faces. Depending on available imagery and reconstruction algorithm, the resulting 3D reconstructions may have deficits. We improve generic morphable model and fused with stereo reconstruction to remedy such deficits. Firstly, we obtain the face bounding box by Max-Margin Object Detection, and recognition the face feature points directly from a sparse subset of pixel intensities by the Ensemble of Regression Treesmethod. Secondly, through the color PCA model to generate the shape and color of the 3D facial statistical model, the ISOMAP algorithm is used to convert the 3D mesh to 2D surface and extract the texture information to get the facial model.Finally, the surface registration with two step non-rigid change on source mesh: we mean the global deformation in the source by using few anchor points on the source mesh, and using the Radial Basis Function (RBF) to express non-rigid global deformation; and then Procrustes analysis is applied for non-rigid transformation of the source vertex, the k-nearest neighbor transformation through weighted scheme tosmooth the local deformation. The experiment result shows the high-quality scan which is used for cloud comparison with the face model, stereo reconstruction and our deformed face model, after aligning all models with the high quality scan, three RMS facial deformation model values are 2.795 2, 2.102 8, 2.153 4.Comparing to other models, deformed face model has smaller discrepancies dominate more strongly, and the deformed face model is visually more shape consistent to the image. Qualitative and quantitative analysis of the deformed face model shows that the combination of stereo reconstruction with general shape information about human faces is geometrically superior to both the reconstruction based on single image from generic model as well as the stereo reconstruction without consideration of the generic model. 2018, Science Press. All right reserved.
关键词	Three dimensional computer graphics Deformation Image reconstruction Image segmentation Information fusion Mesh generation Nearest neighbor search Object detection Radial basis function networks Stereo image processing
DOI	10.3788/OPE.20182601.0184
收录类别	EI
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/60664
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Gao, Zhan-Yu,Gu, Ying-Ying,Lu, Yao-Yu,et al. Face reconstruction fused with generic morphable model[J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering,2018,26(1):184-192.
APA	Gao, Zhan-Yu,Gu, Ying-Ying,Lu, Yao-Yu,Xu, Zhen-Bang,&Wu, Qing-Wen.(2018).Face reconstruction fused with generic morphable model.Guangxue Jingmi Gongcheng/Optics and Precision Engineering,26(1),184-192.
MLA	Gao, Zhan-Yu,et al."Face reconstruction fused with generic morphable model".Guangxue Jingmi Gongcheng/Optics and Precision Engineering 26.1(2018):184-192.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Face reconstruction （928KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载