Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  2007, Vol. 8 Issue (4): 550-558    DOI: 10.1631/jzus.2007.A0550
Information & Computer Science     
Sample based 3D face reconstruction from a single frontal image by adaptive locally linear embedding
ZHANG Jian, ZHUANG Yue-ting
School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
Download:     PDF (0 KB)     
Export: BibTeX | EndNote (RIS)      

Abstract  In this paper, we propose a highly automatic approach for 3D photorealistic face reconstruction from a single frontal image. The key point of our work is the implementation of adaptive manifold learning approach. Beforehand, an active appearance model (AAM) is trained for automatic feature extraction and adaptive locally linear embedding (ALLE) algorithm is utilized to reduce the dimensionality of the 3D database. Then, given an input frontal face image, the corresponding weights between 3D samples and the image are synthesized adaptively according to the AAM selected facial features. Finally, geometry reconstruction is achieved by linear weighted combination of adaptively selected samples. Radial basis function (RBF) is adopted to map facial texture from the frontal image to the reconstructed face geometry. The texture of invisible regions between the face and the ears is interpolated by sampling from the frontal image. This approach has several advantages: (1) Only a single frontal face image is needed for highly automatic face reconstruction; (2) Compared with former works, our reconstruction approach provides higher accuracy; (3) Constraint based RBF texture mapping provides natural appearance for reconstructed face.

Key wordsFace reconstruction      Manifold learning      RBF interpolation      Reconstruction error rate     
Received: 10 February 2006     
CLC:  TP391  
Cite this article:

ZHANG Jian, ZHUANG Yue-ting. Sample based 3D face reconstruction from a single frontal image by adaptive locally linear embedding. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(4): 550-558.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.2007.A0550     OR     http://www.zjujournals.com/xueshu/zjus-a/Y2007/V8/I4/550

[1] Yue-ting ZHUANG, Yu-shun WANG, Timothy K. SHIH, Nick C. TANG. Patch-guided facial image inpainting by shape propagation[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(2): 232-238.
[2] Rong ZHU, Min YAO. Image feature optimization based on nonlinear dimensionality reduction[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(12): 1720-1737.
[3] Wang Qian-Ting, Guo Jian, Chen Yi-Zhi. Fractal modelling of off-road terrain oriented to vehicle virtual test[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(Supplement 2): 287-292.
[4] LI Zhong, MA Li-zhuang, TAN Wu-zheng, ZHAO Ming-xi. Reconstruction from contour lines based on bi-cubic Bézier spline surface[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(7 ): 18-.
[5] WANG Qiang, ZHENG Yao, CHEN Chun, TADAHIRO Fujimoto, CHIBA Norishige. Efficient rendering of breaking waves using MPS method[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(6 ): 13-.
[6] DONG Chen-shi, WANG Guo-zhao. Surface reconstruction by offset surface filtering[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2005, 6(Supplement 1): 137-143.