Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  2006, Vol. 7 Issue (4 ): 12-    DOI: 10.1631/jzus.2006.A0556
    
Data-driven facial animation based on manifold Bayesian regression
Wang Yu-shun, Zhuang Yue-ting, Wu Fei
School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; The Microsoft State Education Ministry Key Laboratory, Zhejiang University, Hangzhou 310027, China
Download:     PDF (0 KB)     
Export: BibTeX | EndNote (RIS)      

Abstract  Driving facial animation based on tens of tracked markers is a challenging task due to the complex topology and to the non-rigid nature of human faces. We propose a solution named manifold Bayesian regression. First a novel distance metric, the geodesic manifold distance, is introduced to replace the Euclidean distance. The problem of facial animation can be formulated as a sparse warping kernels regression problem, in which the geodesic manifold distance is used for modelling the topology and discontinuities of the face models. The geodesic manifold distance can be adopted in traditional regression methods, e.g. radial basis functions without much tuning. We put facial animation into the framework of Bayesian regression. Bayesian approaches provide an elegant way of dealing with noise and uncertainty. After the covariance matrix is properly modulated, Hybrid Monte Carlo is used to approximate the integration of probabilities and get deformation results. The experimental results showed that our algorithm can robustly produce facial animation with large motions and complex face models.

Key wordsFacial animation      Manifold      Geodesic distance      Bayesian regression     
Received: 05 June 2005     
CLC:  TP391  
Cite this article:

Wang Yu-shun, Zhuang Yue-ting, Wu Fei. Data-driven facial animation based on manifold Bayesian regression. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7(4 ): 12-.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.2006.A0556     OR     http://www.zjujournals.com/xueshu/zjus-a/Y2006/V7/I4 /12

[1] Rong ZHU, Min YAO. Image feature optimization based on nonlinear dimensionality reduction[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(12): 1720-1737.
[2] ZHANG Jian, ZHUANG Yue-ting. Sample based 3D face reconstruction from a single frontal image by adaptive locally linear embedding[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(4): 550-558.
[3] LEE Sang Hun, LEE Kunwoo. Feature-based multiresolution techniques for product design[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2006, 7( 9): 11-.