Please wait a minute...
J4  2011, Vol. 45 Issue (1): 30-36    DOI: 10.3785/j.issn.1008-973X.2011.01.005
Facial feature tracking using three-dimensional model and
Gabor wavelet
ZHAN Jiang-tao1,2, LIU Qiang3, CHAI Chun-lei1
1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China;2.Department of
Design and Art, Zhejiang Institute of Mechanical and Electrical Engineering, Hangzhou 310053, China;
3. Academy of Arts and Design, Tsinghua University, Beijing 100084, China
Download:   PDF(0KB) HTML
Export: BibTeX | EndNote (RIS)      


A new facial feature points tracking scheme was proposed by integrating three-dimensional geometric face modelbased tracking method and facial feature points tracking method with Gabor wavelet in bundle adjustment way in order to realize the robustness and accuracy of facial tracking system. The tracking method with Gabor wavelet was used to get the initial feature points. Then the model-based tracking method was used to get the final optimal feature points. The scheme overcame the disadvantage of using two-dimensional image features compared with three other typical methods. The scheme can be used for robust, real-time and wide-angle facial feature tracking.

Published: 03 March 2011
CLC:  TP 391.41  
Cite this article:

ZHAN Jiang-tao, LIU Qiang, CHAI Chun-lei. Facial feature tracking using three-dimensional model and
Gabor wavelet. J4, 2011, 45(1): 30-36.

URL:     OR



[1] 金城,卜佳俊,陈华,等. 自底向上的人脸特征点定位[J]. 浙江大学学报:工学版,2008, 42(5): 794-799.
JIN Cheng, BU Jiajun, CHEN Hua, et al. Human face detection and feature tracking in a bottomup way [J]. Journal of Zhejiang University:Engineering Science, 2008, 42(5): 794-799.
[2] COOTES T, WALKER K, TAYLOR C. Viewbased active appearance models [C] ∥Proceedings of 4th IEEE International Conference on Automatic Face and Gesture Recognition. Grenoble, French: IEEE, 2000: 227-232.
[3] HOU X, LI S, ZHAN G H, et al. Direct appearance models [C] ∥Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′01). Hawaii: IEEE, 2001: 828-833.
[4] ROGERIO S, FERIS A, ROBERTO M, et al. Tracking facial features using Gabor wavelet networks [C]∥Proceedings of XIII Brazilian Symposium on Computer Graphics and Image Processing. Gramado: IEEE, 2000: 22-27.
[5] 李英,赖剑煌,阮邦志. 多模板ASM方法及其在人脸特征点检测中的应用[J]. 计算机研究与发展, 2007, 41(1): 133-140.
LI Ying, LAI Jianhuang, RUAN Bangzhi. Multitemplate ASM and its application in facial feature points detection [J]. Journal of Computer Research and Development, 2007, 41(1): 133-140.
[6] 段鸿,程义民,王以孝,等. 基于KanadeLucasTomasi算法的人脸特征点跟踪方法[J]. 计算机辅助设计与图形学学报,2004, 16(3): 279-283.
DUAN Hong, CHENG Yimin, WANG Yixiao, et al. Tracking facial feature points using KanadeLucasTomasi approach [J]. Journal of ComputerAided Design and Computer Graphics, 2004, 16(3): 279-283.
[7] 颜蒋国,潘立登. 基于Gabor小波的人脸特征点跟踪方法[J]. 计算机应用,2004, 24(7): 50-51.
YAN Jiangguo, PAN Lideng. Tracking facial feature with Gabor wavelet [J]. Computer Applications, 2004, 24(7): 50-51.
[8] WISKOTT L, FELLOUS J M, KRUGER N, et al. Face recognition by elastic bunch graph matching [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 1997, 19(7): 775-779.
[9] VACCHETTI L, LEPETIT V, FUA P. Stable realtime 3d tracking using online and offline information [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(10): 1385-1391.
[10] VIOLA P, JONES M. Rapid object detection using a boosted cascade of simple features [C]∥Proceedings of 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′01). Hawaii: IEEE, 2001: 511-518.
[11] DEMENTHON D F, DAVIS L S. Modelbased object pose in 25 lines of code [J]. International Journal of Computer Vision, 1995, 15(1/2): 123-141.
[12] DAUGMAN J G. Twodimensional spectral analysis of cortical receptive field profiles [J]. Vision Research, 1980, 20(10): 847-856.
[13] VACCHETTI L, LEPETIT V, FUA P. Fusing online and offline information for stable 3d tracking in realtime [C]∥ Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′03). Wisconsin: IEEE, 2003: 241-248.
[14] Cross correlation [EB/OL]. http:∥correl ation#Normalized_crosscorrelation. [2009-05-31].
[15] TRIGGS B, MCLAUCHLAN P, HARTLEY R, et al. Bundle adjustment: a modern synthesis [C]∥ Proceedings of International Workshop on Vision Algorithms (ICCV′99). Kerkyra: IEEE, 1999: 298-372.
[16] WILLIAM H P, BRIAN P F, SAUL A T, et al. C数值算法[M]. 傅祖芸,赵梅娜,丁岩石,译. 2版. 北京:电子工业出版社, 2004: 121-128.
[17] LEE K C, HO J, YANG M H, et al. Visual tracking and recognition using probabilistic appearance manifolds [J]. Computer Vision and Image Understanding, 2005, 99(3): 303-331.
[18] 宋刚,艾海舟,徐光佑. 纹理约束下的人脸特征点跟踪[J]. 软件学院, 2004, 15(11): 1607-1615.
SONG Gang, AI Haizhou, XU Guangyou. Texture constrained facial point tracking [J]. Journal of Software, 2004, 15(11): 1607-1615.
[19] COOTES T F, WHEELER G V, WALKER K N, et al. Viewbased active appearance models [J]. Image Vision Computing, 2002, 20(9): 657-664.
[20] TONG Yan, WANG Yang, ZHU Zhiwei, et al. Robust facial feature tracking under varying face pose and facial expression [J]. Pattern Recognition, 2007, 40(11): 3195-3208.
[21] ROMDHANI S, GONG S, PSARROU A. Multiview nonlinear active shape model using kernel PCA [C]∥Proceedings of BMVC. Nottingham: IEEE, 1999: 483-492.

[1] YANH Yu-ting, SHI Yu-hui, XIA Shun-ren. Discussion mechanism based brain storm optimization algorithm[J]. J4, 2013, 47(10): 1705-1711.
[2] ZHU Xiao-en, HAO Xin, XIA Shun-ren. Feature selection algorithm based on Levy flight[J]. J4, 2013, 47(4): 638-643.
[3] SON Chang-il , ZHEN Shuai, XIA Shun-ren. Attractor range based affine registration of multi-modal
brain magnetic resonance images
[J]. J4, 2012, 46(9): 1722-1728.
[4] XIE Di, TONG Ruo-feng, TANG Min, FENG Yang. Distinguishable method for video fire detection[J]. J4, 2012, 46(4): 698-704.
[5] DAI Yuan-ming, WEI Wei, LIN Yi-ning. An improved Mean-shift tracking algorithm based on
color and texture feature
[J]. J4, 2012, 46(2): 212-217.
[6] Qi lei, JIN Wen-guang, GENG Wei-dong. Human motion capture using wireless inertial sensors[J]. J4, 2012, 46(2): 280-285.
[7] LIU Chen-bin, PAN Ying, ZHANG Hai-shi, HUANG Feng-ping, XIA Shun-ren. Detecting MGMT expression status of glioma with magnetic
resonance image
[J]. J4, 2012, 46(1): 170-176.
[8] QIAN Cheng, ZHANG San-yuan. Weighted incremental subspace learning algorithm
suitable for object tracking
[J]. J4, 2011, 45(12): 2240-2246.
[9] CAO Ying, HAO Xin, ZHU Xiao-en, XIA Shun-ren. Mammographic mass segmentation algorithm based on
automatic random walks
[J]. J4, 2011, 45(10): 1753-1760.
[10] LV Gu-lai,LI Jian-ping,LI Qiang,YU Li-xing,ZHU Song-ming,LOU Jian-zhong. Method for rootstock position recognition based on machine vision[J]. J4, 2011, 45(10): 1766-1770.
[11] LAI Xiao-bo , ZHU Shi-qiang. Mutual information based non-parametric
 transform stereo matching algorithm
[J]. J4, 2011, 45(9): 1636-1642.
[12] WANG Jin-de, SHOU Li-dan, LI Xiao-yan, CHEN Gang. Bundling features with multiple segmentations for
object-based image retrieval
[J]. J4, 2011, 45(2): 259-266.
[13] LIU Jian-ming, LU Dong-ming, GE Rong. Global optimization based image inpainting and
its implementation on GPU
[J]. J4, 2011, 45(2): 247-252.
[14] LIANG Wen-feng, XIANG Zhi-yu. Algorithm of robust object tracking using PTZ camera[J]. J4, 2011, 45(1): 59-63.
[15] SONG Kun-po, XIA Shun-ren, XU Qing. Algorithm considering correlation of wavelet coefficients for
ultrasound image denoising
[J]. J4, 2010, 44(11): 2203-2208.