Facial feature tracking using three-dimensional model and
Gabor wavelet
ZHAN Jiang-tao1,2, LIU Qiang3, CHAI Chun-lei1
1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China;2.Department of
Design and Art, Zhejiang Institute of Mechanical and Electrical Engineering, Hangzhou 310053, China;
3. Academy of Arts and Design, Tsinghua University, Beijing 100084, China
A new facial feature points tracking scheme was proposed by integrating three-dimensional geometric face modelbased tracking method and facial feature points tracking method with Gabor wavelet in bundle adjustment way in order to realize the robustness and accuracy of facial tracking system. The tracking method with Gabor wavelet was used to get the initial feature points. Then the model-based tracking method was used to get the final optimal feature points. The scheme overcame the disadvantage of using two-dimensional image features compared with three other typical methods. The scheme can be used for robust, real-time and wide-angle facial feature tracking．
［1］ 金城,卜佳俊,陈华,等. 自底向上的人脸特征点定位［J］. 浙江大学学报：工学版,2008, 42(5): 794-799．
JIN Cheng, BU Jiajun, CHEN Hua, et al. Human face detection and feature tracking in a bottomup way ［J］. Journal of Zhejiang University:Engineering Science, 2008, 42(5): 794-799．
［2］ COOTES T, WALKER K, TAYLOR C. Viewbased active appearance models ［C］ ∥Proceedings of 4th IEEE International Conference on Automatic Face and Gesture Recognition. Grenoble, French: IEEE, 2000: 227-232．
［3］ HOU X, LI S, ZHAN G H, et al. Direct appearance models ［C］ ∥Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′01). Hawaii: IEEE, 2001: 828-833．
［4］ ROGERIO S, FERIS A, ROBERTO M, et al. Tracking facial features using Gabor wavelet networks ［C］∥Proceedings of XIII Brazilian Symposium on Computer Graphics and Image Processing. Gramado: IEEE, 2000: 22-27．
［5］ 李英,赖剑煌,阮邦志. 多模板ASM方法及其在人脸特征点检测中的应用［J］. 计算机研究与发展, 2007, 41(1): 133-140．
LI Ying, LAI Jianhuang, RUAN Bangzhi. Multitemplate ASM and its application in facial feature points detection ［J］. Journal of Computer Research and Development, 2007, 41(1): 133-140．
［6］ 段鸿,程义民,王以孝,等. 基于KanadeLucasTomasi算法的人脸特征点跟踪方法［J］. 计算机辅助设计与图形学学报,2004, 16(3): 279-283．
DUAN Hong, CHENG Yimin, WANG Yixiao, et al. Tracking facial feature points using KanadeLucasTomasi approach ［J］. Journal of ComputerAided Design and Computer Graphics, 2004, 16(3): 279-283．
［7］ 颜蒋国,潘立登. 基于Gabor小波的人脸特征点跟踪方法［J］. 计算机应用,2004, 24(7): 50-51．
YAN Jiangguo, PAN Lideng. Tracking facial feature with Gabor wavelet ［J］. Computer Applications, 2004, 24(7): 50-51．
［8］ WISKOTT L, FELLOUS J M, KRUGER N, et al. Face recognition by elastic bunch graph matching ［J］. IEEE Transaction on Pattern Analysis and Machine Intelligence, 1997, 19(7): 775-779．
［9］ VACCHETTI L, LEPETIT V, FUA P. Stable realtime 3d tracking using online and offline information ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(10): 1385-1391．
［10］ VIOLA P, JONES M. Rapid object detection using a boosted cascade of simple features ［C］∥Proceedings of 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′01). Hawaii: IEEE, 2001: 511-518．
［11］ DEMENTHON D F, DAVIS L S. Modelbased object pose in 25 lines of code ［J］. International Journal of Computer Vision, 1995, 15(1/2): 123-141．
［12］ DAUGMAN J G. Twodimensional spectral analysis of cortical receptive field profiles ［J］. Vision Research, 1980, 20(10): 847-856．
［13］ VACCHETTI L, LEPETIT V, FUA P. Fusing online and offline information for stable 3d tracking in realtime ［C］∥ Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′03). Wisconsin: IEEE, 2003: 241-248．
［14］ Cross correlation ［EB/OL］. http:∥en.wikipedia.org/wiki/Crosscorrel ation#Normalized_crosscorrelation. ［2009-05-31］．
［15］ TRIGGS B, MCLAUCHLAN P, HARTLEY R, et al. Bundle adjustment: a modern synthesis ［C］∥ Proceedings of International Workshop on Vision Algorithms (ICCV′99). Kerkyra: IEEE, 1999: 298-372．
［16］ WILLIAM H P, BRIAN P F, SAUL A T, et al. C数值算法［M］. 傅祖芸,赵梅娜,丁岩石,译. 2版. 北京:电子工业出版社, 2004: 121-128．
［17］ LEE K C, HO J, YANG M H, et al. Visual tracking and recognition using probabilistic appearance manifolds ［J］. Computer Vision and Image Understanding, 2005, 99(3): 303-331．
［18］ 宋刚,艾海舟,徐光佑. 纹理约束下的人脸特征点跟踪［J］. 软件学院, 2004, 15(11): 1607-1615.
SONG Gang, AI Haizhou, XU Guangyou. Texture constrained facial point tracking ［J］. Journal of Software, 2004, 15(11): 1607-1615.
［19］ COOTES T F, WHEELER G V, WALKER K N, et al. Viewbased active appearance models ［J］. Image Vision Computing, 2002, 20(9): 657-664．
［20］ TONG Yan, WANG Yang, ZHU Zhiwei, et al. Robust facial feature tracking under varying face pose and facial expression ［J］. Pattern Recognition, 2007, 40(11): 3195-3208．
［21］ ROMDHANI S, GONG S, PSARROU A. Multiview nonlinear active shape model using kernel PCA ［C］∥Proceedings of BMVC. Nottingham: IEEE, 1999: 483-492．
