Please wait a minute...
浙江大学学报(工学版)
J4  2009, Vol. 43 Issue (09): 1597-1603    DOI: 10.3785/j.issn.1008973X.2009.09.009
自动化技术、计算机技术     
基于注册和多尺度表观模型的三维头部跟踪
 赵刚强, 陈岭, 陈根才
（浙江大学 计算机科学与技术学院,浙江 杭州 310027）
Threedimensional head pose tracking using registration and multiscale appearance model
 DIAO Gang-Jiang, CHEN Ling, CHEN Gen-Cai
（College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China）
 全文: PDF(2083 KB)   HTML
摘要：

针对人体大范围运动下的头部姿态跟踪问题,提出一种基于尺度不变特征变换（SIFT）局部描述符注册和多尺度表观模型的三维头部姿态跟踪方法.基于SIFT局部描述符的注册算法通过在两帧灰度图像间进行特征点匹配计算两帧间的头部运动,在两帧人脸图像的尺度有一定变化时仍可得到精确结果.多尺度视角表观模型可以减少大范围跟踪时的误差累积,该模型在线选取具有不同头部姿态的关键帧,并通过多次注册的方法来减少当前帧的误差累积.实验结果表明,该方法不仅跟踪结果准确（均方根（RMS）误差为4 °）,而且在人体前后运动约1 m和头部进出摄像机视角情况下均很鲁棒.
Abstract:

Scale invariant feature transform (SIFT) local descriptor based registration algorithm and multiscale viewbased appearance model were used aiming at the problem of large head movement tracking. The SIFT local descriptor based registration algorithm can estimate the pose change between two frames even when head scale was also changed by matching salient SIFT features between two intensity images. The multiscale viewbased appearance model was employed to reduce the drift accumulation during tracking in large range. The model selected key frames online when the head underwent different motions and the tracker bounded the drift of current frame by employing multiple registrations approach. Experimental results show that the method is not only accurate (4 °RMS error), but also robust with respect to the movement along the Z axis was about 1 m and the subject returned to the visual field of camera after abrupt leaving．
:  TP 391  
基金资助:

国家自然科学基金资助项目（60703040）；浙江省自然科学基金资助项目（Y107178）；浙江省科技计划资助项目（2007C13019）.
通讯作者: 陈岭，男，副教授.     E-mail: lingchen@cs.zju.edu.cn
作者简介: 赵刚强(1981-)，男，山东聊城人，博士生，从事计算机视觉、人机交互研究.
服务　　
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章　　

引用本文:

赵刚强, 陈岭, 陈根才. 基于注册和多尺度表观模型的三维头部跟踪[J]. J4, 2009, 43(09): 1597-1603.

DIAO Gang-Jiang, CHEN Ling, CHEN Gen-Cai. Threedimensional head pose tracking using registration and multiscale appearance model. J4, 2009, 43(09): 1597-1603.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008973X.2009.09.009    或    http://www.zjujournals.com/eng/CN/Y2009/V43/I09/1597

［1］ 梁国远,查红彬,刘宏. 基于三维模型和仿射对应原理的人脸姿态估计方法 ［J］. 计算机学报, 2005, 28（5）: 792800．
LIANG Guoyuan, ZHA Hongbin, LIU Hong. Face pose estimation based on 3D models and affine correspondences ［J］. Chinese Journal of Computers, 2005, 28（5）: 792800．
［2］ SEEMANN E, NICKEL K, STIEFELHAGEN R. Head pose estimation using stereo vision for humanrobot interaction ［C］∥ Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition. Korea: IEEE, 2004: 626631.
［3］ MALASSIOTIS S, STRINTZIS M. Realtime head tracking and 3D pose estimation from range data ［C］∥ Prodeedings of IEEE International Conference on Image Processing. Barcelona: IEEE, 2003: 859862. 
［4］ GORODNICHY D, MALIK S, ROTH G. Affordable 3D face tracking using projective vision ［C］∥ Proceedings of International Conference on Vision Interfaces. Calgary: IEEE, 2002．
［5］ RUDDARRAJU R, HARO A, ESSAFAST I. Multiple camera head pose tracking ［C］∥ Proceedings of International Conference on Vision Interfaces. Halifax: IEEE, 2003.
［6］ YANG R, ZHANG Z. Modelbased head pose tracking with stereo vision ［C］∥ Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition. Washington DC: IEEE, 2002: 255260．
［7］ MORENCY L, DARRELL T. Stereo tracking using ICP and normal flow constraint ［C］∥ Proceedings of IEEE International Conference on Pattern Recognition. Quebec City: IEEE, 2002: 367372.
［8］ LOWE D. Distinctive image features from scaleinvariant keypoints ［J］. International Journal of Computer Vision, 2004, 60(2):91110．
［9］ KRYSTIAN M, CORDELIA S. Performance evaluation of local descriptors ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10):16151630．
［10］ RAHIMI A, MORENCY L, DARRELL T. Reducing drift in differential tracking ［J］. Computer Vision and Image Understanding, 2006, 109(2): 97111．
［11］ ZHU Y, FUJIMURA K. Head pose estimation for driver monitoring ［C］∥ Proceeding of IEEE Intelligent Vehicles Symposium. Parma: IEEE,2004: 501506．
［12］ LU F, MILIOS E. Globally consistent range scan alignment for environment mapping ［J］.Autonomous Robots,1997,4(4):333349．
［13］ MORENCY L, RAHIMI A, DARRELL T. Adaptive viewbased appearance models ［C］∥ Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition. Madison: IEEE,2003:803810．
［14］ HORN B. Closedform solution of absolute orientation using unit quaternions ［J］. Journal of the Optical Society of America, 1987, 44(4):629642．
［15］ FISCHLER M, BOLLES R. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography ［J］. Communications of the ACM, 1981, 24(6):381395．
［16］ KAILATH T, SAYED A, HASSIBI B. Linear estimation ［M］. EnglewoodCliffs: PrenticeHall, 1999: 1816．
［17］ VIOLA P, JONES M. Robust realtime face detection［C］∥ Proceedings of IEEE International Conference on Computer Vision. Vancouver: IEEE,2001:747．
[1] 赵建军,王毅,杨利斌. 基于时间序列预测的威胁估计方法[J]. J4, 2014, 48(3): 398-403.
[2] 崔光茫, 赵巨峰, 冯华君, 徐之海, 李奇, 陈跃庭. 非均匀介质退化图像快速仿真模型的建立[J]. J4, 2014, 48(2): 303-311.
[3] 张天煜, 冯华君, 徐之海, 李奇, 陈跃庭. 基于强边缘宽度直方图的图像清晰度指标[J]. J4, 2014, 48(2): 312-320.
[4] 刘中, 陈伟海, 吴星明, 邹宇华, 王建华. 基于双目视觉的显著性区域检测[J]. J4, 2014, 48(2): 354-359.
[5] 王相兵,童水光,钟崴,张健. 基于可拓重用的液压挖掘机结构性能方案设计[J]. J4, 2013, 47(11): 1992-2002.
[6] 王进, 陆国栋, 张云龙. 基于数量化一类分析的IGA算法及应用[J]. J4, 2013, 47(10): 1697-1704.
[7] 刘羽, 王国瑾. 以已知曲线为渐进线的可展曲面束的设计[J]. J4, 2013, 47(7): 1246-1252.
[8] 胡根生,鲍文霞,梁栋,张为. 基于SVR和贝叶斯方法的全色与多光谱图像融合[J]. J4, 2013, 47(7): 1258-1266.
[9] 吴金亮, 黄海斌, 刘利刚. 保持纹理细节的无缝图像合成[J]. J4, 2013, 47(6): 951-956.
[10] 陈潇红,王维东. 基于时空联合滤波的高清视频降噪算法[J]. J4, 2013, 47(5): 853-859.
[11] 朱凡,李悦,蒋 凯,叶树明,郑筱祥. 基于偏最小二乘的大鼠初级运动皮层解码[J]. J4, 2013, 47(5): 901-905.
[12] 吴宁, 陈秋晓, 周玲, 万丽. 遥感影像矢量化图形的多层次优化方法[J]. J4, 2013, 47(4): 581-587.
[13] 计瑜,沈继忠,施锦河. 一种基于盲源分离的眼电伪迹自动去除方法[J]. J4, 2013, 47(3): 415-421.
[14] 王翔,丁勇. 基于Gabor滤波器的全参考图像质量评价方法[J]. J4, 2013, 47(3): 422-430.
[15] 童水光, 王相兵, 钟崴, 张健. 基于BP-HGA的起重机刚性支腿动态优化设计[J]. J4, 2013, 47(1): 122-130.