Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)
Computer Technology     
Mobile robot human tracking using hierarchical features
JIA Song min, LU Ying bin, WANG Li jia, LI Xiu zhi, XU Tao
College of Electronic and Control Engineering, Beijing University of Technology, Beijing 100124, China;
Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing 100124,China;
Engineering Research Center of Digital Community, Ministry of Education, Beijing 100124, China
Download:   PDF(1929KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

First, the outer orientation of pedestrian target was obtained through head-shoulder or color features. Then the improved SIFT features of the pixels were extracted to locate the target accurately in the coarse location area. The pedestrian scale change problem was solved based on SIFT features to figure out the scale variation of the pedestrian. Simultaneously, the updating mechanism of SIFT features template library was introduced into feature reservation priority level to solve the problem of temporary occlusion and deformation of the target. Aiming at the adaptive elliptic kernel function of the traditional Cam-Shift algorithm, the variablebandwidth and orientation ellipse kernel was combined with scale variations of the human and the Epanechnikov function, which reduced the interfere of background. Furthermore, the searching area for Harris operator was limited by the outler coarse location results, which improved the real-time performance of SIFT feature matching. The experimental results indicate that the proposed mobie robot human tracking algorithm can accomplish human tracking under conditions of target scale variations, temporary occlusion and deformation.



Published: 22 September 2016
CLC:  TP 242.6  
  TP 394.1  
Cite this article:

JIA Song min, LU Ying bin, WANG Li jia, LI Xiu zhi, XU Tao. Mobile robot human tracking using hierarchical features. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(9): 1677-1683.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2016.09.06     OR     http://www.zjujournals.com/eng/Y2016/V50/I9/1677


分层特征移动机器人行人跟踪

利用行人头肩或者颜色特征,实现行人外层初定位|在初定位区域上,应用改进的尺度不变特征变换(SIFT)特征匹配实现对目标的精确定位.根据SIFT特征确定目标尺寸,解决行人尺度变化问题;将SIFT特征模板库更新机制引入特征保留优先级,解决行人短暂遮挡和形变的问题.为解决传统Cam-Shift算法的椭圆核函数自适应问题,将SIFT特征尺度变化与Epanechnikov函数融合,构成自适应带宽核函数,克服背景对目标的干扰.外层粗定位结果限制了Harris算子的检测范围,提高了SIFT特征匹配的实时性.实验结果证明,所提出移动机器人行人跟踪算法可以在目标尺度变化、短暂遮挡以及形变情况下实现行人跟踪.

[1] YOSHIMI T, NISHIYAMA M, SONOURA T, et al. Development of a person following robot with vision based target detection [C] ∥ Proceedings of the 2006 IROS International Conference on Intelligent Robots and Systems. Beijing: IROS, 2006: 5286-5291.
[2] YUN W H, KIM D, LEE J. Person following with obstacle avoidance based on multilayered mean shift and force field method [C] ∥ Proceedings of the 2010 SMC International Conference on Systems, Man and Cybernetics. Turkey: SMC,2010: 3813-3816.
[3] 曹腾,项志宇,刘济林.基于视差空间V截距的障碍物检测自主机器人[J].浙江大学学报:工学版,2015,49(3): 409-414.
CAO Teng, XIANG Zhiyu, LIU Jilin. Obstacle detection based on Vintercept in disparity space [J]. Journal of Zhejiang University: Engineering Science, 2015, 49(3): 409414.
[4] 邱雪娜.基于视觉的运动目标跟踪算法及其在移动机器人中的应用 [D]. 上海:华东理工大学,2011.
QIU Xuena. Visiobased moving object tracking and its application to mobile robot [D] Shanghai: South China University of Technology, 2011.
[5] 李杏华,刘硕. 基于计算机视觉的人体跟踪系统研究[D].天津:天津大学,2008.
LI Xinghua, LIU Shuo. Research on computer vision based human tracking system [D]. Tianjin: Tianjin University, 2008.
[6] 王丽佳,贾松敏,王爽,等.采用改进的MeanShift算法的移动机器人行人跟踪[J].光学紧密工程,2013,21(9): 2364-2370.
WANG Lijia, JIA Songmin, WANG Shuang, et al. Person tracking of mobile robot using improved MeanShift [J]. Optics and Precision Engineering, 2013, 21(9): 2364-2370.
[7] 薛陈,朱明,陈爱华.鲁邦的基于改进MeanShift的目标跟踪[J].光学精密工程,2010,18(1): 234-239.
XUE Chai,ZHU Ming,CHEN Aihua. Robust object tracking based on improved MeanShift algorithm [J]. Optics and Precision Engineering, 2010, 18(1): 234-239.
[8] LI J D. Research on camerabased human body tracking using improved camshift algorithm [J]. International Journal on Smart Sensing and Intelligent Systems, 2015, 8(2): 1104-1122.
[9] SUGA A, FUKUDA K, TAKIGUCHI T, et al. Object recognition and segmentation using SIFT and graph cuts [C] ∥ Proceedings of the 19th ICPR International Conference on Pattern Recognition. Tampa: ICPR, 2008:14.
[10] LOWE D G. Distinctive image features from scaleinvariant keypoints [J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
[11] 王丽佳,贾松敏,李秀智.多特征提取的双目机器人目标跟踪[J].控制与决策,2013,28(10): 1568-1572.
WANG Lijia, JIA Songmin, LI Xiuzhi. Person following of binocular robot by extracting multiple features [J]. Control and Decision, 2013, 28(10): 1568-1572.
[12] NAUSHAD ALI M M, ABDULLAHALWADUD M, LEE S L. Moving object detection and tracking using particle filter [J]. Applied Mechanics and Materials 2013, 321324(2): 1200-1204.
[13] SONGMIN J, WANG S. Human tracking system based on adaptive multifeature meanshift for robot under the doublelayer locating mechanism [J]. Advanced Robotics, 2014, 25(5): 564-577.
[14] 蔺海峰, 马宇峰, 宋涛. 基于 SIFT 特征目标跟踪算法研究[J]. 自动化学报, 2010, 36(8): 1204-1208.
LIN Haifeng, MA Yufeng, Research on object tracking algorithm based on SIFT [J]. Acta Automatica Sinica, 2010, 36(8): 1204-1208.
[15] 徐进,沈敏一,杨力,等. 基于双目光束法平差的机器人定位与地形拼接[J]. 浙江大学学报:工学版, 2011, 45(7): 1141-1146.
XU Jin, SHEN Minyi, YANG Li, et al. Binocular bundle adjustment based localization and terrain stitching for robot [J]. Journal of Zhejiang University: Engineering Science, 2011, 45(7): 1141-1146.
[16] 董蓉, 李勃. 基于 SIFT 特征的目标多自由度 MeanShift 跟踪算法[J].控制与决策, 2012,27(3): 399-407.
DONG Rong, LI Bo. Multidegreeoffreedom MeanShift tracking algorithm based on SIFT feature [J]. Control and Decision, 2012, 27(3): 399-407.
[17] 王丽佳,贾松敏. 基于改进在线多示例学习算法的机器人目标跟踪[J].自动化学报,2014,40(12): 2916-2925.
WANG Lijia, JIA Songmin. Person following for mobile robot using improved multiple instance learning [J]. Acta Automatica Sinica, 2014, 40(12): 2916-2925.

[1] JIANG Wen ting, GONG Xiao jin, LIU Ji lin. Incremental large scale dense semantic mapping[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(2): 385-391.
[2] MA Zi ang, XIANG Zhi yu. Calibration and 3D reconstruction with omnidirectional ranging by optic flow camera[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(9): 1651-1657.
[3] WANG Li-jun, HUANG Zhong-chao, ZHAO Yu-qian. New spatial-coherent latent topic model based on super-pixel segmentation and scene classification method[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 402-408.
[4] CAO Teng, XIANG Zhi-yu, LIU Ji-lin. Obstacle detection based on V-intercept in disparity space[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 409-414.
[5] LU Wei, XIANG Zhi-yu, YU Hai-bin, LIU Ji-lin. Object compressive tracking based on adaptive multi-feature appearance model[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(12): 2132-2138.
[6] CHEN Ming-ya, XIANG Zhi-yu, LIU Ji-lin. Assistance localization method for mobile robot based on
monocular natural visual landmarks
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(2): 285-291.
[7] LIN Ying, GONG Xiao-jin, LIU Ji-lin. Calibration of fisheye cameras based on the viewing sphere[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2013, 47(8): 1500-1507.
[8] WANG Hui-fang, ZHU Shi-qiang, WU Wen-xiang. Improved adaptive robust control of servo system with harmonic drive[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(10): 1757-1763.
[9] OUYANG Liu, XU Jin, GONG Xiao-jin, LIU Ji-lin. Optimization of visual odometry based on uncertainty analysis[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(9): 1572-1579.
[10] MA Li-sha, ZHOU Wen-hui, GONG Xiao-jin, LIU Ji-lin. Motion constrained generalized Field D* path planning[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(8): 1546-1552.
[11] LU Dan-hui, ZHOU Wen-hui, GONG Xiao-jin, LIU Ji-lin. Decoupled mobile robot motion estimation based on fusion of
visual and inertial measurement unit
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(6): 1021-1026.
[12] XU Jin, SHEN Min-yi, YANG Li, WANG Wei-qiang, LIU Ji-lin. Binocular bundle adjustment based localization
and terrain stitching for robot
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2011, 45(7): 1141-1146.
[13] CHEN Jia-qian, LIUYu-tian, HE Yan, JIANG Jing-ping. Novel dynamic mapping method based on occupancy grid
model and sample sets
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2011, 45(5): 794-798.
[14] CHEN Jia-Gan, HE Yan, JIANG Jing-Ping. Improved FastSLAM algorithm based on importance weight smoothing[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2010, 44(8): 1454-1459.
[15] LU Ren-Quan, WEI Jiang, XUE An-Ke. State estimation of network control system based on
linear quantization
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2010, 44(7): 1400-1405.