Please wait a minute...
J4  2014, Vol. 48 Issue (2): 279-284    DOI: 10.3785/j.issn.1008-973X.2014.02.014
    
Monocular vision odometry based on the fusion of optical flow and feature points matching
ZHENG Chi1,2, XIANG Zhi-yu1,2, LIU Ji-lin1,2
1. Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China;
2. Zhejiang Provincial Key Laboratory of Information Network Technology, Hangzhou 310027, China
Download:   PDF(2019KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

For the problem of real-time precise localization on the urban flat surface, a monocular vision odometry based on the Kalman fusion of optical flow and feature points matching has been proposed. Based on the assumption of flat plane, the method of optical flow tracking was applied for localization between two frames in small movement. Meanwhile, the traditional SURF feature points matching between two frames in long distance was applied for refining the output of the optical flow method. The position and posture of the robot was updated through Kalman filter. The results demonstrate that the fusion algorithm overcomes the shortcomings of poor positioning accuracy of the optical flow and the low processing speed of the feature matching method, highlighting the advantages of real-time performance of optical flow and high accuracy of the feature matching. The fusion algorithm is robust to the circumstances such as illumination change and low road texture, producing a good localization results in real-time.



Published: 01 February 2014
CLC:  TN 919  
Cite this article:

ZHENG Chi, XIANG Zhi-yu, LIU Ji-lin. Monocular vision odometry based on the fusion of optical flow and feature points matching. J4, 2014, 48(2): 279-284.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2014.02.014     OR     http://www.zjujournals.com/eng/Y2014/V48/I2/279


融合光流与特征点匹配的单目视觉里程计

针对城市平坦路面准确实时定位的问题,提出将光流跟踪法与特征点匹配进行卡尔曼融合的单目视觉里程计方法.基于平面假设,利用光流跟踪法进行帧间小位移定位,同时利用传统的加速鲁棒特征点(SURF)进行帧间大位移匹配来矫正光流法结果.通过卡尔曼滤波更新机器人的位置和姿态.结果表明,融合算法克服了光流法定位精度差和特征点匹配法处理速度慢的缺点,突出了光流法实时性和特征点匹配定位准确性的优点,该方法能够提供较准确的实时定位输出,并对光照变化和路面纹理较少的情况有一定的鲁棒性.

\
[1\] ROYER E,LHUILLIER M,DHOME M,et al. Monocular vision for mobile robot localization and autonomous navigation \
[J\]. International Journal of Computer Vision, 2007, 74(3): 237-260.
\
[2\] SONG Xiao-jing,SONG Zi-bin,SENEVIRATNE L D,et al. Optical flow-based slip and velocity estimation technique for unmanned skid-steered vehicles \
[C\]∥ Intelligent Robots and Systems (IROS), 2008 IEEE/RSJ International Conference on. Nice: IEEE, 2008: 101-106.
\
[3\] NISTER D,NARODITSKY O,BERGEN J. Visual odometry \
[C\]∥ Computer Vision and Pattern Recognition (CVPR),2004 IEEE Computer Society Conference on. Washington, DC: IEEE, 2004, 1(1): 652-659.
\
[4\] HOWARD A. Real-time stereo visual odometry for autonomous ground vehicles \
[C\]∥ Intelligent Robots and Systems (IROS), 2008 IEEE/RSJ International Conference on. Nice: IEEE, 2008: 3946-3952.
\
[5\] KITT B,REHDER J,CHAMBERS A,et al. Monocular visual odometry using a planar road model to solve scale ambiguity \
[C\]∥ Proceeding of European Conference on Mobile Robots.  Orebro: \
[s. n.\], 2011: 43-48.
\
[6\] SUN D, ROTH S, BLACK M J. Secrets of optical flow estimation and their principles \
[C\]∥ Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on. San Francisco: IEEE, 2010: 2432-2439.
\
[7\] LUCAS B D,KANAKE T. An iterative image registration technique with an application to stereo vision  \
[C\]∥ International Joint Conference on Artificial Intelligence (IJCIA). Vancouver: AAAI,1981: 674-679.
\
[8\] BOUGUET J. Pyramidal Implementation of the affine Lucas Kanade feature tracker description of the algorithm \
[J\]. Intel Corporation,2001, 5.
\
[9\] BAY H, ESS A, TUYTELAARS T, et al.SURF: speeded up robust features \
[J\]. Computer Vision and Image Understanding (CVIU), 2008, 110(3): 346-359.