|
|
|
Binocular bundle adjustment based localization
and terrain stitching for robot |
| XU Jin, SHEN Min-yi, YANG Li, WANG Wei-qiang, LIU Ji-lin |
| Department of Information and Electronic Engineering, Zhejiang University, Hangzhou 310027, China |
|
|
|
Abstract In order for robot to achieve future complex intelligent tasks such as path planning and obstacle avoidance, a binocular bundle adjustment based localization and stitching method was proposed to solve the problem of precise localization of the mobile robot and dense terrain mapping of unknown environment. The corresponding features in the inter-frames were tracked from the image sequences captured by the stereo vision system mounted on the mobile vehicle.Then the system estimated the location and pose of robot by using binocular bundle adjustment (BBA) method. Dense three-dimensional terrain reconstruction information was obtained by stereo matching of images captured by stereo camera. Then terrain reconstruction and stitching were realized incorporated with the pose information estimated by localization. Experimental results demonstrated the effectiveness and robustness of the system．
|
|
Published: 01 July 2011
|
|
|
基于双目光束法平差的机器人定位与地形拼接
为了实现自主移动机器人完成复杂智能任务,如路径规划和避障等,针对移动机器人在复杂未知环境中精确定位并对周围环境进行致密地形构建问题,提出一种基于双目光束法平差的机器人定位与致密地形拼接算法.利用安装在移动机器人上的立体相机获取图像序列,跟踪前后帧图像序列中的对应特征点,基于双目光束法平差优化(BBA)精确估计机器人位置姿态.对左右相机采集图像对进行立体匹配获取致密三维地形信息,结合定位时获取的旋转平移姿态,实现了地形的构建与拼接.实验结果表明,该算法具有较好的实时性和鲁棒性.
|
|
| ［1］ MAIMONE M, CHENG Y, MATTHIES L, et al. Two years of visual odometry on the mars exploration rovers ［J］. Journal of Field Robotics, Special Issue on Space Robotics, 2007, 24(3): 169-186．
［2］ PRETTO A, MENEGATTI E, BENNEWITZ M, et al. A visual odometry framework robust to motion blur ［C］∥ IEEE International Conference on Robotics and Automation. Kobe, Japan: IEEE, 2009: 2250-2257．
［3］ SCARAMUZZA D, SIEGWART R. Appearanceguided monocular omnidirectional visual odometry for outdoor ground vehicles ［J］. IEEE Transactions on Robotics, 2008, 24(5): 1015-1026．
［4］ KONOLIGE K, AGRAWAL M. FrameSLAM: from bundle adjustment to realtime visual mapping ［J］. IEEE Transactions on Robotics, 2008, 24(5): 1066-1077．
［5］ SHEN M Y, XIANG Z Y, LIU J L, et al. Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment ［J］. Journal of Zhejiang University: Science A, 2008, 9(10): 1341-1350．
［6］ BEIS J, LOWE D G. Shape indexing using approximate nearestneighbour search in highdimensional spaces ［C］∥ Conference on Computer Vision and Pattern Recognition. Puerto Rico: ［s.n.］,1997: 1000-1006．
［7］ LOWE D G. Distinctive image features from scaleinvariant keypoints ［J］. International Journal of Computer Vision, 2004, 60(2): 91-110．
［8］ 张广军. 机器视觉 ［M］. 北京：科学出版社,2005: 24-26．
［9］ 马颂德,张正友. 计算机视觉 ［M］. 北京：科学出版社,1997: 95-98．
［10］ FISCHLER M A, BOLLES R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography ［J］. ACM Communications, 1981, 24(6): 381-395．
［11］ LEVENBERG K. A method for the solution of certain nonlinear problems in least squares ［J］. Quarterly of Applied Mathematics, 1944, 2(2): 164-168．
［12］ 王之卓. 摄影测量原理 ［M］. 武汉:测绘科技大学出版社,2000: 10-11．
［13］ 沈晔湖, 刘济林. 利用立体图对的三维人脸模型重建算法［J］. 计算机辅助设计与图形学学报, 2006, 12(18): 1904-1909．
SHEN Yehu, LIU Jilin. From stereo pairs to 3D face model ［J］. Computer Aided Design and Computer Graphics, 2006, 12(18): 1904-1909．
［14］ TRIGGS B, MCLAUCHLAN P, HARTLEY R, et al. A bundle adjustment: a modern synthesis ［C］∥Proceedings of the International Workshop on Visual Algorithm: Theory and Practice. Corfu, Greece: ［s.n.］, 1999: 298-372．
［15］ KWOLEK B. Visual odometry based on Gabor filters and sparse bundle adjustment ［C］∥IEEE International Conference on Robotics and Automation. Roma: IEEE, 2007: 3573-3578． |
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
