Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2012, Vol. 13 Issue (6): 472-482    DOI: 10.1631/jzus.C1100311
    
Accurate real-time stereo correspondence using intra- and inter-scanline optimization
Li Yao, Dong-xiao Li, Jing Zhang, Liang-hao Wang, Ming Zhang
Institute of Information and Communication Engineering, Zhejiang University, Hangzhou 310027, China; Zhejiang Provincial Key Laboratory of Information Network Technology, Hangzhou 310027, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  This paper deals with a novel stereo algorithm that can generate accurate dense disparity maps in real time. The algorithm employs an effective cross-based variable support aggregation strategy within a scanline optimization framework. Rather than matching intensities directly, the use of adaptive support aggregation allows for precisely handling the weak textured regions as well as depth discontinuities. To improve the disparity results with global reasoning, we reformulate the energy function on a tree structure over the whole 2D image area, as opposed to dynamic programming of individual scanlines. By applying both intra- and inter-scanline optimizations, the algorithm reduces the typical ‘streaking’ artifact while maintaining high computational efficiency. The experimental results are evaluated on the Middlebury stereo dataset, showing that our approach is among the best for all real-time approaches. We implement the algorithm on a commodity graphics card with CUDA architecture, running at about 35 fames/s for a typical stereo pair with a resolution of 384×288 and 16 disparity levels.

Key wordsStereo correspondence      Scanline optimization      Real-time     
Received: 23 October 2011      Published: 05 June 2012
CLC:  TN911.73  
Cite this article:

Li Yao, Dong-xiao Li, Jing Zhang, Liang-hao Wang, Ming Zhang. Accurate real-time stereo correspondence using intra- and inter-scanline optimization. Front. Inform. Technol. Electron. Eng., 2012, 13(6): 472-482.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C1100311     OR     http://www.zjujournals.com/xueshu/fitee/Y2012/V13/I6/472


Accurate real-time stereo correspondence using intra- and inter-scanline optimization

This paper deals with a novel stereo algorithm that can generate accurate dense disparity maps in real time. The algorithm employs an effective cross-based variable support aggregation strategy within a scanline optimization framework. Rather than matching intensities directly, the use of adaptive support aggregation allows for precisely handling the weak textured regions as well as depth discontinuities. To improve the disparity results with global reasoning, we reformulate the energy function on a tree structure over the whole 2D image area, as opposed to dynamic programming of individual scanlines. By applying both intra- and inter-scanline optimizations, the algorithm reduces the typical ‘streaking’ artifact while maintaining high computational efficiency. The experimental results are evaluated on the Middlebury stereo dataset, showing that our approach is among the best for all real-time approaches. We implement the algorithm on a commodity graphics card with CUDA architecture, running at about 35 fames/s for a typical stereo pair with a resolution of 384×288 and 16 disparity levels.

关键词: Stereo correspondence,  Scanline optimization,  Real-time 
[1] Dong-wei Xu, Yong-dong Wang, Li-min Jia, Yong Qin, Hong-hui Dong. Real-time road traffic state prediction based on ARIMA and Kalman filter[J]. Front. Inform. Technol. Electron. Eng., 2017, 18(2): 287-302.
[2] Rui Zhao, Gui-he Qin, Jia-qiao Liu. A rectangle bin packing optimization approach to the signal scheduling problem in the FlexRay static segment[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(4): 375-388.
[3] Qi-rong Mao, Xin-yu Pan, Yong-zhao Zhan, Xiang-jun Shen. Using Kinect for real-time emotion recognition via facial expressions[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(4): 272-282.
[4] Jian Ding, Tao Huang, Jiang Liu, Yun-jie Liu. Virtual network embedding based on real-time topological attributes[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(2): 109-118.
[5] Xiao-hu Ma, Yan-qi Tan, Gang-min Zheng. A fast classification scheme and its application to face recognition[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(7): 561-572.
[6] Zhi-bo Wang, Zhi Wang, Hong-long Chen, Jian-feng Li, Hong-bin Li, Jie Shen. HierTrack: an energy-efficient cluster-based target tracking system for wireless sensor networks[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(6): 395-406.
[7] Li Lu, Dong-qin Feng, Jian Chu. Improving the real-time performance of Ethernet for plant automation (EPA) based industrial networks[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(6): 433-448.
[8] Ali Uysal, Raif Bayir. Real-time condition monitoring and fault diagnosis in switched reluctance motors with Kohonen neural network[J]. Front. Inform. Technol. Electron. Eng., 2013, 14(12): 941-952.
[9] Lei Zhang, Mattias Lampe, Zhi Wang. A hybrid genetic algorithm to optimize device allocation in industrial Ethernet networks with real-time constraints[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(12): 965-975.