Please wait a minute...
J4  2009, Vol. 43 Issue (6): 975-977    DOI: 10.3785/j.issn.1008-973X.2009.
Video foreground segmentation with camera movement
 CHEN Cheng, PENG Huo-Ting, XIAO Dun
(Institute of Artificial Intelligence, Zhejiang University, Hangzhou 310027, China)
Download:   PDF(2460KB) HTML
Export: BibTeX | EndNote (RIS)      


A new approach based on non-parametric motion estimation and image registration was proposed for video foreground segmentation with camera movement.   First, non-parametric motion estimation was conducted between the video frame containing foreground and a similar training background image. Then, a new background image with exactly the same viewpoint as the video frame was constructed on the fly, and foreground pixels were segmented by classical background subtraction.  A manifold based extension was also proposed to alleviate the low efficiency of motion estimation. In the offline stage, motion estimation for training background images was pre-calculated, and a low-dimensional background manifold was discovered. In the online stage, motion estimation involving the new frame was conducted by fast interpolation on the manifold. Experimental results  show that the proposed method segments videos accurately and efficiently.

Published: 01 June 2009
CLC:  TP391.41  
Cite this article:

CHEN Cheng, PENG Huo-Ting, XIAO Dun. Video foreground segmentation with camera movement. J4, 2009, 43(6): 975-977.

URL:     OR


提出一种基于非参数化运动估计和图像配准的方法来进行相机运动条件下的前景提取.通过对视频帧和接近的训练背景图像进行非参数化运动估计,动态地构造出一幅和视频帧的视角完全相同的背景图像, 再通过背景减除提取前景. 为了解决运动估计的计算效率问题, 又提出一种基于流形的改进算法: 在离线阶段, 预先对训练背景图像进行非参数化运动估计, 并利用流形学习对训练背景图像进行建模; 在在线阶段, 通过在背景流形上进行运动插值来快速地估计新视频帧和训练背景图像之间的运动. 实验表明,改进的方法在基本保持像素提取准确率的同时获得了很高的效率.

[1] LEUNG M, YANG Y. Human body motion segmentation in a complex scene [J]. Pattern Recognition, 1987, 20(1): 5564.
[2] STAUFFER C, GRIMSON W. Adaptive background mixture models for realtime tracking [C]∥ Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 1999:246252.
[3] KATO J, WATANABE T, JOGA S, et al. An HMM based segmentation method for traffic monitoring movies [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24 (9): 12911296.
[4] RIDDER C, MUNKELT O, KIRCHNER H. Adaptive background estimation and foreground detection using kalman-filtering [C]∥ Proceedings of International Conference on Recent Advances in Mechatronics. Berlin: Springer, 1995:193199.
[5] WREN C, AZARBAYEJANI A, DARRELL T, et al. Pfinder: Real-time tracking of human body [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 780785.
[6] MITTALAND A, HUTTENLOCHER D. Scene modeling for wide area surveillance and image synthesis [C]∥ Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2000, 2: 160167.
[7] WIXSON L. Detecting salient motion by accumulating directionally-consistent flow [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8): 774780.
[8] HEUER J, KAUP A. Global motion estimation algorithm for video segmentation [C]∥ Proceedings of ACM Multimedia. New York: ACM, 1999:261264.
[9] SONG K, HUANG J. Fast optical flow estimation and its application to real-time obstacle avoidance [C]∥ Proceedings of IEEE International Conference on Robotics and Automation. New York: IEEE, 2001: 28912896.
[10] VERRI A, POGGIO T. Against quantitative optical flow [C]∥ Proceedings of IEEE International Conference on Computer Vision. New York: IEEE, 1987:171180.
[11] TENENBAUM J, SILVA V, LANGFORD J. A global geometric framework for nonlinear dimensionality reduction [J]. Science ,2000, 290(5500): 23192323.
[12] BENGIO Y, PAIEMENT J, VINCENT P. Out-of-sample extensions for LLE, Isomap, MDS, Eigenmaps, and spectral clustering [C]∥ Advances in Neural Information Processing Systems 16. Cambrige: MIT Press, 2004.

[1] SUN Zhi-Hai, KONG Mo-Ceng, SHU Shan-An. Improved algorithm of subtractive clustering for object location  in video sequences[J]. J4, 2010, 44(3): 458-462.
[2] WANG Xuan-Yin, LIANG Dong-Tai. Surface defect detection based on multivariate image analysis[J]. J4, 2010, 44(3): 448-452.
[3] FAN Xiang, XIA Shun-ren. Feature based automatic stitching of microscopic images[J]. J4, 2009, 43(7): 1182-1186.
[4] ZHANG Dong-Mei, LIU Li-Gang. Angle-filtering based smoothing algorithm for planar graphs[J]. J4, 2009, 43(6): 1042-1046.