Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2010, Vol. 11 Issue (4): 270-277    DOI: 10.1631/jzus.C0910308
    
Exemplar-based video inpainting with large patches
Abbas Koochari, Mohsen Soryani
Department of Computer Engineering, Iran University of Science and Technology, Tehran 16846-13114, Iran
Download:   PDF(516KB)
Export: BibTeX | EndNote (RIS)      

Abstract  Inpainting is the process of reconstructing damaged regions of images and video frames. This study deals with weaknesses of the current video inpainting techniques, when an object is totally damaged, and a framework for video inpainting is proposed. Using this framework, the moving object is separated from the background. A large mosaic image is constructed using the moving object and then a patch-based method with large patches is used to fill holes. In each frame, the inpainted foreground is obtained by placing the object in its location. Missing areas of the stationary background are also filled separately and the final video is produced by composing the inpainted background and object frames. Results for three video sequences with an occluded object show that this approach represents the object in the missing region better than other approaches.

Key wordsVideo inpainting      Patch      Background modeling      Mosaic     
Received: 24 May 2009      Published: 22 March 2010
CLC:  TP391.41  
Cite this article:

Abbas Koochari, Mohsen Soryani. Exemplar-based video inpainting with large patches. Front. Inform. Technol. Electron. Eng., 2010, 11(4): 270-277.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/jzus.C0910308     OR     http://www.zjujournals.com/xueshu/fitee/Y2010/V11/I4/270


Exemplar-based video inpainting with large patches

Inpainting is the process of reconstructing damaged regions of images and video frames. This study deals with weaknesses of the current video inpainting techniques, when an object is totally damaged, and a framework for video inpainting is proposed. Using this framework, the moving object is separated from the background. A large mosaic image is constructed using the moving object and then a patch-based method with large patches is used to fill holes. In each frame, the inpainted foreground is obtained by placing the object in its location. Missing areas of the stationary background are also filled separately and the final video is produced by composing the inpainted background and object frames. Results for three video sequences with an occluded object show that this approach represents the object in the missing region better than other approaches.

关键词: Video inpainting,  Patch,  Background modeling,  Mosaic 
[1] Kai ZHU, Gang LIU , Long ZHAO , Wan ZHANG. Label fusion for segmentation via patch based on local weighted voting[J]. Front. Inform. Technol. Electron. Eng., 2017, 18(5): 680-688.
[2] Gopi Ram , Durbadal Mandal , Sakti Prasad Ghoshal , Rajib Kar . Optimal array factor radiation pattern synthesis for linear antenna array using cat swarm optimization: validation by an electromagnetic simulator[J]. Front. Inform. Technol. Electron. Eng., 2017, 18(4): 570-577.
[3] You-bo Liu, Jun-yong Liu, Gareth Taylor, Ting-jian Liu, Jing Gou, Xi Zhang. Situational awareness architecture for smart grids developed in accordance with dispatcher’s thought process: a review[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(11): 1107-1121.
[4] Yan-hong Liu, Juan Cao, Zhong-gui Chen, Xiao-ming Zeng. Ray-triangular Bézier patch intersection using hybrid clipping algorith[J]. Front. Inform. Technol. Electron. Eng., 2016, 17(10): 1018-1030.
[5] Min Yuan, Bing-xin Yang, Yi-de Ma, Jiu-wen Zhang, Fu-xiang Lu, Tong-feng Zhang. Multi-scale UDCT dictionary learning based highly undersampled MR image reconstruction using patch-based constraint splitting augmented Lagrangian shrinkage algorithm[J]. Front. Inform. Technol. Electron. Eng., 2015, 16(12): 1069-1087.
[6] Hong-chao Ma, Jie Sun. Intelligent optimization of seam-line finding for orthophoto mosaicking with LiDAR point clouds[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(5): 417-429.