Please wait a minute...
Front. Inform. Technol. Electron. Eng.  2016, Vol. 17 Issue (5): 422-434    DOI: 10.1631/FITEE.1500316
    
A multiscale-contour-based interpolation framework for generating a time-varying quasi-dense point cloud sequence
Chu-hua Huang, Dong-ming Lu, Chang-yu Diao
College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; College of Computer Science and Technology, Guizhou University, Guiyang 550025, China; Academy of Cultural Heritage, Zhejiang University, Hangzhou 310058, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  To speed up the reconstruction of 3D dynamic scenes in an ordinary hardware platform, we propose an efficient framework to reconstruct 3D dynamic objects using a multiscale-contour-based interpolation from multi-view videos. Our framework takes full advantage of spatio-temporal-contour consistency. It exploits the property to interpolate single contours, two neighboring contours which belong to the same model, and two contours which belong to the same view at different times, corresponding to point-, contour-, and model-level interpolations, respectively. The framework formulates the interpolation of two models as point cloud transport rather than non-rigid surface deformation. Our framework speeds up the reconstruction of a dynamic scene while improving the accuracy of point-pairing which is used to perform the interpolation. We obtain a higher frame rate, spatio-temporal-coherence, and a quasi-dense point cloud sequence with color information. Experiments with real data were conducted to test the efficiency of the framework.

Key wordsMulti-view video      Free-viewpoint video      Point-pair      Multiscale-contour-based interpolation      Spatio-temporal-contour      Consistency      Time-varying point cloud sequence     
Received: 28 September 2015      Published: 04 May 2016
CLC:  TP391.4  
Cite this article:

Chu-hua Huang, Dong-ming Lu, Chang-yu Diao. A multiscale-contour-based interpolation framework for generating a time-varying quasi-dense point cloud sequence. Front. Inform. Technol. Electron. Eng., 2016, 17(5): 422-434.

URL:

http://www.zjujournals.com/xueshu/fitee/10.1631/FITEE.1500316     OR     http://www.zjujournals.com/xueshu/fitee/Y2016/V17/I5/422


基于多尺度轮廓插值生成准密集时变点云模型序列

目的:提高采用多视角视频序列生成时变三维模型序列的速度,以更好地跟踪三维动态物体的形变过程;同时保证时变三维模型序列的外观质量。
创新点:提出基于多尺度轮廓插值生成时变点云模型序列的方法。利用重建对象轮廓的多尺度时空连续性,完成时变三维模型序列的时空维度插值。
方法:首先,采用基于剪影轮廓原理重建物体关键帧的稀疏三维模型。接着,分析三维模型的轮廓点在点级别、轮廓级别、模型级别的连续性,并在该过程中采用距离图插值来增强轮廓的连续性。然后,采用最近点查找方法获得匹配点对,在三个尺度上对匹配点对进行线性密集化。最后,生成具有良好时空一致性的准密集时变三维模型序列。
结论:利用轮廓多尺度时空连续性能够提高重建对象的形变跟踪速度,且时变三维模型序列具有良好的外观质量。

关键词: 多视角视频序列,  自由视点视频序列,  匹配点对,  多尺度轮廓插值,  时空轮廓,  一致性,  时变点云模型序列 
[1] Aisha SIDDIQA , Ahmad KARIM , Abdullah GANI. Big data storage technologies: a survey[J]. Front. Inform. Technol. Electron. Eng., 2017, 18(8): 1040-1070.
[2] Lin-jun Fan, Yun-xiang Ling, Xing-tao Zhang, Jun Tang. Quantitative evaluation of model consistency evolution in compositional service-oriented simulation using a connected hyper-digraph[J]. Front. Inform. Technol. Electron. Eng., 2014, 15(1): 1-12.
[3] Zheng Zhu, Dong-xiao Li, Ming Zhang. Optimizing inter-view prediction structures for multi-view video coding using simulated annealing[J]. Front. Inform. Technol. Electron. Eng., 2011, 12(2): 155-162.
[4] Ashkan Tashk, Mohammad Sadegh Helfroush, Mohammad Javad Dehghani. A Chebyshev/Legendre polynomial interpolation approach for fingerprint orientation estimation smoothing and prediction[J]. Front. Inform. Technol. Electron. Eng., 2010, 11(12): 976-988.