Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  2008, Vol. 9 Issue (12): 1621-1630    DOI: 10.1631/jzus.A0820200
Electrical & Electronic Engineering     
Frame rate up-conversion using multiresolution critical point filters with occlusion refinement
Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO
Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China
Download:     PDF (0 KB)     
Export: BibTeX | EndNote (RIS)      

Abstract  In this paper, multiresolution critical-point filters (CPFs) are employed to image matching for frame rate up-conversion (FRUC). By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation (ORCMI). In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Experimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCMI can achieve 1~2 dB PSNR gain for standard video sequences.

Key wordsFrame rate up-conversion      Multiresolution critical-point filters      Occlusion refinement     
Received: 19 March 2008     
CLC:  TN919.8  
Cite this article:

Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO. Frame rate up-conversion using multiresolution critical point filters with occlusion refinement. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1621-1630.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.A0820200     OR     http://www.zjujournals.com/xueshu/zjus-a/Y2008/V9/I12/1621

[1] Hua ZHANG, Xiang TIAN, Yao-wu CHEN. A video structural similarity quality metric based on a joint spatial-temporal visual attention model[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(12): 1696-1704.
[2] Hu WEI, Tao LIN, Zheng-hui LIN. Parallel processing architecture of H.264 adaptive deblocking filters[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(8): 1160-1168.
[3] Han-jie MA, Fan ZHOU, Rong-xin JIANG, Yao-wu CHEN. A network-aware error-resilient method using prioritized intra refresh for wireless video communications[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(8): 1169-1176.
[4] Byeongdu LA, Minyoung EOM, Yoonsik CHOE. Dominant edge direction based fast intra mode decision in the H.264/AVC encoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(6): 767-777.
[5] Sheng-bo CHEN, Wei CHEN, Wei-lan HUANG, Li-jun ZHAI, Xu-ming LIU. A cross-layer approach to enable multipacket transmission in MIMO-SDMA based WLAN[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(2): 271-278.
[6] Jun-yan HUO, Yi-lin CHANG, Hai-tao YANG, Shuai WAN. Color compensation for multi-view video coding based on diversity of cameras[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1631-1637.
[7] Wan-yi LI, Lu YU. Highly parallel implementation of sub-pixel interpolation for AVS HDTV decoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1638-1643.
[8] Kai LUO, Dong-xiao LI, Ming ZHANG. High throughput bandwidth optimized VLSI design for motion compensation in AVS HDTV decoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(6): 822-832.
[9] Jin-feng ZHANG, Rong-gang WANG, Jian-wei NIU, Yuan DONG, Hai-la WANG. Rate-distortion optimized bitstream switching for peer-to-peer live streaming[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(4): 445-456.
[10] Xiang-wen WANG, Jun SUN, Rong XIE, Song-yu YU. Efficient video downscaling transcoder from MPEG-2 to H.264[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(4): 457-463.
[11] Gui-xu LIN, Shi-bao ZHENG. Perceptual importance analysis for H.264/AVC bit allocation[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(2): 225-231.
[12] KUMARAYAPA Ajith, ZHANG Ye. More efficient ground truth ROI image coding technique: implementation and wavelet based application analysis[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(6): 835-840.
[13] WU Jing, YE Xiu-qing, GU Wei-kang. An adaptive fuzzy filter for coding artifacts removal in video and image[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(6): 841-848.
[14] LI Ji-liang, FANG Xiang-zhong, HOU Jun. Mean shift based log-Gabor wavelet image coding[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(4): 620-624.
[15] WANG Shu-hui, LIN Tao, LIN Zheng-hui. Macroblock-level decoding and deblocking method and its pipeline implementation in H.264 decoder SOC design[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(1 ): 6-.