Please wait a minute...
Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering)  0, Vol. 7 Issue (100): 41-47    DOI: 10.1631/jzus.2006.AS0041
Error Control, Resilience and Concealment     
Content-adaptive robust error concealment for packet-lossy H.264 video streaming
Liao Ning, Yan Dan, Quan Zi-Yi, Men Ai-Dong
Multimedia Center, School of Telecommunication Engineering, Beijing University of Posts & Telecom, Beijing 100876, China
Download:   PDF(0KB)
Export: BibTeX | EndNote (RIS)      

Abstract  In this paper, we present a spatio-temporal post-processing error concealment (EC) algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks. It aims at optimizing the subjective quality of the restored video under the constraints of low delay and computational complexity, which are critical to real-time applications and portable devices having limited resources. Specifically, it takes into consideration the physical property of motion field in order to achieve more meaningful perceptual video quality, in addition to the improved objective PSNR. Further, a simple bilinear spatial interpolation approach is combined with the improved boundary-match (B-M) based temporal EC approach according to texture and motion activity analysis. Finally, we propose a low complexity temporal EC method based on motion vector interpolation as a replacement of the B-M based approach in the scheme under low-computation requirement, or as a complement to further improve the scheme’s performance in applications having enough computation resources. Extensive experiments demonstrated that the proposal features not only better reconstruction, objectively and subjectively, than JM benchmark, but also robustness to different video sequences.

Key wordsError concealment      Error control      H.264/AVC      Video streaming      Lossy transmission     
Received: 05 December 2005     
CLC:  TN919.8  
Cite this article:

Liao Ning, Yan Dan, Quan Zi-Yi, Men Ai-Dong. Content-adaptive robust error concealment for packet-lossy H.264 video streaming. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 0, 7(100): 41-47.

URL:

http://www.zjujournals.com/xueshu/zjus-a/10.1631/jzus.2006.AS0041     OR     http://www.zjujournals.com/xueshu/zjus-a/Y0/V7/I100/41

[1]   Alkachouch, Z., Bellanger, M.G., 2000. DCT-based spatial domain interpolation of blocks in images. IEEE Trans. on Image Processing, 9(4):729-732.
doi: 10.1109/83.841948
[2]   Chen, M.J., Chen, L.G., Weng, R.M., 1997. Error concealment of lost motion vectors with overlapped motion compensation. IEEE Trans. Circuits and Systems for Video Technology, 7(3):560-563.
doi: 10.1109/76.585936
[3]   Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, 2003. Draft ITU-T Recomm. and Final Draft Int’l. Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC), Doc.G050r1.
[4]   Kwok, W., Sun, H., 1993. Multidirectional interpolation for spatial error concealment. IEEE Trans. on Consumer Electronics, 39(3):455-460.
doi: 10.1109/30.234620
[5]   Mualla, M.A., Canagarajah, C.N., Bull, D.R., 2000. Motion field interpolation for temporal error concealment. IEEE Proc. Visual Image Signal Processing, 147(5):445-453.
[6]   Salama, P., Shroff, N.B., Coyle, E.J., Delp, E.J., 1995. Error Concealment Techniques for Encoded Video Streams. Pro. Int. Conf. Image Processing, p.9-12.
[7]   Salama, P., Schroff, N.B., Delp, E.J., 2000. Error concealment in MPEG video streams over ATM networks. IEEE J. on Select. Areas in Communication, 18(6):1129-1144.
doi: 10.1109/49.848263
[8]   Shirani, S., Kossentini, F., Ward, R., 2000. A concealment method for video communication in an error-prone environment. IEEE J. Select. Areas Commun., 18(6): 1122-1128.
doi: 10.1109/49.848261
[9]   Sun, H., Kwok, W., 1995. Concealment of damaged block transform coded images using projections onto convex sets. IEEE Trans. on Image Processing, 4(4):470-479.
doi: 10.1109/83.370675
[10]   Tsekeridou, S., Pitas, I., 2000. MPEG-2 error concealment based on block-matching principles. IEEE Trans. Circuits and Systems for Video Tech., 10(4):646-658.
doi: 10.1109/76.845010
[11]   VCEG, 1999. Internet Error Patterns VCEG-O38r1.doc. ftp://ftp.imtc-files.org/jvt-experts/9910_Red/Q15-I16r1.zip.
[12]   Wang, Y., Ostermann, J., Zhang, Y.Q., 2002a. Two-dimensional Motion Models. Video Processing and Communications, Section 5.5. Prentice Hall.
[13]   Wang, Y.K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M., 2002b. The error concealment feature in the H.26L test model. Proc. Int. Conf. Image Processing, 2:729-732.
[14]   Wang, Z., Sheikh, H.R., Bovik, A.C., 2003. Objective Video Quality Assessment. In: Furht, B., Marqure, O. (Eds.), Handbook of Video Databases: Design and Applications. CRC Press, p.1041-1078.
[15]   Wenger, S., 2003. H.264/AVC over IP. IEEE Trans. on Circuits and Systems for Video Tech., 13(7):645-656.
doi: 10.1109/TCSVT.2003.814966
[1] Hua ZHANG, Xiang TIAN, Yao-wu CHEN. A video structural similarity quality metric based on a joint spatial-temporal visual attention model[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(12): 1696-1704.
[2] Han-jie MA, Fan ZHOU, Rong-xin JIANG, Yao-wu CHEN. A network-aware error-resilient method using prioritized intra refresh for wireless video communications[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(8): 1169-1176.
[3] Hu WEI, Tao LIN, Zheng-hui LIN. Parallel processing architecture of H.264 adaptive deblocking filters[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(8): 1160-1168.
[4] Byeongdu LA, Minyoung EOM, Yoonsik CHOE. Dominant edge direction based fast intra mode decision in the H.264/AVC encoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(6): 767-777.
[5] Sheng-bo CHEN, Wei CHEN, Wei-lan HUANG, Li-jun ZHAI, Xu-ming LIU. A cross-layer approach to enable multipacket transmission in MIMO-SDMA based WLAN[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2009, 10(2): 271-278.
[6] Jun-yan HUO, Yi-lin CHANG, Hai-tao YANG, Shuai WAN. Color compensation for multi-view video coding based on diversity of cameras[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1631-1637.
[7] Wan-yi LI, Lu YU. Highly parallel implementation of sub-pixel interpolation for AVS HDTV decoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1638-1643.
[8] Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO. Frame rate up-conversion using multiresolution critical point filters with occlusion refinement[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(12): 1621-1630.
[9] Kai LUO, Dong-xiao LI, Ming ZHANG. High throughput bandwidth optimized VLSI design for motion compensation in AVS HDTV decoder[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(6): 822-832.
[10] Xiang-wen WANG, Jun SUN, Rong XIE, Song-yu YU. Efficient video downscaling transcoder from MPEG-2 to H.264[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(4): 457-463.
[11] Jin-feng ZHANG, Rong-gang WANG, Jian-wei NIU, Yuan DONG, Hai-la WANG. Rate-distortion optimized bitstream switching for peer-to-peer live streaming[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(4): 445-456.
[12] Gui-xu LIN, Shi-bao ZHENG. Perceptual importance analysis for H.264/AVC bit allocation[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2008, 9(2): 225-231.
[13] WU Jing, YE Xiu-qing, GU Wei-kang. An adaptive fuzzy filter for coding artifacts removal in video and image[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(6): 841-848.
[14] KUMARAYAPA Ajith, ZHANG Ye. More efficient ground truth ROI image coding technique: implementation and wavelet based application analysis[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(6): 835-840.
[15] LI Ji-liang, FANG Xiang-zhong, HOU Jun. Mean shift based log-Gabor wavelet image coding[J]. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 2007, 8(4): 620-624.