Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)
    
Three-dimensional HD real-time video processing system based on FPGA and CMOS image sensor
YE Xue-song1, LU Ling1, CAI Xiu-jun2, ZHANG Hong1, LI Zan1, CHENG Li-cheng1
1. Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China; 2. SIR RUN RUN SHAW Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
Download:   PDF(2298KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

Based on field-programmable gate array (FPGA) with its high speed and parallel processing characteristics, a three-dimensional real-time video processing system of high definition was presented combined with HD CMOS image sensor. The configuration of CMOS image sensor, the output interface of two channel video streams and the Bayer format transformation algorithms were analyzed. The FPGA processing module of DDR2 SDRAM access operation with time-sharing method was realized, and a three-dimensional HD video real time display with frame rate at 120 Hz and 720p was accomplished. The video display was stable and of great clarity with a delay about 1/30 second.



Published: 06 June 2018
CLC:  TB 863  
Cite this article:

YE Xue-song, LU Ling, CAI Xiu-jun, ZHANG Hong, LI Zan, CHENG Li-cheng. Three-dimensional HD real-time video processing system based on FPGA and CMOS image sensor. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(1): 47-53.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2015.01.008     OR     http://www.zjujournals.com/eng/Y2015/V49/I1/47


基于FPGA和CMOS传感器的三维高清实时视频系统

利用现场可编程门阵列(FPGA)高速和并行处理的特点,结合高清CMOS图像传感器,设计基于FPGA的三维高清实时视频处理系统,分析CMOS图像传感器的配置方法以及两路CMOS图像数据的输出处理和图像数据的Bayer格式转换算法.研究并实现了基于FPGA的DDR2 SDRAM分时读写操作的处理方法,实现720像素/120 Hz三维高清视频图像的实时显示.视频显示清晰稳定,系统延时约为1/30秒.

[1] 冯大伟, 姜会林, 张光伟. 基于双目立体视觉的医用三维电子内窥镜系统[J]. 长春理工大学学报:自然科学版, 2012, 35(1): 38-42.
FENG Da-wei, JIANG Hui-lin, ZHANG Guang-wei. 3D medical electronic endoscope system based on binocular stereo vision [J]. Journal of Changchun University of Science and Technology: Natural Science Edition, 2012, 35(1): 38-42.
[2] ASIM F D, GLENN M P. Three-dimensional video imaging for endoscopic surgery [J]. Computers in Biology and Medicine, 1995, 25(2): 231-247.
[3] PETER P, MANIT A, JEAN V J, et al. Three-dimensional visualization in laparoscopic surgery [J]. BJU International, 2006, 98(2): 253-256.
[4] SAM B B, GERALD L A. Three-dimensional (3D) vision: does it improve laparoscopic skills? An assessment of a 3D head-mounted visualization system [J]. Reviews in Urology, 2005, 7(4): 211-214.
[5] BLAVIER A, GAUDISSART Q, CADIERE G B, et al. Impact of 2D and 3D vision on performance of novice subjects using da Vinci robotic system [J]. Acta Chir Belg, 2006, 106(6): 662-664.
[6] SEONG H K, BYUNG M O, HONGMAN Y, et al. Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera [J]. Surgical Endoscopy, 2010, 24: 1132-1143.
[7] YE Bin, WANG Li-qiang, SHI Yan, et al. High resolution miniaturized CMOS camera module for medical electronic endoscope [J]. Acta Photonica Sinica, 2010, 39(11): 1951-1955.
[8] 陈郁韩. FPGA 在医疗设备中的应用研究[J]. 医疗卫生装备, 2007, 28(1): 62-64.
CHEN Yu-han. Application of field programmable gate array (FPGA) to medical instruments [J]. Chinese Medical Equipment Journal, 2007, 28(1): 62-64.
[9] GUERIN C, MAHROUG J, TROMEUR W, et al. An acquisition system for CMOS imagers with a genuine 10 Gbit/s bandwidth [J]. Nuclear Instruments and Methods in Physics Research A, 2012, 695: 420-424.
[10] ISTVAN A, PETER C, PETRONEL B. Hardware implementation of a real-time 3D video acquisition system [C]∥ 12th International Conference on Optimization of Electrical and Electronic Equipment. Basov: National University of Ireland, 2010: 920-925.
[11] 周文晖, 杜歆, 叶秀清, 等. 基于FPGA的双目立体视觉系统[J]. 中国图象图形学报, 2005, 10(9): 1166-1170.
ZHOU Wen-hui, DU Xin, YE Xiu-qing, et al. Binocular stereo vision system based on FPGA [J]. Journal of Image and Graphics, 2005, 10(9): 1166-1170.
[12] DONALD G B. Design for embedded image processing on FPGAs [M]. [S. l.]: IEEE, 2011.
[13] 刘来成, 周文晖, 楼斌, 等. 基于FPGA 的多模式实时立体显示系统设计[J]. 杭州电子科技大学学报, 2011, 31(5): 179-182.
LIU Lai-cheng, ZHOU Wen-hui, LOU Bin, et al. FPGA-based multi-mode to achieve real-time stereoscopic display system [J]. Journal of Hangzhou Dianzi University, 2011, 31(5): 179-182.

No related articles found!