Please wait a minute...
浙江大学学报(工学版)
自动化技术、信息技术     
基于FPGA和CMOS传感器的三维高清实时视频系统
叶学松1,陆玲1,蔡秀军2,张宏1,李赞1,程李成1
1.浙江大学 生物医学工程学系,浙江 杭州310027;2.浙江大学医学院附属邵逸夫医院,浙江 杭州 310016
Three-dimensional HD real-time video processing system based on FPGA and CMOS image sensor
YE Xue-song1, LU Ling1, CAI Xiu-jun2, ZHANG Hong1, LI Zan1, CHENG Li-cheng1
1. Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China; 2. SIR RUN RUN SHAW Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
 全文: PDF(2298 KB)   HTML
摘要:

利用现场可编程门阵列(FPGA)高速和并行处理的特点,结合高清CMOS图像传感器,设计基于FPGA的三维高清实时视频处理系统,分析CMOS图像传感器的配置方法以及两路CMOS图像数据的输出处理和图像数据的Bayer格式转换算法.研究并实现了基于FPGA的DDR2 SDRAM分时读写操作的处理方法,实现720像素/120 Hz三维高清视频图像的实时显示.视频显示清晰稳定,系统延时约为1/30秒.

Abstract:

Based on field-programmable gate array (FPGA) with its high speed and parallel processing characteristics, a three-dimensional real-time video processing system of high definition was presented combined with HD CMOS image sensor. The configuration of CMOS image sensor, the output interface of two channel video streams and the Bayer format transformation algorithms were analyzed. The FPGA processing module of DDR2 SDRAM access operation with time-sharing method was realized, and a three-dimensional HD video real time display with frame rate at 120 Hz and 720p was accomplished. The video display was stable and of great clarity with a delay about 1/30 second.

出版日期: 2018-06-06
:  TB 863  
基金资助:

国家“十二五”科技支撑计划资助项目(2012BAI14B06)

作者简介: 叶学松(1970-),男,教授,博导,从事生物医学传感检测和环境监测领域新型传感检测技术的研究.E-mail: yexuesong@zju.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  

引用本文:

叶学松,陆玲,蔡秀军,张宏,李赞,程李成. 基于FPGA和CMOS传感器的三维高清实时视频系统[J]. 浙江大学学报(工学版), 10.3785/j.issn.1008-973X.2015.01.008.

YE Xue-song, LU Ling, CAI Xiu-jun, ZHANG Hong, LI Zan, CHENG Li-cheng. Three-dimensional HD real-time video processing system based on FPGA and CMOS image sensor. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 10.3785/j.issn.1008-973X.2015.01.008.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2015.01.008        http://www.zjujournals.com/eng/CN/Y2015/V49/I1/47

[1] 冯大伟, 姜会林, 张光伟. 基于双目立体视觉的医用三维电子内窥镜系统[J]. 长春理工大学学报:自然科学版, 2012, 35(1): 38-42.
FENG Da-wei, JIANG Hui-lin, ZHANG Guang-wei. 3D medical electronic endoscope system based on binocular stereo vision [J]. Journal of Changchun University of Science and Technology: Natural Science Edition, 2012, 35(1): 38-42.
[2] ASIM F D, GLENN M P. Three-dimensional video imaging for endoscopic surgery [J]. Computers in Biology and Medicine, 1995, 25(2): 231-247.
[3] PETER P, MANIT A, JEAN V J, et al. Three-dimensional visualization in laparoscopic surgery [J]. BJU International, 2006, 98(2): 253-256.
[4] SAM B B, GERALD L A. Three-dimensional (3D) vision: does it improve laparoscopic skills? An assessment of a 3D head-mounted visualization system [J]. Reviews in Urology, 2005, 7(4): 211-214.
[5] BLAVIER A, GAUDISSART Q, CADIERE G B, et al. Impact of 2D and 3D vision on performance of novice subjects using da Vinci robotic system [J]. Acta Chir Belg, 2006, 106(6): 662-664.
[6] SEONG H K, BYUNG M O, HONGMAN Y, et al. Comparison of two- and three-dimensional camera systems in laparoscopic performance: a novel 3D system with one camera [J]. Surgical Endoscopy, 2010, 24: 1132-1143.
[7] YE Bin, WANG Li-qiang, SHI Yan, et al. High resolution miniaturized CMOS camera module for medical electronic endoscope [J]. Acta Photonica Sinica, 2010, 39(11): 1951-1955.
[8] 陈郁韩. FPGA 在医疗设备中的应用研究[J]. 医疗卫生装备, 2007, 28(1): 62-64.
CHEN Yu-han. Application of field programmable gate array (FPGA) to medical instruments [J]. Chinese Medical Equipment Journal, 2007, 28(1): 62-64.
[9] GUERIN C, MAHROUG J, TROMEUR W, et al. An acquisition system for CMOS imagers with a genuine 10 Gbit/s bandwidth [J]. Nuclear Instruments and Methods in Physics Research A, 2012, 695: 420-424.
[10] ISTVAN A, PETER C, PETRONEL B. Hardware implementation of a real-time 3D video acquisition system [C]∥ 12th International Conference on Optimization of Electrical and Electronic Equipment. Basov: National University of Ireland, 2010: 920-925.
[11] 周文晖, 杜歆, 叶秀清, 等. 基于FPGA的双目立体视觉系统[J]. 中国图象图形学报, 2005, 10(9): 1166-1170.
ZHOU Wen-hui, DU Xin, YE Xiu-qing, et al. Binocular stereo vision system based on FPGA [J]. Journal of Image and Graphics, 2005, 10(9): 1166-1170.
[12] DONALD G B. Design for embedded image processing on FPGAs [M]. [S. l.]: IEEE, 2011.
[13] 刘来成, 周文晖, 楼斌, 等. 基于FPGA 的多模式实时立体显示系统设计[J]. 杭州电子科技大学学报, 2011, 31(5): 179-182.
LIU Lai-cheng, ZHOU Wen-hui, LOU Bin, et al. FPGA-based multi-mode to achieve real-time stereoscopic display system [J]. Journal of Hangzhou Dianzi University, 2011, 31(5): 179-182.

No related articles found!