Please wait a minute...
Journal of Zhejiang University (Science Edition)  2017, Vol. 44 Issue (4): 379-384    DOI: 10.3785/j.issn.1008-9497.2017.04.001
    
A survey of depth learning methods for detecting lung nodules by CT images
HU Weijian1, CHEN Wei2, FENG Haozhe2, ZHANG Tianping2, ZHU Zhengmao2, PAN Qiaoming1
1. Engineering College, Lishui University, Lishui 323000, Zhejiang Province, China;
2. State Key Lab of CAD & CG, College of Computer Science, Zhejiang University, Hangzhou 310058, China
Download: HTML (   PDF(934KB)
Export: BibTeX | EndNote (RIS)      

Abstract  Lung cancer is one of the most aggressive cancers and detecting lung nodule by CT images at the early stage is of vital importance to treating lung cancer. This paper overviews the application of a revolutionary image recognition method, deep learning, in the detection of lung nodule. First, we contrast different convolutional neural network (CNN) architectures and their performance in image recognition. Then, we mainly focus on various deep learning methods including faster-RCNN, transfer learning, residual network and curriculum learning to train the classifier. We also introduce some available databases of lung CT images in the last section of our paper.

Key wordsdeep learning      lung nodule      CNN      database     
Received: 23 May 2017      Published: 09 December 2017
CLC:  TP301  
Cite this article:

HU Weijian, CHEN Wei, FENG Haozhe, ZHANG Tianping, ZHU Zhengmao, PAN Qiaoming. A survey of depth learning methods for detecting lung nodules by CT images. Journal of Zhejiang University (Science Edition), 2017, 44(4): 379-384.

URL:

https://www.zjujournals.com/sci/EN/Y2017/V44/I4/379


应用于平扫CT图像肺结节检测的深度学习方法综述

肺癌是一种致死率很高的癌症.通过肺部平扫CT影像检测肺结节对肺癌早期诊断、治疗意义重大.全面介绍了一种革命性的图像识别技术——深度学习方法,在肺结节检测中的应用.首先,横向对比了不同卷积神经网络的结构及其在图像识别上的效果,其次着重分析了不同深度学习方法在训练肺结节分类器上的应用,包括faster-RCNN、迁移学习、残差学习以及迁移学习.还介绍了一些可用的肺部CT影像数据集供读者参考.

关键词: 深度学习,  肺结节,  卷积神经网络,  数据库 
[1] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]//PEREIRA F, BURGES C J C, BOTTOU L, et al. Advances in Neural Information Processing Systems 25. Nevada:Curran Associates Inc, 2012:1097-1105.
[2] 刘玉杰,庞芸萍,李宗民,等.融合抽象层级变换和卷积神经网络的手绘图像检索方法[J].浙江大学学报:理学版,2016,43(6):657-663. LIU Y J, PANG Y P, LI Z M, et al. Sketch based image retrieval based on abstract-level transform and convolutional neural networks[J]. Journal of Zhejiang University:Science Edition,2016,43(6):657-663.
[3] ELBAZ A, BEACHE G M, GIMEL'FARB G, et al. Computer-aided diagnosis systems for lung cancer:Challenges and methodologies[J]. International Journal of Biomedical Imaging,2013,2013(1):942353.
[4] LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE,1998,86(11):2278-2324.
[5] CANZIANI A, PASZKE A, CULURCIELLO E. An analysis of deep neural network models for practical applications[J]. arXiv preprint arXiv:1605.07678,2016.
[6] ANIRUDH R, THIAGARAJAN J J, BREMER T, et al. Lung nodule detection using 3D convolutional neural networks trained on weakly labeled data[C]//SPIE Medical Imaging. Orlando:International Society for Optics and Photonics,2016:978532.Doi:10.1117/12.2214876.
[7] LEE H, LEE H, PARK M, et al. Contextual convolutional neural networks for lung nodule classification using Gaussian-weighted average image patches[C]//SPIE Medical Imaging. Orlando:International Society for Optics and Photonics,2017:1013423.Doi:10.1117/12.2253978.
[8] ROTH H R, LU L, LIU J, et al. Improving computer-aided detection using convolutional neural networks and random view aggregation[J]. IEEE Transactions on Medical Imaging,2016,35(5):1170-1181.
[9] SETIO A A A, CIOMPI F, LITJENS G, et al. Pulmonary nodule detection in CT images:False positive reduction using multi-view convolutional networks[J]. IEEE Transactions on Medical Imaging,2016,35(5):1160-1169.
[10] GIRSHICK R. Fast R-CNN[C]//IEEE International Conference on Computer Vision. Washington:IEEE Computer Society,2015:1440-1448.
[11] REN S, HE K, GIRSHICK R, et al. Faster R-CNN:Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,39(6):1137-1149.
[12] WAN S, CHEN Z, ZHANG T, et al. Bootstrapping face detection with hard negative examples[J]. arXiv preprint arXiv:1608.02236,2016.
[13] ZHANG L, LIN L, LIANG X, et al. Is Faster R-CNN doing well for pedestrian detection?[C]//European Conference on Computer Vision. New York:Springer International Publishing,2016:443-457.
[14] IOFFE S, SZEGEDY C. Batch normalization:Accelerating deep network training by reducing internal covariate shift[C]//Proceedings of the 32nd International Conference on Machine Learning. Lille:Computer Science,2015,37:448-456.
[15] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington:IEEE,2015:770-778.
[16] HE K, ZHANG X, REN S, et al. Identity mappings in deep residual networks[C]//European Conference on Computer Vision. New York:Springer International Publishing,2016:630-645.
[17] SZEGEDY C, IOFFE S, VANHOUCKE V, et al. Inception-v4, inception-resnet and the impact of residual connections on learning[J]. arXiv preprint arXiv:1602.07261,2016.
[18] PAN S J, YANG Q. A survey on transfer learning[J]. IEEE Educational Activities Department,2010,22(10):1345-1359.
[19] HOOCHANG S, ROTH H R, GAO M, et al. Deep convolutional neural networks for computer-aided detection:CNN architectures, dataset characteristics and transfer learning[J]. IEEE Transactions on Medical Imaging,2016,35(5):1285-1298.
[20] CHRISTODOULIDIS S, ANTHIMOPOULOS M, EBNER L, et al. Multi-source transfer learning with convolutional neural networks for lung pattern analysis[J]. IEEE Jo
[1] Shengjia XU,Cheng SU,Kongyang ZHU,Xiaocan ZHANG. Automatic identification of mineral in petrographic thin sections based on images using a deep learning method[J]. Journal of Zhejiang University (Science Edition), 2022, 49(6): 743-752.
[2] Hualing LIU,Guoxiang ZHANG,Jun MA. Research progress of graph embedding algorithms[J]. Journal of Zhejiang University (Science Edition), 2022, 49(4): 443-456.
[3] Yuwen WANG,Zhenhong DU,Zhen DAI,Renyi LIU,Feng ZHANG. Multivariate water quality parameter prediction model based on hybrid neural network[J]. Journal of Zhejiang University (Science Edition), 2022, 49(3): 354-362.
[4] QIAN Lihui, WANG Bin, ZHENG Yunfei, ZHANG Jiajie, LI Mading, YU Bing. Depth of field videos classification based on image depth prediction[J]. Journal of Zhejiang University (Science Edition), 2021, 48(3): 282-288.
[5] CHEN Yuanqiong, ZOU Beiji, ZHANG Meihua, LIAO Wangmin, HUANG Jiaer, ZHU Chengzhang. A review on deep learning interpretability in medical image processing[J]. Journal of Zhejiang University (Science Edition), 2021, 48(1): 18-29.
[6] FU Yingying, ZHANG Feng, DU Zhenhong, LIU Renyi. Multi-step prediction of PM2.5 hourly concentration by fusing graph convolution neural network and attention mechanism[J]. Journal of Zhejiang University (Science Edition), 2021, 48(1): 74-83.
[7] WANG Xie, ZHANG Xiaocan, SU Cheng. Land use classification of remote sensing images based on multi-scale learning and deep convolution neural network[J]. Journal of Zhejiang University (Science Edition), 2020, 47(6): 715-723.
[8] LI Junyi, REN Tao, LU Luzheng. A comparative study of big text data mining methods on tourist emotion computing[J]. Journal of Zhejiang University (Science Edition), 2020, 47(4): 507-520.
[9] LIU Yijing, ZHANG Xubin, ZHANG Jianwei, ZHOU Zhelei, FENG Yuanli, CHEN Wei. DenseNet-centercrop: A novel convolutional network for lung nodule classification[J]. Journal of Zhejiang University (Science Edition), 2020, 47(1): 20-26.
[10] Shanxiong CHEN, Xiaolong WANG, Xu HAN, Yun LIU, Minggui WANG. A recognition method of Ancient Yi character based on deep learning[J]. Journal of Zhejiang University (Science Edition), 2019, 46(3): 261-269.
[11] Jie HUANG, Feng ZHANG, Zhenhong DU, Renyi LIU, Xiaopei CAO. Hourly concentration prediction of PM2.5 based on RNN-CNN ensemble deep learning model[J]. Journal of Zhejiang University (Science Edition), 2019, 46(3): 370-379.
[12] CHENG Yuliang, SU Cheng, ZHANG Xiaocan. Extensible management system with the multi-source expedition data of southwest Indian Ocean[J]. Journal of Zhejiang University (Science Edition), 2017, 44(4): 493-498.
[13] LIU Ren-yi1,LIU Nan1,SU Guo-zhong2 . Analyzing of several typical spatial-temporal data models and expanding of spatial-temporal data models of base state with amendments. [J]. Journal of Zhejiang University (Science Edition), 2000, 27(2): 196-200.