Please wait a minute...
J4  2012, Vol. 46 Issue (11): 2109-2115    DOI: 10.3785/j.issn.1008-973X.2012.11.025
自动化技术、光学工程     
基于区域显著性的双波段图像融合方法
彭海,赵巨峰,冯华君,徐之海,李奇,陈跃庭
浙江大学 现代光学仪器重点实验室,浙江 杭州 310027
Dual band image fusion method based on region saliency
PENG Hai, ZHAO Ju-feng, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting
State Key Laboratory of Optical Instrumentation,Zhejiang University,Hangzhou 310027,China
 全文: PDF  HTML
摘要:

为了在红外与可见光图像融合中保留更多有效信息,提出一种基于区域显著性分析的融合方法.通过区域分割以及多分辨率对比度分析,获得图像的尺度不变区域显著性图(RSISM).利用RSISM能够有效表达区域的显著性特征,合理区分不同性质的区域;根据RSISM划分显著性区域、背景区域及中间区域,对各区域制定相异融合规则,并在非降采样轮廓波变换(NSCT)变换域上融合双波段图像.实验证明,与传统方法相比,该方法能够更好地保留显著性区域的红外特征及其他区域的细节信息,同时对背景热辐射干扰不敏感,有较好融合效果,并能够拓展应用于动态图像的融合中.

Abstract:

In order to efficiently preserve information in infrared and visible images fusion, a region based image fusion method was proposed using region saliency analysis. Region based scale invariant salient map (RSISM) was achieved by image segmentation, pyramid decomposition and multi-scale contrast analysis. RSISM could well represent the salient information of a region and distinguish different regions. Image was separated into three parts according to RSISM, including salient area, background and other regions. Proper fusion rules were formulated for each region. Dual band images were finally fused in NSCT domain. Results showed the proposed method has a better performance compared to other fusion methods. According to experimental results, the proposed method is thus proven to be a good one for image fusion which can keep both target features and background details. Besides, with the combination of spatially salient feature and dynamic information between adjacent frames in image sequence, dynamic salient map can be achieved and used for sequential image fusion.

出版日期: 2012-12-11
:  TN 21  
基金资助:

国家“973”高技术发展规划资助项目(2009CB72400602);国家自然科学基金资助项目(60977010)

通讯作者: 冯华君(1963 - ),男,教授,博导.     E-mail: fenghj@zju.edu.cn
作者简介: 彭海(1985-),男,硕士,主要从事图像融合技术的研究.E-mail:3051109119@zju.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  

引用本文:

彭海,赵巨峰,冯华君,徐之海,李奇,陈跃庭. 基于区域显著性的双波段图像融合方法[J]. J4, 2012, 46(11): 2109-2115.

PENG Hai, ZHAO Ju-feng, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Dual band image fusion method based on region saliency. J4, 2012, 46(11): 2109-2115.

链接本文:

http://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2012.11.025        http://www.zjujournals.com/eng/CN/Y2012/V46/I11/2109

[1] JOEL L, MASHA M. Comparing multispectral image fusion methods for a target detection task  [J]. Optical Engineering, 46(6), 066402: 1-8.
 [2] CHEN Fengrui, GUAN Zequn, YANG Xiankun, et al. A novel remote sensing image fusion method based on independent component analysis [J]. International Journal of Remote Sensing, 2011, 32(10): 2745-2763.
 [3] QU Guihong, ZHANG Dali,YAN Pingfan. Medical image fusion by wavelet transform modulus maxima  [J]. Optics Express, 2001,9(4):184-190.
 [4] SABALAN D, HASSAN G. MRI and PET images fusion based on human retina Model [J]. Journal of Zhejiang University :ScienceA, 2007, 8(10): 1624-1632.
 [5] SADHASIVAM S K, KEERTHIVASAN M B. Implementation of max principle with PCA in image fusion for surveillance and navigation application [J]. Electronic Letters of Computer Vision and Image Analysis, 2011, 10(1):1-10.
 [6] XIAO Zhangshu, ZHENG Chongxun. Image fusion scheme by combining local image structures and directive contrasts [J]. Optical Engineering, 2011, 50(7): 77005.
 [7] BAI Xiangzhi, ZHOU Fugen, XUE Bindang. Edge preserved image fusion based on multiscale toggle contrast operator [J]. Image and Vision Computing, 2011,29(12): 829-839.
 [8] BAI Xiangzhi, ZHOU Fugen, XUE Bindang. Fusion of infrared and visual images through region extraction by using multi scale centersurround tophat transform [J]. Optics Express,2011, 19(9): 8444-8457.
 [9] WAN T, CANAGARAJAH N, ACHIM A. Segmentationdriven image fusion based on alphastable modeling of wavelet coefficients [J]. IEEE Transactions on Multimedia, 2009, 11(4): 624-633.
 [10] HONG Richang, WANG Chao, WANG Meng, et al. Salience preserving multi focus image fusion with dynamic range compression  [J]. International Journal of Innovative Computing, Information and Control, 2009, 5(8): 2369-2380.
 [11] SASIKALA M, KUMARAVEl N. A comparative analysis of feature based image fusion methods [J]. Information Technology Journal, 2007, 6(8): 1224-1230.
 [12] ALEXANDER T. Image fusion by a ratio of lowpass pyramid. [J] Pattern Recognition Letters, 1989,9(4):245-253.
 [13] LEWIS J J, O CALLAGHAN R J, NIKOLOV S G, et al. Pixel and Regionbased image fusion with complex wavelets [J]. Information Fusion, 2007, 8(2):119-130.
 [14] DA C A L, ZHOU Jianping, DO M N. The nonsubsampled contourlet transform: Theory, design, and applications [J]. IEEE Transactions on Image Processing, 2006, 15(10): 3089-3101.
 [15] PETROVIC V S, XYDEAS C S. Gradientbased multiresolution image fusion [J]. IEEE Transactions on Image Processing. 2004, 13(2): 228-237.
 [16] SCHAUL L, FREDEMBACH C, SUSSTRUNK S. Color image dehazing using the nearinfrared [C]∥ IEEE International Conference on Image Processing.Cairo: IEEE, 2009: 1629-1632.
 [17] WANG Zhaobin, MA Yide, Jason G. Multifocus image fusion using PCNN [J]. Pattern Recognition, 2010, 43(6): 2003-2016.
 [18] PIELLAa G. A general framework for multiresolution image fusion: from pixels to regions [J]. Information Fusion, 2003, 4(4): 259-280.
 [19] GUO Baolong, ZHANG Qiang, HOU Ye. Regionbased fusion of infrared and visible images using nonsubsampled contourlet transform [J]. Chinese Optics Letters, 2008, 6(5): 338-341.
 [20] LIU Feng, GLEICHER M. Region enhanced scaleinvariant saliency detection [C]∥IEEE International Conference on Multimedia and Expo. Toronto, Ont: IEEE, 2006: 1477-1480.
 [21] LIU Tie, YUAN Zejian, SUN Jian, et al. Learning to detect a salient object [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(2): 353-367.
 [22] ZITOVA B, Flusser J. Image registration methods: a survey [J]. Image and vision computing, 2003, 21(11): 977-1000.
 [23] ZHENG Yufeng, ESSOCK E A, HANSEN B C, et al. A new metric based on extended spatial frequency and its application to DWT based fusion algorithms [J]. Information Fusion, 2007, 8(2): 177-192.

[1] 刘涛, 赵巨峰, 徐之海, 冯华君, 陈慧芳. 基于卡尔曼滤波的红外图像增强算法[J]. J4, 2012, 46(8): 1534-1539.