Please wait a minute...
J4  2012, Vol. 46 Issue (11): 2109-2115    DOI: 10.3785/j.issn.1008-973X.2012.11.025
浙江大学 现代光学仪器重点实验室,浙江 杭州 310027
Dual band image fusion method based on region saliency
PENG Hai, ZHAO Ju-feng, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting
State Key Laboratory of Optical Instrumentation,Zhejiang University,Hangzhou 310027,China
 全文: PDF  HTML



In order to efficiently preserve information in infrared and visible images fusion, a region based image fusion method was proposed using region saliency analysis. Region based scale invariant salient map (RSISM) was achieved by image segmentation, pyramid decomposition and multi-scale contrast analysis. RSISM could well represent the salient information of a region and distinguish different regions. Image was separated into three parts according to RSISM, including salient area, background and other regions. Proper fusion rules were formulated for each region. Dual band images were finally fused in NSCT domain. Results showed the proposed method has a better performance compared to other fusion methods. According to experimental results, the proposed method is thus proven to be a good one for image fusion which can keep both target features and background details. Besides, with the combination of spatially salient feature and dynamic information between adjacent frames in image sequence, dynamic salient map can be achieved and used for sequential image fusion.

出版日期: 2012-12-11
:  TN 21  


通讯作者: 冯华君(1963 - ),男,教授,博导.     E-mail:
作者简介: 彭海(1985-),男,硕士,主要从事图像融合技术的研究
E-mail Alert


彭海,赵巨峰,冯华君,徐之海,李奇,陈跃庭. 基于区域显著性的双波段图像融合方法[J]. J4, 2012, 46(11): 2109-2115.

PENG Hai, ZHAO Ju-feng, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Dual band image fusion method based on region saliency. J4, 2012, 46(11): 2109-2115.


[1] JOEL L, MASHA M. Comparing multispectral image fusion methods for a target detection task  [J]. Optical Engineering, 46(6), 066402: 1-8.
 [2] CHEN Fengrui, GUAN Zequn, YANG Xiankun, et al. A novel remote sensing image fusion method based on independent component analysis [J]. International Journal of Remote Sensing, 2011, 32(10): 2745-2763.
 [3] QU Guihong, ZHANG Dali,YAN Pingfan. Medical image fusion by wavelet transform modulus maxima  [J]. Optics Express, 2001,9(4):184-190.
 [4] SABALAN D, HASSAN G. MRI and PET images fusion based on human retina Model [J]. Journal of Zhejiang University :ScienceA, 2007, 8(10): 1624-1632.
 [5] SADHASIVAM S K, KEERTHIVASAN M B. Implementation of max principle with PCA in image fusion for surveillance and navigation application [J]. Electronic Letters of Computer Vision and Image Analysis, 2011, 10(1):1-10.
 [6] XIAO Zhangshu, ZHENG Chongxun. Image fusion scheme by combining local image structures and directive contrasts [J]. Optical Engineering, 2011, 50(7): 77005.
 [7] BAI Xiangzhi, ZHOU Fugen, XUE Bindang. Edge preserved image fusion based on multiscale toggle contrast operator [J]. Image and Vision Computing, 2011,29(12): 829-839.
 [8] BAI Xiangzhi, ZHOU Fugen, XUE Bindang. Fusion of infrared and visual images through region extraction by using multi scale centersurround tophat transform [J]. Optics Express,2011, 19(9): 8444-8457.
 [9] WAN T, CANAGARAJAH N, ACHIM A. Segmentationdriven image fusion based on alphastable modeling of wavelet coefficients [J]. IEEE Transactions on Multimedia, 2009, 11(4): 624-633.
 [10] HONG Richang, WANG Chao, WANG Meng, et al. Salience preserving multi focus image fusion with dynamic range compression  [J]. International Journal of Innovative Computing, Information and Control, 2009, 5(8): 2369-2380.
 [11] SASIKALA M, KUMARAVEl N. A comparative analysis of feature based image fusion methods [J]. Information Technology Journal, 2007, 6(8): 1224-1230.
 [12] ALEXANDER T. Image fusion by a ratio of lowpass pyramid. [J] Pattern Recognition Letters, 1989,9(4):245-253.
 [13] LEWIS J J, O CALLAGHAN R J, NIKOLOV S G, et al. Pixel and Regionbased image fusion with complex wavelets [J]. Information Fusion, 2007, 8(2):119-130.
 [14] DA C A L, ZHOU Jianping, DO M N. The nonsubsampled contourlet transform: Theory, design, and applications [J]. IEEE Transactions on Image Processing, 2006, 15(10): 3089-3101.
 [15] PETROVIC V S, XYDEAS C S. Gradientbased multiresolution image fusion [J]. IEEE Transactions on Image Processing. 2004, 13(2): 228-237.
 [16] SCHAUL L, FREDEMBACH C, SUSSTRUNK S. Color image dehazing using the nearinfrared [C]∥ IEEE International Conference on Image Processing.Cairo: IEEE, 2009: 1629-1632.
 [17] WANG Zhaobin, MA Yide, Jason G. Multifocus image fusion using PCNN [J]. Pattern Recognition, 2010, 43(6): 2003-2016.
 [18] PIELLAa G. A general framework for multiresolution image fusion: from pixels to regions [J]. Information Fusion, 2003, 4(4): 259-280.
 [19] GUO Baolong, ZHANG Qiang, HOU Ye. Regionbased fusion of infrared and visible images using nonsubsampled contourlet transform [J]. Chinese Optics Letters, 2008, 6(5): 338-341.
 [20] LIU Feng, GLEICHER M. Region enhanced scaleinvariant saliency detection [C]∥IEEE International Conference on Multimedia and Expo. Toronto, Ont: IEEE, 2006: 1477-1480.
 [21] LIU Tie, YUAN Zejian, SUN Jian, et al. Learning to detect a salient object [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(2): 353-367.
 [22] ZITOVA B, Flusser J. Image registration methods: a survey [J]. Image and vision computing, 2003, 21(11): 977-1000.
 [23] ZHENG Yufeng, ESSOCK E A, HANSEN B C, et al. A new metric based on extended spatial frequency and its application to DWT based fusion algorithms [J]. Information Fusion, 2007, 8(2): 177-192.

[1] 刘涛, 赵巨峰, 徐之海, 冯华君, 陈慧芳. 基于卡尔曼滤波的红外图像增强算法[J]. J4, 2012, 46(8): 1534-1539.