Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)
    
Multi-exposure image fusion based on well-exposedness assessment
JIANG Shen-yu, CHEN Kuo, XU Zhi-hai, FENG Hua-jun, LI Qi, CHEN Yue-ting
State Key Laboratory of Modern Optical Instrumentation, Zhejiang University, Hangzhou 310027, China
Download:   PDF(2448KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

Aiming at the problem that digital camera is insufficient in dynamic range when taking pictures of wide dynamic range scenes, a spatial-domain fusion method for multi-exposure images was proposed.  Scenes were sampled and exposed repeatedly, and brightness changes of different pixels of the images were analyzed.Then,  assessment value was calculated using the Gauss model. The well-exposedness assessment method was applied to sub-areas of the images. Weighted value of each pixel was calculated to eliminate the images block effect. Image sequences that imaged under different exposures were fused into high dynamic range (HDR) images with local adaptive exposure, which extended the dynamic range. Compared with other methods, the proposed method is simple and effective, producing results with better performance in scene details and color information, and even with higher entropy.



Published: 28 August 2015
CLC:  TN 911  
Cite this article:

JIANG Shen-yu, CHEN Kuo, XU Zhi-hai, FENG Hua-jun, LI Qi, CHEN Yue-ting. Multi-exposure image fusion based on well-exposedness assessment. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 470-475.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2015.03.011     OR     http://www.zjujournals.com/eng/Y2015/V49/I3/470


基于曝光适度评价的多曝光图像融合方法

针对数字相机在拍摄宽亮度范围场景时动态范围不足的问题,提出一种高效的多曝光图像融合方法.该方法通过场景的多次采样曝光,分析不同像素的亮暗变化,利用高斯数学模型计算评价数值.将结合图像亮度信息的曝光适度评价方法应用于图像分块区域,并计算每个像素的权重值,消除图像块效应.将不同曝光度下成像的图像序列融合为一幅局部自适应曝光的高动态范围(HDR)图像,实现动态范围扩展.与另外3种方法进行对比分析,结果表明:该方法简便有效,细节纹理与颜色信息具有更强的表现能力,且熵值更高.

[1] MANN S, PICARD R W. On being‘undigital’ with digital cameras: extending dynamic range by combining differently exposed pictures [C] ∥ Proceedings of IS&T 46th Annual Conference. Cambridge: Massachusetts, 1995: 422-428.
[2] FATTAL R, LISCHINSKI D, WERMAN M. Gradient domain high dynamic range compression [C] ∥ Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM, 2002: 249-256.
[3] DURAND F, DORSEY J. Fast bilateral filtering for the display of high-dynamic-range images [C] ∥ Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM, 2002: 257-266.
[4] MANTIUK R, DALY S, KEROFSKY L. Display adaptive tone mapping [J]. ACM Transactions on Graphics, 2008, 27(3):68.
[5] GROSSBERG M D, NAYAR S K. Determining the camera response from images: What is knowable? [C] ∥ Transactions on Pattern Analysis and Machine.New York:IEEE,2003:1455-1467.
[6] GREG W. Fast, robust image registration for compositing high dynamic range photographs from hand-held exposures [J]. Journal of Graphics Tools, 2003, 8(2): 17-30.
[7] GALLO O, GELFAND N, CHEN W C, et al. Artifact-free high dynamic range imaging [C] ∥ International Conference on Computational Photography. San Francisco: IEEE, 2009: 17.
[8] 张军,戴霞,孙德全,等.不同曝光值图像的直接融合方法[J].软件学报, 2011, 22(4): 813-825.
ZHANG Jun, DAI Xia, SUN De-quan, et al. Directly fusion method for combining variable exposure value images [J]. Journal of Software, 2011, 22(4): 813-825.
[9] GOSHTASBY A A. Fusion of multi-exposure images\[J\]. Image and Vision Computing, 2005, 23(6): 611-618.
[10] MERTENS T, KAUTZ J, REETH F V. Exposure fusion: A simple and practical alternative to high dynamic range photography [J]. Computer Graphics Forum, 2009, 28(1): 161-171.
[11] VANMALI A V, DESHMUKH S S, GADRE V M. Low complexity detail preserving multi-exposure image fusion for images with balanced exposure [C] ∥ National Conference on Communications. New Delhi: IEEE, 2013: 15.
[12] 赵颖. 基于子带结构和梯度的多曝光图像融合技术研究[D]. 北京: 北京理工大学, 2011: 14-32.
ZHAO Ying. Subband architecture and gradient based multi-exposure fusion [D]. Beijing: Beijing Institute of Technology, 2011: 14-32.
[13] SHEN J B, ZHAO Y, HE Y. Detail-preserving exposure fusion using subband architecture [J]. The Visual Computer, 2012, 28(5):463-473.
[14] DEBEVEC P E, JITENDRA M. Recovering high dynamic range radiance maps from photographs [C] ∥ Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques. New York: ACM, 1997.
\[15\] MALIK M H, GILANI S A M,HAQ A.Wavelet based exposure fusion\[C\]∥Proceedings of the World Congress on Engineering.Lodon:WCE,2008:688-693.

[1] WU Chen-xi, ZHANG Min, WANG Ke-ren. Broadband underdetermined direction of arrival estimation based on two level nested array[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(5): 1016-1023.
[2] XIE Luo feng, XU Hui ning, HUANG Qin yuan, ZHAO Yue, YIN Guo fu. Application of DTCWPT and NCA-LSSVM to inspect internal defects of magnetic tile[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(1): 184-191.
[3] WANG Zhi, ZHU Shi qiang, BU Yan, GUO Zhen min. Stereo matching algorithm using improved guided filtering[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(12): 2262-2269.
[4] YU Hui-min, ZENG Xiong. Visual tracking combined with ranking vector SVM[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(6): 1015-1021.
[5] CHEN Kuo, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Fast detail-preserving exposure fusion[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(6): 1048-1054.
[6] ZHU Zhu, LIU Ji-lin. Real-time Markov random field based ground segmentation of 3D Lidar data[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 464-469.
[7] TONG Ji-jun, ZHANG Guang-lei, CAI Qiang, JIAN Jin-ming, GUO Xi-shan. Application of threshold stochastic resonance in low concentration gas detecting[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(1): 15-19.
[8] LI Jiang, ZHAO Ya-qiong, BAO Ye-hua. Voice processing technique for patients with stroke based on chao theory and surrogate data analysis[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(1): 36-41.
[9] WU Peng-zhou, YU Hui-min, ZENG Xiong. Object counting based on regularized risk minimization[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(7): 1226-1233.
[10] PAN Neng-jie, YU Hui-min. Edge-enhanced maximally stable color regions[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(7): 1241-1247.
[11] YUE Ke-qiang, SUN Ling-ling, YOU Bin, LOU Li-heng. Parallelizable identification anti-collision algorithm based on under-determined blind separation[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(5): 865-870.
[12] XIANG Nan, ZHAO Hang-fang, GONG Xian-yi. Improper complex-domain state-space filtering[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(4): 727-733.
[13] YANG Li, ZHU Zhu, LIU Ji-lin. Bird’s-eye panoramic view algorithm for vehicle’s embedded system[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(2): 292-296.
[14] LIU Feng-xia, PAN Xiang,GONG Xian-yi. Matched-field three-dimensional source localization
using spiral line array
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2013, 47(1): 62-69.
[15] LIU Zhi-kun, LIU Zhong, FU Xue-zhi, NING Xiao-ling. Modified variable step-size adaptive filtering and
Eckart weighted denoising algorithm
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(6): 1014-1020.