Please wait a minute...
浙江大学学报(工学版)
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)  2019, Vol. 53 Issue (1): 107-114    DOI: 10.3785/j.issn.1008-973X.2019.01.012
Computer Technology     
Registration and stitching optimization for two-scene-type remote sensing image
XU Yue1, XU Zhi-hai1, FENG Hua-jun1, LI Qi1, CHEN Yue-ting1, XU Yi2, ZHAO Hong-bo2
1. State Key Laboratory of Modern Optical Instrumentation, Zhejiang University, Hangzhou 310027, China;
2. Shanghai Institute of Satellite Engineering, Shanghai 200240, China
Download:   PDF(1196KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

An optimization approach based on weighted value reassignment in RMSE was presented for remote sensing image registration and stitching in order to improve the registration and stitching quality of remote sensing image which consists of two scene types. Scale-invariant feature transform (SIFT) detector was used to extract feature points and obtain the homogeneous matrix between two images which have overlapped region. Remote sensing image has lots of details that may not evenly distribute. A method based on sub-block image entropy clustering to segment the image into large blocks was proposed. The image entropy reflected the dispersion degree of gray level distribution, and larger entropy value meant larger amount of information and more texture detail. Each segment represented a unique scene type and a weighted value would be assigned to feature points. In objective function of RMSE, the weighted value reflected the amount of texture information and contributed to the improvement of optimization result, which friendly matched the human vision. The experimental results showed that the registration residual error of feature points could be reassigned and was reduced by 14% in the region which had rich details. Then the registration and stitching quality and the stability of the registration process were improved, and the randomness was reduced.

Received: 03 January 2018      Published: 07 January 2019
CLC:  TP751  
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
Cite this article:

XU Yue, XU Zhi-hai, FENG Hua-jun, LI Qi, CHEN Yue-ting, XU Yi, ZHAO Hong-bo. Registration and stitching optimization for two-scene-type remote sensing image. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2019, 53(1): 107-114.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2019.01.012     OR     http://www.zjujournals.com/eng/Y2019/V53/I1/107


双场景类型遥感图像的配准拼接优化

为了提升包含2种场景类型的遥感图像的配准拼接质量，提出基于误差权重再分配的遥感图像配准拼接优化方法. 使用尺度不变特征变换（SIFT）特征检测算子，提取2幅具有重叠区域的遥感图像的特征点，计算得到初始的单应性矩阵. 针对遥感图像细节丰富，但在某些特定区域分布不均匀的特点，将图像按照网格分割成若干小子块，进行信息熵聚类. 图像熵反映的是灰度分布的分散程度，较大的熵意味着更大的信息量和纹理细节. 按照信息量分布，将图像分隔为2个大的图像区域，每一区域近似代表一种场景类型. 以特征点匹配的残余误差为目标函数，对不同场景区域的特征点分配不同的优化权重，权重来源于各图像子块的信息熵，反映了图像各场景信息量的多少，从而改善拼接效果，使之符合人眼视觉要求. 实验表明，采用该方法可以再分配特征点匹配残余误差，细节丰富区域的匹配残差降低14%，提升细节丰富区域的配准拼接质量，降低随机性，提高了配准过程的稳定度.

[1] MIKOLAJCZYK K, SCHMID C. Indexing based on scale invariant interest points[C]//Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV). Vancouver:IEEE, 2001:525-531.
[2] MIKOLAJCZYK K, SCHMID C. Scale and affine invariant interest point detectors[J]. International Journal of Computer Vision, 2004, 60(1):63-86.
[3] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[4] BAY H, ESS A, TUYTELAARS T, VAN GOOL L. Speeded-Up Robust Features (SURF)[J]. Computer Vision and Image Understanding, 2008, 110(3):346-359.
[5] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB:an efficient alternative to SIFT or SURF[C]//Proceedings of 2011 IEEE International Conference on Computer Vision (ICCV). Barcelona:IEEE, 2012:2564-2571.
[6] ROSTEN E, DRUMMOND T. Machine learning for high-speed corner detection[C]//9th European Conference on Computer Vision. Graz, Austria:Springer, 2006:430-443.
[7] CALONDER M, LEPETIT V, STRECHA C, et al. Brief:binary robust independent elementary features[C]//11th European Conference on Computer Vision. Heraklion, Crete, Greece:Springer, 2010:778-792.
[8] 冯宇平, 戴明, 孙立悦, 等. 图像自动拼接融合的优化设计[J]. 光学精密工程, 2010, 18(2):470-476 FENG Yu-ping, DAI Ming, SUN Li-yue, et al. Optimized design of automatic image mosaic[J]. Optics and Precision Engineering, 2010, 18(2):470-476
[9] 何宾, 陶丹, 彭勃. 高实时性F-SIFT图像拼接算法[J]. 红外与激光工程, 2013, 42(增2):440-444 HE Bin, TAO Dan, PENG Bo. High real-time F-SIFT image mosaic algorithm[J]. Infrared and Laser Engineering, 2013, 42(Suppl. 2):440-444
[10] 李玉峰, 李广泽, 谷绍湖, 等. 基于区域分块与尺度不变特征变换的图像拼接算法[J]. 光学精密工程, 2016, 24(5):1197-1205 LI Yu-feng, LI Guang-ze, GU Shao-hu, et al. Image mosaic algorithm based on area blocking and SIFT[J]. Optics and Precision Engineering, 2016, 24(5):1197-1205
[11] GAO J, KIM S J, BROWN M S. Constructing image panoramas using dual-homography warping[C]//Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Colorado Springs:IEEE, 2011:49-56.
[12] CHEN J, FENG H, PAN K, et al. An optimization method for registration and mosaicking of remote sensing images[J]. Optik-International Journal for Light and Electron Optics, 2014, 125(2):697-703.
[13] WU X, ZHAO Q, BU W. A SIFT-based contactless palmprint verification approach using iterative RANSAC and local palmprint descriptors[J]. Pattern Recognition, 2014, 47(10):3314-3326.
[14] WANG Z, KIEU H, NGUYEN H, et al. Digital image correlation in experimental mechanics and image registration in computer vision:similarities, differences and complements[J]. Optics and Lasers in Engineering, 2015, 65(1):18-27.
[15] SZELISKI R. Image alignment and stitching:a tutorial[J]. Foundations and Trends® in Computer Graphics and Vision, 2006, 2(1):1-104.
[16] CHANG C H, SATO Y, CHUANG Y Y. Shape-preserving half-projective warps for image stitching[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Columbus:IEEE, 2014:3254-3261.
[17] BRINK A D. Image models and the definition of image entropy applied to the problem of unsupervised segmentation[D]. Johannesburg:University of the Witwatersrand, 2016.
[1] SU Hui, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Restoration method of TDI remote sensing image based onoptimization of numerical fidelity term[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(4): 674-679.
[2] FU Yong-yong, WANG Xu-hang, DENG Jin-song, YE Zi-ran, ZHOU Meng-meng, YOU Shu-cheng, GUAN Tao. Extraction of water information in complex water-net plain with Chinese GF-2 remotely sensed images[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(12): 2474-2480.
[3] ZHAO Liao-ying, CHEN Xiao-fen, LI Xiao-run. Hyperspectral change detection based on change vector analysis and spectral unmixing[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2017, 51(10): 1912-1919.