A Multi-Scale Transform Method Based on Morphological Operators for Pansharpening

Document Type : Research Article

Author

Department of Electrical Engineering (Communication), Tarbiat Modares University

Abstract

The aim of pansharpening is to fuse the low resolution multispectral (MS) image with the high resolution panchromatic (PAN) image to provide a synthesized MS image with high resolution. One of the main approaches for pansharpening is the multi-resolution analysis (MRA). It is generally successful in transform of spectral information. But, it often results in spatial distortion in the fused product. To deal with this problem, a morphological profile based multi-scale transform (MP-MST) is proposed in this paper which utilizes the good characteristics of morphological filters for reduction of spatial redundancies in the pansharpened image. More efficient approximate image and detail image are achieved from the MS and PAN images by applying the closing and opening by reconstruction operators, respectively. Different spatial structures with different sizes are extracted through considering a range of structuring elements sizes. The performance of the proposed MP-MST methods is compared to MST ones by doing experiments on three different remote sensors GeoEye, QuickBird and IKONOS. The experiments show the superior performance of MP-MST method compared to MST in terms of various qualitative assessments. The visual comparison is also investigated. The proposed MP-MST methods solve the problem of noise and redundant spatial information in the pansharpened images significantly.

Keywords

Main Subjects

References

 [1]X. He, L. Condat, J. M. Bioucas-Dias, J. Chanussot, J. Xia,A New Pansharpening Method Based on Spatial and Spectral Sparsity Priors, IEEE Transactions on Image Processing 23 (9) (2014) 4160-4174.
[2]X. Zhou , J. Liu , S. Liu , L. Cao , Q. Zhou, H. Huang,A GIHS-based spectral preser- vation fusion method for remote sensing images using edge restored spectral modulation, ISPRS Journal of Photogrammetry and Remote Sensing 88 (2014) 16–27.
 [3]J. Duran, A. Buades, B. Coll, C. Sbert, G. Blanchet, A survey of pansharpening methods with a new band-decoupled variational model, ISPRS Journal of Photogrammetry and Remote Sensing 125 (2017) 78-105.
[4]X. Luo, Z. Zhang, X. Wu, A novel algorithm of remote sensing image fusion based on shift-invariant Shearlet transform and regional selection, AEU - International Journal of Electronics and Communications 70 (2) (2016) 186-197.
[5]L. Alparone, S. Baronti, B. Aiazzi, A. Garzelli, Spatial Methods for Multispectral Pansharpening: Multiresolution Analysis Demystified, IEEE Transactions on Geoscience and Remote Sensing 54 (5) (2016) 2563-2576.
[6]W. Kong, Y. Lei, Y. Lei, X. Ni, Fusion technique for grey-scale visible light and infrared images based on non-subsampled contourlet transform and intensity-hue-saturation transform, IET Signal Processing 5 (1) (2011) 75-80.
[7]Shruti, S. Budhiraja, Multiscale image fusion for pansharpening of multispectral images using saliency detection, 2016 Ninth International Conference on Contemporary Computing (IC3), Noida (2016) 1-6.
[8]C. Theoharatos, V. Tsagaris, N. Fragoulis, G. Economou,Hyperspectral image fusion using 2-D principal component analysis, 2011 2nd International Conference on Space Technology, Athens (2011) 1-4.
 [9]Earth Resource Mapping Pty Ltd,The Brovey transform explained, EMU Forum, vol. 2, no. 11, 1990. Available at: http: // www. ermapper.com/ forum_new/emuf2-11.htm # aiticle_5 (last accessed 05.05.2013).
 [10]A. Garzelli, F. Nencini, L. Capobianco,Optimal MMSE pan sharpening of very high resolution multispectral images, IEEE Transactions on Geoscience and Remote Sensing 46 (1) (2008) 228–236.
 [11]C. L. Chien and W. H. Tsai,Image Fusion With No Gamut Problem by Improved Nonlinear IHS Transforms for Remote Sensing, in IEEE Transactions on Geoscience and Remote Sensing, 52 (1) (2014) 651-663.
  [12]S. Zhong, Y. Zhang, Y. Chen, D. Wu,Combining Component Substitution and Multiresolution Analysis: A Novel Generalized BDSD Pansharpening Algorithm, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (6) (2017) 2867-2875.
[13]F. Palsson, J. R. Sveinsson, M. O. Ulfarsson, J. A. Benediktsson,Model-Based Fusion of Multi- and Hyperspectral Images Using PCA and Wavelets, IEEE Transactions on Geoscience and Remote Sensing 53 (5) (2015) 2652-2663.
[14]P.J. Burt, E.H. Adelson,The Laplacian pyramid as a compact image code, IEEE Transactions on Communications 31 (4) (1983) 532–540.
 [15]A. Toet, Image fusion by a ratio of low pass pyramid, Pattern Recogn. Lett. 9 (4) (1989) 245–253.
[16]U. Yati, M. Biswas, Dual Discrete Wavelet Transform Based Image Fusion Using Averaging Principal Component, Recent Trends in Communication, Computing, and Electronics. Lecture Notes in Electrical Engineering 524 (2019).
[17]J. Lewis, R. OCallaghan, S. Nikolov, D. Bull, N. Canagarajah,Pixel and region based image fusion with complex wavelets, Inform. Fusion 8 (2) (2007) 119–130.
 [18]F. Nencini, A. Garzelli, S. Baronti, L. Alparone, Remote sensing image fusion using the curvelet transform, Inform. Fusion 8 (2) (2007) 143–156.
 [19]Q. Zhang, B. Guo,Multifocus image fusion using the nonsubsampled contourlet transform, Signal Process., 89 (7) (2009) 1334–1346.
 [20]Yu Liu, Shuping Liu, Zengfu Wang, A general framework for image fusion based on multi-scale transform and sparse representation, Information Fusion 24 (2015) 147-164.
 [21]M. Vega, J. Mateos, R. Molina, A. K. Katsaggelos, Super Resolution of Multispectral Images using ℓ1 Image Models and Interband Correlations, Journal of Signal Processing Systems for Signal, Image, and Video Technology 65 (3) (2011) 509–523.
[22]X. Yang, L. Jian, B. Yan, K. Liu, L. Zhang, Y. Liu, A sparse representation based pansharpening method, Future Generation Computer Systems, 88 (2018): 385-399.
 [23]M. Imani, H. Ghassemian, Pansharpening Optimisation Using MultiResolution Analysis and Sparse Representation, International Journal of Image and Data Fusion 8 (3) 270–292, 2017.
 [24]J. Qu, Y. Li, W. Dong, Fusion of hyperspectral and panchromatic images using an average filter and a guided filter, Journal of Visual Communication and Image Representation 52 (2018) 151-158.
 [25]B. Aiazzi, L. Alparone, S. Baronti, A. Garzelli, M. Selva, MTF-tailored multiscale fusion of high-resolution MS and Pan imagery, Photogramm. Eng. Remote Sens. 72 (5) (2006) 591–596.
 [26]R. Restaino, G. Vivone, M. Dalla Mura, and J. Chanussot, Fusion of Multispectral and Panchromatic Images Based on Morphological Operators, IEEE Transactions on Image Processing, 25 (6) (2016): 2882- 2895.
 [27]F. Laporterie, O. Amram, G. Flouzat, E. Pilicht, and M. Gayt, Data fusion thanks to an improved morphological pyramid approach: comparison loop on simulated images and application to SPOT 4 data, Proc. IEEE IGARSS, (2000) 2117–2119.
[28]M. Imani, H. Ghassemian, Edge patch image-based morphological profiles for classification of multispectral and hyperspectral data, IET Image Processing 11 (3) (2017) 164-172.
 [29]A.-G. Legaz-Aparicio, R. Verdu-Monedero, J. Angulo, Adaptive morphological filters based on a multiple orientation vector field dependent on image local features, Journal of Computational and Applied Mathematics 330 (2018) 965-981.
 [30]P. J. Burt, R. J. Kolezynski, Enhanced image capture through fusion, in Proc. International Conference on Computer Vision (1993) 173-182.
 [31]A. Toet, Image fusion by a ratio of low-pass pyramid, Pattern Recognition Letters 9 (4) (1989) 245-253.
 [32]R. C. Gonzalez,‌ R. E. Woods, Digital Image Processing (3rd Edition), Prentice-Hall, Inc. Upper Saddle River, NJ, USA, 2006.
 [33]R. Raj Singh, R. Mishra, Benefits of Dual Tree Complex Wavelet Transform over Discrete Wavelet Transform for Image Fusion, International Journal for Innovative Research in Science & Technology 1 (11) (2015) 259-263.
 [34]T. S. Anand, K. Narasimhan, P. Saravanan,Performance evaluation of image fusion using the Multi-Wavelet and Curvelet transforms, IEEE-International Conference On Advances In Engineering, Science And Management (ICAESM -2012), Nagapattinam, Tamil Nadu (2012) 121-129.
[35]M. Dalla Mura, J. A. Benediktsson, B. Waske, L. Bruzzone, Extended profiles with morphological attribute filters for the analysis of hyperspectral data, Int. J. Remote Sens., 31 (22) (2010) 5975–5991.
 [36]G. Vivone et al.,A Critical Comparison Among Pansharpening Algorithms, IEEE Transactions on Geoscience and Remote Sensing 53 (5) (2015) 2565-2586.
[37]M. B. Akbari Haghighat, A. Aghagolzadeh, H. Seyedarabi, A non-reference image fusion metric based on mutual information of image features, Computers & Electrical Engineering 37 (5) (2011) 744-756.
[38]M. Imani, H. Ghassemian, Binary coding based feature extraction in remote sensing high dimensional data, Information Sciences 342 (2016) 191-208.
AUT Journal of Modeling and Simulation
Volume 52, Issue 1
June 2020
Pages 97-116

Files

Share

How to cite

Statistics