Fusion of Remote Sensing Images Based on   Nonsubsampled Contourlet Transform and Region Segmentation

doi:10.1007/s12204-011-1216-2

Abstract

Abstract: The purpose of remote sensing images fusion is to produce a
fused image that contains more clear, accurate and comprehensive information
than any single image. A novel fusion method is proposed in this paper based
on nonsubsampled contourlet transform (NSCT) and region segmentation.
Firstly, the multispectral image is transformed to intensity-hue-saturation (IHS) system. Secondly, the panchromatic image and the component intensity of the multispectral image are
decomposed by NSCT. Then the NSCT coefficients of high and low frequency
subbands are fused by different rules, respectively. For the high frequency
subbands, the fusion rules are also unalike in the smooth and edge regions.
The two regions are segregated in the panchromatic image, and the
segmentation is based on particle swarm optimization. Finally, the fusion
image can be obtained by performing inverse NSCT and inverse IHS transform.
The experimental results are evaluated by both subjective and objective
criteria. It is shown that the proposed method can obtain superior results
to others.

Key words:

image fusion| multispectral remote sensing image|
panchromatic image| nonsubsampled contourlet transform (NSCT)| particle

摘要： The purpose of remote sensing images fusion is to produce a
fused image that contains more clear, accurate and comprehensive information
than any single image. A novel fusion method is proposed in this paper based
on nonsubsampled contourlet transform (NSCT) and region segmentation.
Firstly, the multispectral image is transformed to intensity-hue-saturation (IHS) system. Secondly, the panchromatic image and the component intensity of the multispectral image are
decomposed by NSCT. Then the NSCT coefficients of high and low frequency
subbands are fused by different rules, respectively. For the high frequency
subbands, the fusion rules are also unalike in the smooth and edge regions.
The two regions are segregated in the panchromatic image, and the
segmentation is based on particle swarm optimization. Finally, the fusion
image can be obtained by performing inverse NSCT and inverse IHS transform.
The experimental results are evaluated by both subjective and objective
criteria. It is shown that the proposed method can obtain superior results
to others.

关键词:

image fusion| multispectral remote sensing image|
panchromatic image| nonsubsampled contourlet transform (NSCT)| particle

CLC Number:

TP751.1

WU Yi-quan (吴一全), WU Chao (吴超), WU Shi-hua (吴诗婳) . Fusion of Remote Sensing Images Based on Nonsubsampled Contourlet Transform and Region Segmentation[J]. Journal of shanghai Jiaotong University (Science), 2011, 16(6): 722-727.

References

1 Choi M. A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter [J]. IEEE Transactions on Geoscience and Remote Sensing, 2006, 44 (6): 1672-1682.

    2 Nikolakopoulos K G. Comparison of nine fusion techniques for very high resolution data [J]. Photogrammetric Engineering and Remote Sensing, 2008, 74 (5): 647-659.

    3 Metwalli M R, Nasr A H, Allah O S F, et al. Satellite image fusion based on principal component analysis and high-pass filtering [J]. Journal of the Optical Society of America A (Optics, Image Science and Vision), 2010, 27 (6): 1385-1394.

    4 Liu B, Liu W J, Peng J X. Multispectral image fusion method based on intensity-hue-saturation and nonsubsampled three-channels non-separable wavelets [J]. Chinese Optics Letters, 2010, 8 (4): 384-387.

    5 Liu B, Peng J X. Multi-spectral image fusion method based on two channels non-separable wavelets [J]. Science in China Series F (Information Science), 2008, 51 (12): 2022-2032.

    6 Xue   Jian, Yu   Sheng-lin, Wang   Hong-ping. An image fusion algorithm based on lifting wavelet transform and IHS transform [J]. Journal of Image and Graphics, 2009, 14 (2): 340-345 (in Chinese).

    7 Donoho M N, Vetterli M. The contourlet transform: An efficient

directional multiresolution image representation [J]. IEEE

Transactions on Image Processing, 2005, 14 (12): 2091-2106.

    8 Cunha A L, Zhou J P, Donoho M N. The nonsubsampled contourlet transform: Theory, design, and applications [J]. IEEE Transactions on Image Processing, 2006, 15 (10): 3089-3101.

    9 Eberhart R C, Kennedy J. Particle swarm optimization [C]// Proceedings of the 1995 IEEE International Conference on Neural Networks. Piscataway, NJ, USA: IEEE, 1995: 1942-1948.

    10 Wu   Yan, Yang   Wan-hai, Li   Ming. Fusion algorithm of

multispectral and high-resolution panchromatic images [J]. Acta

Photonica Sinica, 2003, 32 (2): 174-178 (in Chinese).

    11 Wu   Yan, Li   Ming, Liang   Ji-ming, et al. A new algorithm of image fusion [J]. Journal of Electronics and Information Technology, 2003, 25 (1): 44-49 (in Chinese).

12 Chen W, Fang K L. Multilevel thresholding algorithm based on particle swarm optimization for image segmentation [C]// 2008 Chinese Control Conference. Piscataway, NJ, USA: IEEE, 2008: 346-351.

[1]	HUANG Yixiang, DOU Xun, LI Linxi, YANG Hanyu, YU Jiancheng, HUO Xianxu. Quantitative Method of Response Value of Integrated Energy Equipment Based on Global Sensitivity Analysis [J]. Journal of Shanghai Jiao Tong University, 2025, 59(5): 569-579.
[2]	WANG Yili, LI Qiang, SHEN Junyi, YANG Yidong, WANG Qi. Multi-Modal Warship Image Generation and Its Key Part Detection [J]. Air & Space Defense, 2025, 8(1): 77-85.
[3]	LIN Sen, WEN Shuli, ZHU Miao, DAI Qun, YAN Lun, ZHAO Yao, YE Huili. Optimal Allocation of Electric-Thermal Hybrid Energy Storage for Seaport Integrated Energy System Considering Carbon Trading Mechanism [J]. Journal of Shanghai Jiao Tong University, 2024, 58(9): 1344-1356.
[4]	SUN Xin, WANG Simin, XIE Jingdong, JIANG Hailin, WANG Sen. Improved Transformer-PSO Short-Term Electricity Price Prediction Method Considering Multidimensional Influencing Factors [J]. Journal of Shanghai Jiao Tong University, 2024, 58(9): 1420-1431.
[5]	LI Jinfeng, CHEN Wuguang, ZHANG Zhengchuan, XU Yongliang, LI Kaiying, YIN Junlian, WANG Dezhong. Measurement of Gas-Liquid Two-Phase Flow in Draft Tube [J]. Journal of Shanghai Jiao Tong University, 2024, 58(8): 1188-1200.
[6]	ZHANG Haigang, XIE Jinhuai, LIU Jiaqi, GONG Lijia, LI Zhi. Depth Distribution Characteristics of Particle Velocity Field Intensity in Shallow Sea [J]. Journal of Shanghai Jiao Tong University, 2024, 58(7): 995-1005.
[7]	LIN Yan^{1, 2}(林焰), BIAN Xuanyi¹(卞璇屹), DONG Zongran³(董宗然). Ship Pipe Layout Optimization Based on Improved Particle Swarm Optimization [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(5): 737-746.
[8]	CUI Xian, CHEN Ziqiang. A Highly Robust State of Health Estimation Method for Lithium-Ion Batteries Based on ECM and SGPR [J]. Journal of Shanghai Jiao Tong University, 2024, 58(5): 747-759.
[9]	ZHANG Kangjian (张康健), HU Zhechuan (胡哲钏), ZHANG Zhiqiang (张志强). Load Characteristics and Optimal Layout of Center and Gage Cutters of Rock Formation Compound Tunnel Boring Machine [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(5): 857-875.
[10]	CHEN Kun(陈坤), ZHAO Xu(赵旭), DONG Chunyu(董春玉), DI Zichao(邸子超), CHEN Zongzhi(陈宗枝). Anti-Occlusion Object Tracking Algorithm Based on Filter Prediction [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 400-413.
[11]	SUN Zhiwei, HU Xiong, DONG Kai, SUN Dejian, LIU Yang. RUL Prediction Method for Quay Crane Hoisting Gearbox Bearing Based on LSTM-CAPF Framework [J]. Journal of Shanghai Jiao Tong University, 2024, 58(3): 352-360.
[12]	XIONG Jingyi, HU Weijun, YIN Wei, ZHANG Weijie, YANTao. Research on Collaborative Optimization Decision Algorithm for Multi-Missile Clusters [J]. Air & Space Defense, 2024, 7(3): 86-93.
[13]	ZHAO Libei, XIA Zhixun, MA Likun, CHEN Binbin, FENG Yunchao, YANG Pengnian, LI Chaolong, LIU Yandong. Study on the Influence of Combustor Configuration on Combustion Characteristics of Solid Rocket Scramjet [J]. Air & Space Defense, 2024, 7(3): 54-63.
[14]	ZHANG Nianfan, XIAO Longfei, CHEN Gang. A Review of Numerical Studies of Wave Impacts on Marine Structures [J]. Journal of Shanghai Jiao Tong University, 2024, 58(2): 127-140.
[15]	JI Yuheng, LI Chuntong, LUO Xiaomeng, YANG Xuelian, WANG Deyu. Layout Optimization Design of Human Machine Interface in Wheelhouse Based on Ergonomics [J]. Journal of Shanghai Jiao Tong University, 2024, 58(2): 201-210.

Fusion of Remote Sensing Images Based on Nonsubsampled Contourlet Transform and Region Segmentation

Fusion of Remote Sensing Images Based on Nonsubsampled Contourlet Transform and Region Segmentation

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles 0

Metrics

Comments