上海交通大学学报(英文版) ›› 2013, Vol. 18 ›› Issue (5): 526-534.doi: 10.1007/s12204-013-1437-7

• • 上一篇    下一篇

Infrared and Visible Image Fusion Based on Region of Interest Detection and Nonsubsampled Contourlet Transform

LIU Huan-xi1,2* (刘欢喜), ZHU Tian-hong1 (朱天竑), ZHAO Jia-jia3 (赵佳佳)   

  1. (1. School of Electronic, Information and Electrical Engineering, Shanghai Jiaotong University, Shanghai 200240, China; 2. Jiangsu Junlong Power Technology Co., Ltd., Jingjiang 214500, Jiangsu, China; 3. Beijing Institute of Mechanical and Electrical Engineering, Beijing 100074, China)
  • 出版日期:2013-10-31 发布日期:2013-12-05
  • 通讯作者: LIU Huan-xi(刘欢喜) E-mail:lhxsjtu@sjtu.edu.cn

Infrared and Visible Image Fusion Based on Region of Interest Detection and Nonsubsampled Contourlet Transform

LIU Huan-xi1,2* (刘欢喜), ZHU Tian-hong1 (朱天竑), ZHAO Jia-jia3 (赵佳佳)   

  1. (1. School of Electronic, Information and Electrical Engineering, Shanghai Jiaotong University, Shanghai 200240, China; 2. Jiangsu Junlong Power Technology Co., Ltd., Jingjiang 214500, Jiangsu, China; 3. Beijing Institute of Mechanical and Electrical Engineering, Beijing 100074, China)
  • Online:2013-10-31 Published:2013-12-05
  • Contact: LIU Huan-xi(刘欢喜) E-mail:lhxsjtu@sjtu.edu.cn

摘要: In order to enhance the contrast of the fused image and reduce the loss of fine details in the process of image fusion, a novel fusion algorithm of infrared and visible images is proposed. First of all, regions of interest (RoIs) are detected in two original images by using saliency map. Then, nonsubsampled contourlet transform (NSCT) on both the infrared image and the visible image is performed to get a low-frequency sub-band and a certain amount of high-frequency sub-bands. Subsequently, the coefficients of all sub-bands are classified into four categories based on the result of RoI detection: the region of interest in the low-frequency sub-band (LSRoI), the region of interest in the high-frequency sub-band (HSRoI), the region of non-interest in the low-frequency sub-band (LSNRoI) and the region of non-interest in the high-frequency sub-band (HSNRoI). Fusion rules are customized for each kind of coefficients and fused image is achieved by performing the inverse NSCT to the fused coefficients. Experimental results show that the fusion scheme proposed in this paper achieves better effect than the other fusion algorithms both in visual effect and quantitative metrics.

关键词: image fusion, region of interest (RoI) detection, saliency map, nonsubsampled contourlet transform (NSCT)

Abstract: In order to enhance the contrast of the fused image and reduce the loss of fine details in the process of image fusion, a novel fusion algorithm of infrared and visible images is proposed. First of all, regions of interest (RoIs) are detected in two original images by using saliency map. Then, nonsubsampled contourlet transform (NSCT) on both the infrared image and the visible image is performed to get a low-frequency sub-band and a certain amount of high-frequency sub-bands. Subsequently, the coefficients of all sub-bands are classified into four categories based on the result of RoI detection: the region of interest in the low-frequency sub-band (LSRoI), the region of interest in the high-frequency sub-band (HSRoI), the region of non-interest in the low-frequency sub-band (LSNRoI) and the region of non-interest in the high-frequency sub-band (HSNRoI). Fusion rules are customized for each kind of coefficients and fused image is achieved by performing the inverse NSCT to the fused coefficients. Experimental results show that the fusion scheme proposed in this paper achieves better effect than the other fusion algorithms both in visual effect and quantitative metrics.

Key words: image fusion, region of interest (RoI) detection, saliency map, nonsubsampled contourlet transform (NSCT)

中图分类号: