Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain

doi:10.1109/ACCESS.2021.3086096

CIOMP OpenIR

	Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain
	C. Gao; D. Qi; Y. Zhang; C. Song and Y. Yu
	2021
发表期刊	IEEE Access
ISSN	21693536
卷号	9 页码:91883-91895
摘要	Although the traditional image fusion method can obtain rich image results, obvious artificial noise and artifacts are often present in the resulting image. Fusion algorithms based on neural networks can avoid the shortcomings of traditional methods, but they are more complex and less flexible. In this study, we proposed a fusion method using the deep residual neural network ResNet152, which can not only effectively suppress artificial noise but also preserve the edge details of the image and improve the efficiency of the neural network. The proposed method is characterized by a multiscale transformation of an infrared image and visible light image in the optimized nonsubsampled contourlet transformation domain, and the deep residual neural network ResNet152 is used to extract the deep features of the low-pass component to guide the fusion of the low-pass component. The bandpass component is fused by taking the modulus maximum. This method can fully retain the global features and structural information of the source image in the result image. Compared to existing fusion methods using public test image sets, the experimental results show that on a subjective level, the fusion method creates sharper depth edges and fewer noise artifacts than traditional fusion methods. From an objective perspective, the average value for the results of the evaluation function is greater than that of other fusion methods. 2013 IEEE.
DOI	10.1109/ACCESS.2021.3086096
URL	查看原文
收录类别	SCI ; EI
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/65343
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	C. Gao,D. Qi,Y. Zhang,et al. Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain[J]. IEEE Access,2021,9:91883-91895.
APA	C. Gao,D. Qi,Y. Zhang,&C. Song and Y. Yu.(2021).Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain.IEEE Access,9,91883-91895.
MLA	C. Gao,et al."Infrared and Visible Image Fusion Method Based on ResNet in a Nonsubsampled Contourlet Transform Domain".IEEE Access 9(2021):91883-91895.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Infrared and Visible（3810KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载