Changchun Institute of Optics,Fine Mechanics and Physics,CAS
Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss | |
D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu | |
2020 | |
发表期刊 | Ieee Access |
ISSN | 2169-3536 |
卷号 | 8页码:206445-206458 |
摘要 | The fusion of infrared and visible images can utilize the indication characteristics and the textural details of source images to realize the all-weather detection. The deep learning (DL) based fusion solutions can reduce the computational cost and complexity compared with traditional methods since there is no need to design complex feature extraction methods and fusion rules. There are no standard reference images and the publicly available infrared and visible image pairs are scarce. Most supervised DL-based solutions have to take pre-training on other labeled large datasets which may not behave well when testing. The few unsupervised fusion methods can hardly obtain ideal images with good visual impression. In this paper, an infrared and visible image fusion method based on unsupervised convolutional neural network is proposed. When designing the network structure, densely connected convolutional network (DenseNet) is used as the sub-network for feature extraction and reconstruction to ensure that more information of source images can be retained in the fusion images. As to loss function, the perceptual loss is creatively introduced and combined with the structure similarity loss to constrain the updating of weight parameters during the back propagation. The perceptual loss designed helps to improve the visual information fidelity (VIF) of the fusion image effectively. Experimental results show that this method can obtain fusion images with prominent targets and obvious details. Compared with other 7 traditional and deep learning methods, the fusion results of this method are better on objective evaluation and visual observation when taken together. |
DOI | 10.1109/access.2020.3037770 |
URL | 查看原文 |
收录类别 | SCI ; EI |
语种 | 英语 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ciomp.ac.cn/handle/181722/64614 |
专题 | 中国科学院长春光学精密机械与物理研究所 |
推荐引用方式 GB/T 7714 | D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu. Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss[J]. Ieee Access,2020,8:206445-206458. |
APA | D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu.(2020).Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss.Ieee Access,8,206445-206458. |
MLA | D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu."Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss".Ieee Access 8(2020):206445-206458. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Xu-2020-Infrared and(2236KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论