CIOMP OpenIR
Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss
D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu
2020
发表期刊Ieee Access
ISSN2169-3536
卷号8页码:206445-206458
摘要The fusion of infrared and visible images can utilize the indication characteristics and the textural details of source images to realize the all-weather detection. The deep learning (DL) based fusion solutions can reduce the computational cost and complexity compared with traditional methods since there is no need to design complex feature extraction methods and fusion rules. There are no standard reference images and the publicly available infrared and visible image pairs are scarce. Most supervised DL-based solutions have to take pre-training on other labeled large datasets which may not behave well when testing. The few unsupervised fusion methods can hardly obtain ideal images with good visual impression. In this paper, an infrared and visible image fusion method based on unsupervised convolutional neural network is proposed. When designing the network structure, densely connected convolutional network (DenseNet) is used as the sub-network for feature extraction and reconstruction to ensure that more information of source images can be retained in the fusion images. As to loss function, the perceptual loss is creatively introduced and combined with the structure similarity loss to constrain the updating of weight parameters during the back propagation. The perceptual loss designed helps to improve the visual information fidelity (VIF) of the fusion image effectively. Experimental results show that this method can obtain fusion images with prominent targets and obvious details. Compared with other 7 traditional and deep learning methods, the fusion results of this method are better on objective evaluation and visual observation when taken together.
DOI10.1109/access.2020.3037770
URL查看原文
收录类别SCI ; EI
语种英语
引用统计
文献类型期刊论文
条目标识符http://ir.ciomp.ac.cn/handle/181722/64614
专题中国科学院长春光学精密机械与物理研究所
推荐引用方式
GB/T 7714
D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu. Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss[J]. Ieee Access,2020,8:206445-206458.
APA D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu.(2020).Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss.Ieee Access,8,206445-206458.
MLA D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu."Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss".Ieee Access 8(2020):206445-206458.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Xu-2020-Infrared and(2236KB)期刊论文出版稿开放获取CC BY-NC-SA浏览 请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu]的文章
百度学术
百度学术中相似的文章
[D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu]的文章
必应学术
必应学术中相似的文章
[D. D. Xu,Y. C. Wang,X. Zhang,N. Zhang and S. B. Yu]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Xu-2020-Infrared and Visible Image Fusion Usin.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。