Changchun Institute of Optics,Fine Mechanics and Physics,CAS
Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism | |
D. D. Xu; N. Zhang; Y. X. Zhang; Z. Li; Z. K. Zhao and Y. C. Wang | |
2022 | |
发表期刊 | Infrared Physics & Technology |
ISSN | 1350-4495 |
卷号 | 125页码:12 |
摘要 | Infrared and visible image fusion can synthesize complementary features of salient objects and texture details which are important for all-weather detection and other tasks. Nowadays, the deep learning based unsupervised fusion solutions are preferred and have obtained good results since the reference images for fusion tasks are not available. In the existing methods, some prominent features are missing in the fused images and the visual vitality needs to be improved. From this thought, attention mechanism is introduced to the fusion network. Especially, channel dimension and spatial dimension attention are jointed to supplement each other for feature extraction. Multiple attention branches emphasize on multi-scale features to complete the encoding. Skip connections are added to learn residual information. The multi-layer perceptual loss, the structure similarity loss and the content loss together construct the strong constraints for training. Comparative experiments with subjective and objective evaluations on 4 traditional and 9 deep learning based methods demonstrate the advantages of the proposed model. |
DOI | 10.1016/j.infrared.2022.104242 |
URL | 查看原文 |
收录类别 | sci ; ei |
语种 | 英语 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ciomp.ac.cn/handle/181722/66884 |
专题 | 中国科学院长春光学精密机械与物理研究所 |
推荐引用方式 GB/T 7714 | D. D. Xu,N. Zhang,Y. X. Zhang,et al. Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism[J]. Infrared Physics & Technology,2022,125:12. |
APA | D. D. Xu,N. Zhang,Y. X. Zhang,Z. Li,&Z. K. Zhao and Y. C. Wang.(2022).Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism.Infrared Physics & Technology,125,12. |
MLA | D. D. Xu,et al."Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism".Infrared Physics & Technology 125(2022):12. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Multi-scale unsuperv(13604KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论