Changchun Institute of Optics,Fine Mechanics and Physics,CAS
Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection | |
S. Wang, F. Jiang and B. Xu | |
2023 | |
发表期刊 | Sensors
![]() |
ISSN | 14248220 |
卷号 | 23期号:21 |
摘要 | Salient object detection (SOD), which is used to identify the most distinctive object in a given scene, plays an important role in computer vision tasks. Most existing RGB-D SOD methods employ a CNN-based network as the backbone to extract features from RGB and depth images; however, the inherent locality of a CNN-based network limits the performance of CNN-based methods. To tackle this issue, we propose a novel Swin Transformer-based edge guidance network (SwinEGNet) for RGB-D SOD in which the Swin Transformer is employed as a powerful feature extractor to capture the global context. An edge-guided cross-modal interaction module is proposed to effectively enhance and fuse features. In particular, we employed the Swin Transformer as the backbone to extract features from RGB images and depth maps. Then, we introduced the edge extraction module (EEM) to extract edge features and the depth enhancement module (DEM) to enhance depth features. Additionally, a cross-modal interaction module (CIM) was used to integrate cross-modal features from global and local contexts. Finally, we employed a cascaded decoder to refine the prediction map in a coarse-to-fine manner. Extensive experiments demonstrated that our SwinEGNet achieved the best performance on the LFSD, NLPR, DES, and NJU2K datasets and achieved comparable performance on the STEREO dataset compared to 14 state-of-the-art methods. Our model achieved better performance compared to SwinNet, with 88.4% parameters and 77.2% FLOPs. Our code will be publicly available. © 2023 by the authors. |
DOI | 10.3390/s23218802 |
URL | 查看原文 |
收录类别 | sci ; ei |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ciomp.ac.cn/handle/181722/67955 |
专题 | 中国科学院长春光学精密机械与物理研究所 |
推荐引用方式 GB/T 7714 | S. Wang, F. Jiang and B. Xu. Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection[J]. Sensors,2023,23(21). |
APA | S. Wang, F. Jiang and B. Xu.(2023).Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection.Sensors,23(21). |
MLA | S. Wang, F. Jiang and B. Xu."Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection".Sensors 23.21(2023). |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Swin Transformer-Bas(4703KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[S. Wang, F. Jiang and B. Xu]的文章 |
百度学术 |
百度学术中相似的文章 |
[S. Wang, F. Jiang and B. Xu]的文章 |
必应学术 |
必应学术中相似的文章 |
[S. Wang, F. Jiang and B. Xu]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论