High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images

doi:10.3390/rs15184497

CIOMP OpenIR

	High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images
	X. Zhang, Q. Liu, H. Chang and H. Sun
	2023
发表期刊	Remote Sensing
ISSN	20724292
卷号	15 期号:18
摘要	Small object detection in remote sensing enables the identification and analysis of unapparent but important information, playing a crucial role in various ground monitoring tasks. Due to the small size, the available feature information contained in small objects is very limited, making them more easily buried by the complex background. As one of the research hotspots in remote sensing, although many breakthroughs have been made, there still exist two significant shortcomings for the existing approaches: first, the down-sampling operation commonly used for feature extraction can barely preserve weak features of objects in a tiny size; second, the convolutional neural network methods have limitations in modeling global context to address cluttered backgrounds. To tackle these issues, a high-resolution network with transformer embedding parallel detection (HRTP-Net) is proposed in this paper. A high-resolution feature fusion network (HR-FFN) is designed to solve the first problem by maintaining high spatial resolution features with enhanced semantic information. Furthermore, a Swin-transformer-based mixed attention module (STMA) is proposed to augment the object information in the transformer block by establishing a pixel-level correlation, thereby enabling global background–object modeling, which can address the second shortcoming. Finally, a parallel detection structure for remote sensing is constructed by integrating the attentional outputs of STMA with standard convolutional features. The proposed method effectively mitigates the impact of the intricate background on small objects. The comprehensive experiment results on three representative remote sensing datasets with small objects (MASATI, VEDAI and DOTA datasets) demonstrate that the proposed HRTP-Net achieves a promising and competitive performance. © 2023 by the authors.
DOI	10.3390/rs15184497
URL	查看原文
收录类别	sci ; ei
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/68204
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	X. Zhang, Q. Liu, H. Chang and H. Sun. High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images[J]. Remote Sensing,2023,15(18).
APA	X. Zhang, Q. Liu, H. Chang and H. Sun.(2023).High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images.Remote Sensing,15(18).
MLA	X. Zhang, Q. Liu, H. Chang and H. Sun."High-Resolution Network with Transformer Embedding Parallel Detection for Small Object Detection in Optical Remote Sensing Images".Remote Sensing 15.18(2023).

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
High-Resolution Netw（185957KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载