Real-time semantic segmentation based on improved BiSeNet

doi:10.37188/OPE.20233108.1217

CIOMP OpenIR

	Real-time semantic segmentation based on improved BiSeNet
	F. Ren, L. Yang, H. Zhou, S. Zhang, X. He and W. Xu
	2023
发表期刊	Guangxue Jingmi Gongcheng/Optics and Precision Engineering
ISSN	1004924X
卷号	31 期号:8 页码:1217-1227
摘要	To improve the performance of image semantic segmentation on accuracy and efficiency for practical applications, in this study, we propose a real-time semantic segmentation algorithm based on improved BiSeNet. First, the redundancy of certain channels and parameters of BiSeNet is eliminated by sharing the heads of dual branches, and the affluent shallow features are effectively extracted at the same time. Subsequently, the shared layers are divided into dual branches, namely, the detail branch and the semantic branch, which are used to extract detailed spatial information and contextual semantic information, respectively. Furthermore, both the channel attention mechanism and spatial attention mechanism are introduced into the tail of the semantic branch to enhance the feature representation; thus the BiSeNet is optimized by using dual attention mechanisms to extract contextual semantic features more effectively. Finally, the features of the detail branch and semantic branch are fused and up-sampled to the resolution of the input image to obtain semantic segmentation. Our proposed algorithm achieves 77. 2% mIoU on accuracy with real-time performance of 95. 3 FPS on Cityscapes dataset and 73. 8% mIoU on accuracy with real-time performance of 179. 1 FPS on CamVid dataset. The experiments demonstrate that our proposed semantic segmentation algorithm achieves a good trade-off between accuracy and efficiency. Furthermore, the performance of semantic segmentation is significantly improved compared with BiSeNet and other existing algorithms. © 2023 Chinese Academy of Sciences. All rights reserved.
DOI	10.37188/OPE.20233108.1217
URL	查看原文
收录类别	ei
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/67811
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	F. Ren, L. Yang, H. Zhou, S. Zhang, X. He and W. Xu. Real-time semantic segmentation based on improved BiSeNet[J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering,2023,31(8):1217-1227.
APA	F. Ren, L. Yang, H. Zhou, S. Zhang, X. He and W. Xu.(2023).Real-time semantic segmentation based on improved BiSeNet.Guangxue Jingmi Gongcheng/Optics and Precision Engineering,31(8),1217-1227.
MLA	F. Ren, L. Yang, H. Zhou, S. Zhang, X. He and W. Xu."Real-time semantic segmentation based on improved BiSeNet".Guangxue Jingmi Gongcheng/Optics and Precision Engineering 31.8(2023):1217-1227.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Real-time semantic s（1754KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载