PSNet: LiDAR and Camera Registration Using Parallel Subnetworks

doi:10.1109/access.2022.3186974

CIOMP OpenIR

	PSNet: LiDAR and Camera Registration Using Parallel Subnetworks
	Y. Wu; M. Zhu and J. Liang
	2022
发表期刊	Ieee Access
ISSN	2169-3536
卷号	10 页码:70553-70561
摘要	The working environment of autonomous driving and robot navigation is so complex and dynamic that a single type of sensor is insufficient for performing object detection. Thus, in many perception schemes, the LiDAR-camera fusion strategy is preferred. However, the performance of a LiDAR-camera fusion heavily relies on a set of accurately calibrated extrinsic parameters. We propose PSNet, an end-to-end convolutional neural network (CNN) for calibration; this is the first calibration network to use parallel subnetworks to obtain multiresolution features and fuse them adaptively to encourage robustness against different initial error ranges. The method has three key characteristics: (i) Addition of a downsampling block to improve suitability for sparse projected depth maps; (ii) Connection of the high-to-low resolution convolution streams in parallel to obtain multiresolution features that are spatially more precise and contain richer semantic information; (iii) Fusion of multiresolution streams by the multiscale feature aggregation module. The network corrects errors from initial calibration to the ground truth online, rather than directly obtaining the accurate parameters. We evaluated our model on the KITTI datasets and it outperformed other CNN-based methods. In addition, extensive experiments evaluating the model with untrained and unfamiliar datasets demonstrated that our method exhibited good generalization ability.
DOI	10.1109/access.2022.3186974
URL	查看原文
收录类别	sci ; ei
语种	英语
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/67009
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Y. Wu,M. Zhu and J. Liang. PSNet: LiDAR and Camera Registration Using Parallel Subnetworks[J]. Ieee Access,2022,10:70553-70561.
APA	Y. Wu,&M. Zhu and J. Liang.(2022).PSNet: LiDAR and Camera Registration Using Parallel Subnetworks.Ieee Access,10,70553-70561.
MLA	Y. Wu,et al."PSNet: LiDAR and Camera Registration Using Parallel Subnetworks".Ieee Access 10(2022):70553-70561.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
PSNet_ LiDAR and Cam（1465KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载