Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter

doi:10.3390/s21062217

CIOMP OpenIR

	Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter
	B. Zhao; Y. Wang; K. Su; H. Ren and H. Sun
	2021
发表期刊	Sensors
ISSN	14248220
卷号	21 期号:6 页码:1-17
摘要	This paper proposes an action recognition algorithm based on the capsule network and Kalman filter called "Reading Pictures Instead of Looking" (RPIL). This method resolves the convolutional neural networks over sensitivity to rotation and scaling and increases the interpretability of the model as per the spatial coordinates in graphics. The capsule network is first used to obtain the components of the target human body. The detected parts and their attribute parameters (e.g., spatial coordinates, color) are then analyzed by Bert. A Kalman filter analyzes the predicted capsules and filters out any misinformation to prevent the action recognition results from being affected by incorrectly predicted capsules. The parameters between neuron layers are evaluated, then the structure is pruned into a dendritic network to enhance the computational efficiency of the algorithm. This minimizes the dependence of in-depth learning on the random features extracted by the CNN without sacrificing the models accuracy. The association between hidden layers of the neural network is also explained. With a 90% observation rate, the OAD dataset test precision is 83.3%, the ChaLearn Gesture dataset test precision is 72.2%, and the G3D dataset test precision is 86.5%. The RPILNet also satisfies real-time operation requirements (30 fps). 2021 by the authors. Licensee MDPI, Basel, Switzerland.
DOI	10.3390/s21062217
URL	查看原文
收录类别	SCI ; EI
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/65573
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	B. Zhao,Y. Wang,K. Su,et al. Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter[J]. Sensors,2021,21(6):1-17.
APA	B. Zhao,Y. Wang,K. Su,&H. Ren and H. Sun.(2021).Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter.Sensors,21(6),1-17.
MLA	B. Zhao,et al."Reading Pictures Instead of Looking: RGB-D Image-Based Action Recognition via Capsule Network and Kalman Filter".Sensors 21.6(2021):1-17.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
_Reading Pictures In（3001KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载