A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space

doi:10.1109/ACCESS.2023.3320137

CIOMP OpenIR

	A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space
	Y. Gao; Y. Wang; L. Zhang; L. Guo; J. Li and S. Sun
	2023
发表期刊	IEEE Access
ISSN	21693536
卷号	11 页码:107669-107684
摘要	It is the key research object of electronic warfare to use UAV (Unmanned Aerial Vehicle) clusters to carry out electronic countermeasure tasks. The UAV carries loads such as reconnaissance and interference at the same time, which makes it necessary to simultaneously decide multiple types of actions - namely, compound actions - which poses a challenge to intelligent decision-making algorithms. Considering the problem of action-space dimensional complexity and weak collaboration between decisions in multi-agent scenarios with composite actions, this study proposed a decision algorithm involving a multi-agent reinforcement-learning sequence, which combined joint composite actions into sequential decision, reducing the difficulty of a single decision and enhancing the collaboration between various agents and their individual decisions. Because long decision sequences required better depth modeling and had high variance, a DeLighT module was added to the naïve transformer model to increase the depth and baseline techniques, which were used to reduce the variance in the value estimation. The simulated results verified the effectiveness of the proposed algorithm in the UAV cooperative combat scenario, where each agent had a composite action space and showed better performance than the existing algorithms. © 2013 IEEE.
DOI	10.1109/ACCESS.2023.3320137
URL	查看原文
收录类别	sci ; ei
引用统计	被引频次：1[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/67478
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Y. Gao,Y. Wang,L. Zhang,et al. A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space[J]. IEEE Access,2023,11:107669-107684.
APA	Y. Gao,Y. Wang,L. Zhang,L. Guo,&J. Li and S. Sun.(2023).A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space.IEEE Access,11,107669-107684.
MLA	Y. Gao,et al."A Sequential Decision Algorithm of Reinforcement Learning for Composite Action Space".IEEE Access 11(2023):107669-107684.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
A Sequential Decisio（3947KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载