Intelligent Thermal Control Strategy Based on Reinforcement Learning for Space Telescope

doi:10.2514/1.T5774

CIOMP OpenIR

	Intelligent Thermal Control Strategy Based on Reinforcement Learning for Space Telescope
	Y. Xiong,L. Guo,Y. Huang and L. H. Chen
	2020
发表期刊	Journal of Thermophysics and Heat Transfer
ISSN	0887-8722
卷号	34 期号:1 页码:37-44
摘要	In this study, a thermal model of a space telescope is established in Simulink. An intelligent autonomous thermal control strategy based on actor-critic reinforcement learning (RL) for proportional-integral-derivative (PID) parameter adaptive self-tuning, called RL PID, is proposed. This control strategy enables the PID thermal controller to adaptively tune the PID parameters to achieve stable and precise temperature control. A single radial basis function (RBF) neural network is applied to simultaneously approximate the strategy function of the actor and the value function of the critic. The actor maps the system state to PID parameters, and the critic evaluates the output of the actor and generates a temporal difference (TD) error. Based on the architecture of the actor-critic RL algorithm and the TD error performance index, a design flow chart of RL PID is made. Both theoretical and experimental results show that RL PID can achieve a temperature control precision of 0.01 degrees C, and that the steady-state error is reduced by 50 and 75% in the simulation and 50 and 67% in the experiment compared with those of the traditional PID controller and the traditional switch controller, respectively. RL PID has better reliability, more robustness, and a faster response.
DOI	10.2514/1.T5774
URL	查看原文
收录类别	SCI ; EI
语种	英语
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/64626
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Y. Xiong,L. Guo,Y. Huang and L. H. Chen. Intelligent Thermal Control Strategy Based on Reinforcement Learning for Space Telescope[J]. Journal of Thermophysics and Heat Transfer,2020,34(1):37-44.
APA	Y. Xiong,L. Guo,Y. Huang and L. H. Chen.(2020).Intelligent Thermal Control Strategy Based on Reinforcement Learning for Space Telescope.Journal of Thermophysics and Heat Transfer,34(1),37-44.
MLA	Y. Xiong,L. Guo,Y. Huang and L. H. Chen."Intelligent Thermal Control Strategy Based on Reinforcement Learning for Space Telescope".Journal of Thermophysics and Heat Transfer 34.1(2020):37-44.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Intelligent Thermal （1848KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载