TY - GEN
T1 - A Meta-reinforcement Learning Framework for Adaptive Quadrotor UAV Attitude Control
AU - Zhao, Kaidong
AU - Li, Yanjie
AU - Liu, Zihan
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2025.
PY - 2025
Y1 - 2025
N2 - This paper presents a meta-reinforcement learning approach for quadrotor UAV attitude control, addressing the limitations of traditional control methods in complex, dynamic, and uncertain environments. Our method integrates the advantages of context learning, Gaussian sampling, and multi-task training to rapidly adapt to diverse aircraft parameters and environmental conditions. Specifically, we utilize historical information quadruples as contextual data to accurately estimate current task characteristics through real-time observation and learning. In the latent space, we employ Gaussian sampling to effectively handle unknown UAV parameters. To validate the method’s efficacy, we conducted a series of experiments in the Bullet simulator, including single attitude tracking, resultant acceleration control, and continuous trajectory tracking. Experimental results demonstrate that our approach significantly outperforms traditional PID controllers and domain randomization-based SAC methods in terms of stability, rapid response, and trajectory tracking precision. Through multi-task training, our controller has developed the ability to swiftly adapt to novel situations. This research provides a robust and flexible solution for adaptive control of quadrotor UAVs, showing promise for more efficient and stable flight control in complex and dynamically changing environments.
AB - This paper presents a meta-reinforcement learning approach for quadrotor UAV attitude control, addressing the limitations of traditional control methods in complex, dynamic, and uncertain environments. Our method integrates the advantages of context learning, Gaussian sampling, and multi-task training to rapidly adapt to diverse aircraft parameters and environmental conditions. Specifically, we utilize historical information quadruples as contextual data to accurately estimate current task characteristics through real-time observation and learning. In the latent space, we employ Gaussian sampling to effectively handle unknown UAV parameters. To validate the method’s efficacy, we conducted a series of experiments in the Bullet simulator, including single attitude tracking, resultant acceleration control, and continuous trajectory tracking. Experimental results demonstrate that our approach significantly outperforms traditional PID controllers and domain randomization-based SAC methods in terms of stability, rapid response, and trajectory tracking precision. Through multi-task training, our controller has developed the ability to swiftly adapt to novel situations. This research provides a robust and flexible solution for adaptive control of quadrotor UAVs, showing promise for more efficient and stable flight control in complex and dynamically changing environments.
KW - Meta-reinforcement learning
KW - adaptive control
KW - attitude control
KW - quadrotor UAV
UR - https://www.scopus.com/pages/publications/105002727356
U2 - 10.1007/978-981-96-4207-6_3
DO - 10.1007/978-981-96-4207-6_3
M3 - 会议稿件
AN - SCOPUS:105002727356
SN - 9789819642069
T3 - Lecture Notes in Computer Science
SP - 26
EP - 40
BT - Parallel and Distributed Computing, Applications and Technologies - 25th International Conference, PDCAT 2024, Proceedings
A2 - Li, Yupeng
A2 - Xu, Jianliang
A2 - Zhang, Yong
PB - Springer Science and Business Media Deutschland GmbH
T2 - 25th International Conference on Parallel and Distributed Computing, Applications and Technologies, PDCAT 2024
Y2 - 13 December 2024 through 15 December 2024
ER -