Unmanned aerial vehicles (UAVs) require accurate and robust position tracking in the presence of environmental disturbances. Although outer-loop position control is typically implemented using PID regulators, manual gain tuning is timeconsuming and often leads to suboptimal performance, especially under wind uncertainty and varying operating conditions. In contrast to most existing studies that focus on attitude control adaptation, this paper proposes a reinforcement learning-based adaptive gain tuning approach for position-loop PID control of UAVs without manual intervention. A Deep Deterministic Policy Gradient algorithm is employed and evaluated under two scenarios: nominal conditions without wind and disturbed conditions with wind uncertainty. Simulation results demonstrate that the learned gains consistently outperform hand-tuned PID controllers in terms of trajectory tracking accuracy and transient response. In addition, three different approaches are investigated to further validate the effectiveness and robustness of the proposed framework.

Adaptive Position-Loop PID Gain Tuning for UAVs Using Deep Reinforcement Learning / Liu, R., Salcuni, A., Hu, S., Mangini, A.M., Fanti, M.P., Li, Z.. - (2026), pp. 3050-3055. (22nd IEEE International Conference on Automation Science and Engineering, CASE 2026 chn 2026) [10.1109/CASE69030.2026.11704281].

Adaptive Position-Loop PID Gain Tuning for UAVs Using Deep Reinforcement Learning

Liu R.;Salcuni A.;Hu S.;Mangini A. M.;Fanti M. P.;
2026

Abstract

Unmanned aerial vehicles (UAVs) require accurate and robust position tracking in the presence of environmental disturbances. Although outer-loop position control is typically implemented using PID regulators, manual gain tuning is timeconsuming and often leads to suboptimal performance, especially under wind uncertainty and varying operating conditions. In contrast to most existing studies that focus on attitude control adaptation, this paper proposes a reinforcement learning-based adaptive gain tuning approach for position-loop PID control of UAVs without manual intervention. A Deep Deterministic Policy Gradient algorithm is employed and evaluated under two scenarios: nominal conditions without wind and disturbed conditions with wind uncertainty. Simulation results demonstrate that the learned gains consistently outperform hand-tuned PID controllers in terms of trajectory tracking accuracy and transient response. In addition, three different approaches are investigated to further validate the effectiveness and robustness of the proposed framework.
2026
22nd IEEE International Conference on Automation Science and Engineering, CASE 2026
Adaptive Position-Loop PID Gain Tuning for UAVs Using Deep Reinforcement Learning / Liu, R., Salcuni, A., Hu, S., Mangini, A.M., Fanti, M.P., Li, Z.. - (2026), pp. 3050-3055. (22nd IEEE International Conference on Automation Science and Engineering, CASE 2026 chn 2026) [10.1109/CASE69030.2026.11704281].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11589/309762
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex 0
social impact