Satellite Reorientation Using Reinforcement Learning Under Unknown Attitude Failure

<p>This study presents a reinforcement learning (RL) approach for reestablishing communication with deep-space satellites under unknown attitude determination and control system (ADCS) failures. When traditional fault-tolerant control methods cannot restore signal, the proposed RL controller acts as a last-resort measure by autonomously reorienting the satellite’s antenna toward Earth while charging the battery via solar panels. A generic reward function, designed for the RL-based method, enables the controller to adapt to diverse failure scenarios, including severe actuator noise, misalignment, and complete actuator failure. Simulations are conducted in the <em>Basilisk</em> environment and trained with the <em>tonic</em> framework and demonstrate ranging capabilities of the RL-based method across a wide range of ADCS failure modes. The controller not only learned two distinct tasks—antenna pointing and solar charging, but also learned how to point the antenna and maintain battery life in a single control scheme. The proposed method showed great success in noisy, misaligned, and underactuated cases and more notably, this approach obviates the need for prior knowledge of fault conditions or disturbance bounds. Future work will explore online RL algorithms for enhanced real-time adaptability and include hardware-in-the-loop simulations to further validate the method’s viability for deep-space missions.</p>

Name thesis:degree_name

Master of Aerospace Engineering

Level thesis:degree_level

Thesis - Open Access

Discipline thesis:degree_discipline

Aerospace Engineering

Year

2025

Author dc:creator

• Willoughby, Matthew

• Satellite attitude control systems
• Fault-tolerant control
• Robust control
• Adaptive control
• Autonomous systems
• Fault recovery
• Safe‑mode control
• Machine learning
• Reinforcement learning
• Deep deterministic policy gradient
• Artificial Intelligence and Robotics
• Astrodynamics
• Navigation, Guidance, Control and Dynamics

Repository record dc:identifier

https://commons.erau.edu/edt/901

OAI identifier oai:identifier

oai:commons.erau.edu:edt-1940