{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/132764"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/132764","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Safe and adaptive reinforcement learning for robotics applications","abstract":"In recent years, learning-based control methods, especially those leveraging the power of reinforcement learning (RL) and deep learning, have demonstrated impressive performance in complex robotics control tasks. However, they often suffer from the lack of safety and robustness guarantees, which makes it challenging to apply them to safety-critical systems in dynamical environments involving various uncertainties and disturbances. This Ph.D. thesis aims to integrate control-theoretical methods to develop learning-based control architectures with enhanced robustness and stability guarantees and validate their efficiency through real-world robotics applications. First, it introduces a method to rapidly adapt RL policies in the presence of environmental perturbations via L1 adaptive control, which acts as an add-on module to directly estimate and cancel the uncertainties (within the bandwidth of the control channel) induced by the environmental perturbations. Second, we design a safe and efficient RL algorithm using disturbance estimator-based control barrier functions (CBF), which can be used as a safety filter for any model-free RL method. Unlike most existing safe RL methods that address model uncertainty through model learning which requires the collection of enough data to achieve good performance, our method leverages disturbance estimators to accurately estimate the value of uncertainty from the beginning, which is then incorporated into a robust CBF condition to generate safe actions. Finally, we present a comprehensive safe and adaptive learning-based control framework for reinforcement learning, referred to as SARL (Safe and Adaptive Reinforcement Learning), which enables RL-controlled robotic systems to operate safely and effectively in uncertain environments. This framework provides an add-on control architecture that can adapt RL policies to a perturbed environment to improve the control performance while avoiding safety violations. To experimentally validate SARL’s efficacy, we apply it to autonomous and precise drone landing on moving platforms with significant disturbances and unmodeled dynamics.","abstract_html":"In recent years, learning-based control methods, especially those leveraging the power of reinforcement learning (RL) and deep learning, have demonstrated impressive performance in complex robotics control tasks. However, they often suffer from the lack of safety and robustness guarantees, which makes it challenging to apply them to safety-critical systems in dynamical environments involving various uncertainties and disturbances. This Ph.D. thesis aims to integrate control-theoretical methods to develop learning-based control architectures with enhanced robustness and stability guarantees and validate their efficiency through real-world robotics applications. First, it introduces a method to rapidly adapt RL policies in the presence of environmental perturbations via L1 adaptive control, which acts as an add-on module to directly estimate and cancel the uncertainties (within the bandwidth of the control channel) induced by the environmental perturbations. Second, we design a safe and efficient RL algorithm using disturbance estimator-based control barrier functions (CBF), which can be used as a safety filter for any model-free RL method. Unlike most existing safe RL methods that address model uncertainty through model learning which requires the collection of enough data to achieve good performance, our method leverages disturbance estimators to accurately estimate the value of uncertainty from the beginning, which is then incorporated into a robust CBF condition to generate safe actions. Finally, we present a comprehensive safe and adaptive learning-based control framework for reinforcement learning, referred to as SARL (Safe and Adaptive Reinforcement Learning), which enables RL-controlled robotic systems to operate safely and effectively in uncertain environments. This framework provides an add-on control architecture that can adapt RL policies to a perturbed environment to improve the control performance while avoiding safety violations. To experimentally validate SARL’s efficacy, we apply it to autonomous and precise drone landing on moving platforms with significant disturbances and unmodeled dynamics.","abstract_has_math":false,"creators":["Cheng, Yikun"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Mechanical Engineering","degree_department":null,"school":null,"contributors":["Hovakimyan, Naira","Salapaka, Srinivasa M","Stipanovic, Dusan M","Zhao, Pan"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-12","date_published":"2025-12","updated_at":"2026-07-22T22:25:07Z","subjects":["Adaptive Control, Safe Reinforcement Learning, Control Barrier Function, Barrier Funciton"],"languages":["en"],"rights":["Copyright 2025 Yikun Cheng"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/132764","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Hovakimyan, Naira","Salapaka, Srinivasa M","Stipanovic, Dusan M","Zhao, Pan"]},{"key":"dc:creator","label":"Author","values":["Cheng, Yikun"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-12","2025-11-21"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Mechanical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Adaptive Control, Safe Reinforcement Learning, Control Barrier Function, Barrier Funciton"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Yikun Cheng"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/132764"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["In recent years, learning-based control methods, especially those leveraging the power of reinforcement learning (RL) and deep learning, have demonstrated impressive performance in complex robotics control tasks. However, they often suffer from the lack of safety and robustness guarantees, which makes it challenging to apply them to safety-critical systems in dynamical environments involving various uncertainties and disturbances. This Ph.D. thesis aims to integrate control-theoretical methods to develop learning-based control architectures with enhanced robustness and stability guarantees and validate their efficiency through real-world robotics applications. First, it introduces a method to rapidly adapt RL policies in the presence of environmental perturbations via L1 adaptive control, which acts as an add-on module to directly estimate and cancel the uncertainties (within the bandwidth of the control channel) induced by the environmental perturbations. Second, we design a safe and efficient RL algorithm using disturbance estimator-based control barrier functions (CBF), which can be used as a safety filter for any model-free RL method. Unlike most existing safe RL methods that address model uncertainty through model learning which requires the collection of enough data to achieve good performance, our method leverages disturbance estimators to accurately estimate the value of uncertainty from the beginning, which is then incorporated into a robust CBF condition to generate safe actions. Finally, we present a comprehensive safe and adaptive learning-based control framework for reinforcement learning, referred to as SARL (Safe and Adaptive Reinforcement Learning), which enables RL-controlled robotic systems to operate safely and effectively in uncertain environments. This framework provides an add-on control architecture that can adapt RL policies to a perturbed environment to improve the control performance while avoiding safety violations. To experimentally validate SARL’s efficacy, we apply it to autonomous and precise drone landing on moving platforms with significant disturbances and unmodeled dynamics.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2027-12-01","The student, Yikun Cheng, accepted the attached license on 2025-11-19 at 09:25.","The student, Yikun Cheng, submitted this Dissertation for approval on 2025-11-19 at 09:33.","This Dissertation was approved for publication on 2025-11-21 at 18:39.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22895 on 2026-02-19 at 20:08:50"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Safe and adaptive reinforcement learning for robotics applications"]}]}],"canonical_facts":{"dc:contributor":["Hovakimyan, Naira","Salapaka, Srinivasa M","Stipanovic, Dusan M","Zhao, Pan"],"dc:creator":["Cheng, Yikun"],"dc:date":["2025-12","2025-11-21"],"dc:description":["In recent years, learning-based control methods, especially those leveraging the power of reinforcement learning (RL) and deep learning, have demonstrated impressive performance in complex robotics control tasks. However, they often suffer from the lack of safety and robustness guarantees, which makes it challenging to apply them to safety-critical systems in dynamical environments involving various uncertainties and disturbances. This Ph.D. thesis aims to integrate control-theoretical methods to develop learning-based control architectures with enhanced robustness and stability guarantees and validate their efficiency through real-world robotics applications. First, it introduces a method to rapidly adapt RL policies in the presence of environmental perturbations via L1 adaptive control, which acts as an add-on module to directly estimate and cancel the uncertainties (within the bandwidth of the control channel) induced by the environmental perturbations. Second, we design a safe and efficient RL algorithm using disturbance estimator-based control barrier functions (CBF), which can be used as a safety filter for any model-free RL method. Unlike most existing safe RL methods that address model uncertainty through model learning which requires the collection of enough data to achieve good performance, our method leverages disturbance estimators to accurately estimate the value of uncertainty from the beginning, which is then incorporated into a robust CBF condition to generate safe actions. Finally, we present a comprehensive safe and adaptive learning-based control framework for reinforcement learning, referred to as SARL (Safe and Adaptive Reinforcement Learning), which enables RL-controlled robotic systems to operate safely and effectively in uncertain environments. This framework provides an add-on control architecture that can adapt RL policies to a perturbed environment to improve the control performance while avoiding safety violations. To experimentally validate SARL’s efficacy, we apply it to autonomous and precise drone landing on moving platforms with significant disturbances and unmodeled dynamics.","Submission published under a 24 month embargo labeled 'Closed Access', the embargo will last until 2027-12-01","The student, Yikun Cheng, accepted the attached license on 2025-11-19 at 09:25.","The student, Yikun Cheng, submitted this Dissertation for approval on 2025-11-19 at 09:33.","This Dissertation was approved for publication on 2025-11-21 at 18:39.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22895 on 2026-02-19 at 20:08:50"],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/132764"],"dc:language":["en"],"dc:rights":["Copyright 2025 Yikun Cheng"],"dc:subject":["Adaptive Control, Safe Reinforcement Learning, Control Barrier Function, Barrier Funciton"],"dc:title":["Safe and adaptive reinforcement learning for robotics applications"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Mechanical Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:07Z"}