{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/152662"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/152662","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Towards Reinforcement-Learning-based Robot Navigation with 3D Scene Graphs","abstract":"Applying Reinforcement Learning (RL) for autonomous navigation has enormous potential in several robotics applications, including search and rescue operations. RL circumvents the need to manually specify a control policy for navigation and allows capturing aspects that are difficult to describe without relying on learning, e.g., that survivors or objects of interest are more likely to be found in specific regions of the environment. This is relevant for navigation policies guiding autonomous exploration and object search. To improve the performance of RL models guiding autonomous agents, we use 3D Scene Graphs (3DSGs) as a map representation. Previous work has shown that RL policies based on offline 3DSGs produce promising results in simulation, and this work takes initial steps towards extending these findings to 3DSGs produced online by Hydra, a new spatial perception system that builds 3DSGs in real-time. The work also provides an initial integration of the RL policies previously trained and evaluated in simulation [1] on a Unitree A1 quadruped robot. While the results are too preliminary to be conclusive, the thesis takes several integration steps towards deploying scene-graph-based RL policies for navigation on real robots.","abstract_html":"Applying Reinforcement Learning (RL) for autonomous navigation has enormous potential in several robotics applications, including search and rescue operations. RL circumvents the need to manually specify a control policy for navigation and allows capturing aspects that are difficult to describe without relying on learning, e.g., that survivors or objects of interest are more likely to be found in specific regions of the environment. This is relevant for navigation policies guiding autonomous exploration and object search. To improve the performance of RL models guiding autonomous agents, we use 3D Scene Graphs (3DSGs) as a map representation. Previous work has shown that RL policies based on offline 3DSGs produce promising results in simulation, and this work takes initial steps towards extending these findings to 3DSGs produced online by Hydra, a new spatial perception system that builds 3DSGs in real-time. The work also provides an initial integration of the RL policies previously trained and evaluated in simulation [1] on a Unitree A1 quadruped robot. While the results are too preliminary to be conclusive, the thesis takes several integration steps towards deploying scene-graph-based RL policies for navigation on real robots.","abstract_has_math":false,"creators":["Muriga, Veronica"],"institution":"Massachusetts Institute of Technology","degree_name":"Master","degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science","school":null,"contributors":[],"advisors":["Carlone, Luca"],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-09","date_published":"2023-09","updated_at":"2026-07-22T22:22:02Z","subjects":[],"languages":[],"rights":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"],"rights_urls":["https://rightsstatements.org/page/InC-EDU/1.0/"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1721.1/152662","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Carlone, Luca"]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"]},{"key":"dc:creator","label":"Author","values":["Muriga, Veronica"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2023-11-02T20:06:42Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2023-11-02T20:06:42Z"]},{"key":"dc:date.issued","label":"Date","values":["2023-09"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master","Master of Engineering in Electrical Engineering and Computer Science"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"]},{"key":"dc:rights.uri","label":"Rights URI","values":["https://rightsstatements.org/page/InC-EDU/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1721.1/152662"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Applying Reinforcement Learning (RL) for autonomous navigation has enormous potential in several robotics applications, including search and rescue operations. RL circumvents the need to manually specify a control policy for navigation and allows capturing aspects that are difficult to describe without relying on learning, e.g., that survivors or objects of interest are more likely to be found in specific regions of the environment. This is relevant for navigation policies guiding autonomous exploration and object search. To improve the performance of RL models guiding autonomous agents, we use 3D Scene Graphs (3DSGs) as a map representation. Previous work has shown that RL policies based on offline 3DSGs produce promising results in simulation, and this work takes initial steps towards extending these findings to 3DSGs produced online by Hydra, a new spatial perception system that builds 3DSGs in real-time. The work also provides an initial integration of the RL policies previously trained and evaluated in simulation [1] on a Unitree A1 quadruped robot. While the results are too preliminary to be conclusive, the thesis takes several integration steps towards deploying scene-graph-based RL policies for navigation on real robots."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M.Eng."]},{"key":"dc:title","label":"Title","values":["Towards Reinforcement-Learning-based Robot Navigation with 3D Scene Graphs"]}]}],"canonical_facts":{"dc:contributor.advisor":["Carlone, Luca"],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"],"dc:creator":["Muriga, Veronica"],"dc:date.accessioned":["2023-11-02T20:06:42Z"],"dc:date.available":["2023-11-02T20:06:42Z"],"dc:date.issued":["2023-09"],"dc:description.abstract":["Applying Reinforcement Learning (RL) for autonomous navigation has enormous potential in several robotics applications, including search and rescue operations. RL circumvents the need to manually specify a control policy for navigation and allows capturing aspects that are difficult to describe without relying on learning, e.g., that survivors or objects of interest are more likely to be found in specific regions of the environment. This is relevant for navigation policies guiding autonomous exploration and object search. To improve the performance of RL models guiding autonomous agents, we use 3D Scene Graphs (3DSGs) as a map representation. Previous work has shown that RL policies based on offline 3DSGs produce promising results in simulation, and this work takes initial steps towards extending these findings to 3DSGs produced online by Hydra, a new spatial perception system that builds 3DSGs in real-time. The work also provides an initial integration of the RL policies previously trained and evaluated in simulation [1] on a Unitree A1 quadruped robot. While the results are too preliminary to be conclusive, the thesis takes several integration steps towards deploying scene-graph-based RL policies for navigation on real robots."],"dc:description.degree":["M.Eng."],"dc:identifier.uri":["https://hdl.handle.net/1721.1/152662"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"],"dc:rights.uri":["https://rightsstatements.org/page/InC-EDU/1.0/"],"dc:title":["Towards Reinforcement-Learning-based Robot Navigation with 3D Scene Graphs"],"dc:type":["Thesis"],"thesis:degree_name":["Master","Master of Engineering in Electrical Engineering and Computer Science"]},"updated_at":"2026-07-22T22:22:02Z"}