{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/132575"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/132575","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Structured model learning for adaptive robot generalists","abstract":"As robots move from factories into homes, hospitals, and warehouses, the grand challenge is to create adaptive robot generalists: systems that can learn diverse manipulation skills, transfer knowledge across tasks and embodiments, and operate robustly under varying sensing conditions. However, robotic manipulation in such unstructured environments requires integrating diverse sensory modalities, long-horizon reasoning, and learning from heterogeneous data sources. Traditional monolithic learning approaches remain brittle, lack modularity, and struggle to generalize across tasks, embodiments, and sensing configurations. This dissertation presents a unified framework based on structured model learning that decomposes the robot learning problem into modular, reusable components. This approach yields policies that generalize across tasks, adapt to new contexts, and operate robustly under diverse conditions. The framework is developed progressively across manipulation challenges of increasing complexity. It begins by integrating learned policies with analytical models for hybrid control in traffic simulation and robotic manipulation. This foundation extends to hierarchical decomposition, where tasks are separated into high-level goals and low-level skills learned from direct physical human guidance. For contact-rich scenarios involving multiple objects, learned dynamics models combined with behavior primitives enable reasoning about object interactions. The framework further separates state prediction (using diffusion models) from action generation (using inverse dynamics models), enabling coordinated bimanual manipulation of deformable objects. Beyond structural decomposition within individual tasks, the framework enables generalization across embodiments and sensing modalities. Tool-centric representations bridge embodiment differences, enabling robots to learn manipulation skills from human videos. For multimodal sensor fusion, the framework uses separate policy experts for vision and touch, coordinated through learned routing that dynamically balances their contributions based on task context. Validated on tasks including contact-rich stowing, occluded object retrieval, in-hand reorientation, and coordinated bimanual manipulation, the results demonstrate that structured model learning provides a scalable foundation for adaptive robot generalists capable of operating effectively in complex real-world environments.","abstract_html":"As robots move from factories into homes, hospitals, and warehouses, the grand challenge is to create adaptive robot generalists: systems that can learn diverse manipulation skills, transfer knowledge across tasks and embodiments, and operate robustly under varying sensing conditions. However, robotic manipulation in such unstructured environments requires integrating diverse sensory modalities, long-horizon reasoning, and learning from heterogeneous data sources. Traditional monolithic learning approaches remain brittle, lack modularity, and struggle to generalize across tasks, embodiments, and sensing configurations. This dissertation presents a unified framework based on structured model learning that decomposes the robot learning problem into modular, reusable components. This approach yields policies that generalize across tasks, adapt to new contexts, and operate robustly under diverse conditions. The framework is developed progressively across manipulation challenges of increasing complexity. It begins by integrating learned policies with analytical models for hybrid control in traffic simulation and robotic manipulation. This foundation extends to hierarchical decomposition, where tasks are separated into high-level goals and low-level skills learned from direct physical human guidance. For contact-rich scenarios involving multiple objects, learned dynamics models combined with behavior primitives enable reasoning about object interactions. The framework further separates state prediction (using diffusion models) from action generation (using inverse dynamics models), enabling coordinated bimanual manipulation of deformable objects. Beyond structural decomposition within individual tasks, the framework enables generalization across embodiments and sensing modalities. Tool-centric representations bridge embodiment differences, enabling robots to learn manipulation skills from human videos. For multimodal sensor fusion, the framework uses separate policy experts for vision and touch, coordinated through learned routing that dynamically balances their contributions based on task context. Validated on tasks including contact-rich stowing, occluded object retrieval, in-hand reorientation, and coordinated bimanual manipulation, the results demonstrate that structured model learning provides a scalable foundation for adaptive robot generalists capable of operating effectively in complex real-world environments.","abstract_has_math":false,"creators":["Chen, Haonan"],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Driggs-Campbell, Katherine","Li, Yunzhu","Amato, Nancy","Schwing, Alexander"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-12","date_published":"2025-12","updated_at":"2026-07-22T22:25:07Z","subjects":["Robotics","Machine Learning","Artificial Intelligence"],"languages":["en"],"rights":["Copyright 2025 Haonan Chen"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/132575","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Driggs-Campbell, Katherine","Li, Yunzhu","Amato, Nancy","Schwing, Alexander"]},{"key":"dc:creator","label":"Author","values":["Chen, Haonan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-12","2025-12-05"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Robotics","Machine Learning","Artificial Intelligence"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Haonan Chen"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/132575"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["As robots move from factories into homes, hospitals, and warehouses, the grand challenge is to create adaptive robot generalists: systems that can learn diverse manipulation skills, transfer knowledge across tasks and embodiments, and operate robustly under varying sensing conditions. However, robotic manipulation in such unstructured environments requires integrating diverse sensory modalities, long-horizon reasoning, and learning from heterogeneous data sources. Traditional monolithic learning approaches remain brittle, lack modularity, and struggle to generalize across tasks, embodiments, and sensing configurations. This dissertation presents a unified framework based on structured model learning that decomposes the robot learning problem into modular, reusable components. This approach yields policies that generalize across tasks, adapt to new contexts, and operate robustly under diverse conditions. The framework is developed progressively across manipulation challenges of increasing complexity. It begins by integrating learned policies with analytical models for hybrid control in traffic simulation and robotic manipulation. This foundation extends to hierarchical decomposition, where tasks are separated into high-level goals and low-level skills learned from direct physical human guidance. For contact-rich scenarios involving multiple objects, learned dynamics models combined with behavior primitives enable reasoning about object interactions. The framework further separates state prediction (using diffusion models) from action generation (using inverse dynamics models), enabling coordinated bimanual manipulation of deformable objects. Beyond structural decomposition within individual tasks, the framework enables generalization across embodiments and sensing modalities. Tool-centric representations bridge embodiment differences, enabling robots to learn manipulation skills from human videos. For multimodal sensor fusion, the framework uses separate policy experts for vision and touch, coordinated through learned routing that dynamically balances their contributions based on task context. Validated on tasks including contact-rich stowing, occluded object retrieval, in-hand reorientation, and coordinated bimanual manipulation, the results demonstrate that structured model learning provides a scalable foundation for adaptive robot generalists capable of operating effectively in complex real-world environments.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2026-02-19 without embargo terms","The student, Haonan Chen, accepted the attached license on 2025-12-04 at 13:31.","The student, Haonan Chen, submitted this Dissertation for approval on 2025-12-04 at 16:19.","This Dissertation was approved for publication on 2025-12-05 at 14:47.","DSpace SAF Submission Ingestion Package generated from Vireo submission #23062 on 2026-02-19 at 18:29:13"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Structured model learning for adaptive robot generalists"]}]}],"canonical_facts":{"dc:contributor":["Driggs-Campbell, Katherine","Li, Yunzhu","Amato, Nancy","Schwing, Alexander"],"dc:creator":["Chen, Haonan"],"dc:date":["2025-12","2025-12-05"],"dc:description":["As robots move from factories into homes, hospitals, and warehouses, the grand challenge is to create adaptive robot generalists: systems that can learn diverse manipulation skills, transfer knowledge across tasks and embodiments, and operate robustly under varying sensing conditions. However, robotic manipulation in such unstructured environments requires integrating diverse sensory modalities, long-horizon reasoning, and learning from heterogeneous data sources. Traditional monolithic learning approaches remain brittle, lack modularity, and struggle to generalize across tasks, embodiments, and sensing configurations. This dissertation presents a unified framework based on structured model learning that decomposes the robot learning problem into modular, reusable components. This approach yields policies that generalize across tasks, adapt to new contexts, and operate robustly under diverse conditions. The framework is developed progressively across manipulation challenges of increasing complexity. It begins by integrating learned policies with analytical models for hybrid control in traffic simulation and robotic manipulation. This foundation extends to hierarchical decomposition, where tasks are separated into high-level goals and low-level skills learned from direct physical human guidance. For contact-rich scenarios involving multiple objects, learned dynamics models combined with behavior primitives enable reasoning about object interactions. The framework further separates state prediction (using diffusion models) from action generation (using inverse dynamics models), enabling coordinated bimanual manipulation of deformable objects. Beyond structural decomposition within individual tasks, the framework enables generalization across embodiments and sensing modalities. Tool-centric representations bridge embodiment differences, enabling robots to learn manipulation skills from human videos. For multimodal sensor fusion, the framework uses separate policy experts for vision and touch, coordinated through learned routing that dynamically balances their contributions based on task context. Validated on tasks including contact-rich stowing, occluded object retrieval, in-hand reorientation, and coordinated bimanual manipulation, the results demonstrate that structured model learning provides a scalable foundation for adaptive robot generalists capable of operating effectively in complex real-world environments.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2026-02-19 without embargo terms","The student, Haonan Chen, accepted the attached license on 2025-12-04 at 13:31.","The student, Haonan Chen, submitted this Dissertation for approval on 2025-12-04 at 16:19.","This Dissertation was approved for publication on 2025-12-05 at 14:47.","DSpace SAF Submission Ingestion Package generated from Vireo submission #23062 on 2026-02-19 at 18:29:13"],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/132575"],"dc:language":["en"],"dc:rights":["Copyright 2025 Haonan Chen"],"dc:subject":["Robotics","Machine Learning","Artificial Intelligence"],"dc:title":["Structured model learning for adaptive robot generalists"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:07Z"}