{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/127228"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/127228","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Bridging prediction and planning for human-centered autonomy","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","abstract_has_math":false,"creators":["Huang, Zhe"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Driggs-Campbell, Katherine","Gupta, Saurabh","Amato, Nancy","Mitra, Sayan"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024-11-27","date_published":"2024-11-27","updated_at":"2026-07-22T22:25:03Z","subjects":["Robotics","Artificial Intelligence","Human-robot Interaction"],"languages":["en","eng"],"rights":["Copyright 2024 Zhe Huang"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/127228","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Driggs-Campbell, Katherine","Gupta, Saurabh","Amato, Nancy","Mitra, Sayan"]},{"key":"dc:creator","label":"Author","values":["Huang, Zhe"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2024-11-27","2024-12"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Robotics","Artificial Intelligence","Human-robot Interaction"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2024 Zhe Huang"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/127228"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","The student, Zhe Huang, accepted the attached license on 2024-11-26 at 23:59.","The student, Zhe Huang, submitted this Dissertation for approval on 2024-11-27 at 00:32.","This Dissertation was approved for publication on 2024-11-27 at 13:28.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21406 on 2025-03-28 at 14:26:52","Human-centered autonomy needs to develop a strong understanding of human behavior and use the understanding effectively to accomplish challenging human-involved tasks. This dissertation studies human prediction, robot planning, and integration of both to build human-centered autonomy frameworks, and investigates multiple domains including autonomous driving, social navigation, collaborative manufacturing, and collaborative cooking. This dissertation has three parts of studies which span from human prediction, through integration of prediction and planning, to robot planning across the levels of partially observable intent and fully observable trajectory. In the part of human prediction, I introduce a simultaneous intention estimation and trajectory prediction algorithm by combining particle filtering and recurrent neural networks for modeling pedestrians in autonomous driving applications. I investigate pedestrian attention during crowd motion and observe that an agent pays attention to a limited number of neighbors. I use Gumbel Softmax to learn a sparse interaction graph of agents, which is used to aggregate information from the most important neighbors to make multi-agent trajectory prediction. In the part of integration of prediction and planning, I derive intention tracking on a probabilistic graphical model of intention-evolving human-robot collaboration, and extend the derivation to intention hierarchy. I track human intentions at different levels to switch robot control mode and guide robot task and motion planning in a manufacturing setting. I develop language-driven intention tracking by proposing a language probabilistic graphical model and harnessing large language models and vision language models. I use language-driven intention tracking to build an embodied artificial intelligence agent capable of open world understanding, open human intention tracking, and intention-grounded planning, and demonstrate a robot sous-chef application. In addition, I study how to take human trajectory prediction error into consideration for probabilistically safe crowd navigation. I design interaction-aware conformal prediction algorithm to capture mutual influence between a robot and humans during navigation, by alternating uncertainty-aware model predictive control with calibrated human trajectory prediction error, and decision-dependent conformal prediction with human simulation assuming the robot executes the generated motion plan. In the part of robot planning, I present a motion planning algorithm Neural Informed rapidly-exploring random tree star (NIRRT*) by integrating a point-based neural network for guidance state inference into Informed RRT*. In NIRRT*, the Informed RRT* helps the point-based network focus inference on the region relevant to the planning problem for solution improvement, and the point-based network assists the Informed RRT* to sample critical states in the focused subset for optimal convergence acceleration."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Bridging prediction and planning for human-centered autonomy"]}]}],"canonical_facts":{"dc:contributor":["Driggs-Campbell, Katherine","Gupta, Saurabh","Amato, Nancy","Mitra, Sayan"],"dc:creator":["Huang, Zhe"],"dc:date":["2024-11-27","2024-12"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-03-28 without embargo terms","The student, Zhe Huang, accepted the attached license on 2024-11-26 at 23:59.","The student, Zhe Huang, submitted this Dissertation for approval on 2024-11-27 at 00:32.","This Dissertation was approved for publication on 2024-11-27 at 13:28.","DSpace SAF Submission Ingestion Package generated from Vireo submission #21406 on 2025-03-28 at 14:26:52","Human-centered autonomy needs to develop a strong understanding of human behavior and use the understanding effectively to accomplish challenging human-involved tasks. This dissertation studies human prediction, robot planning, and integration of both to build human-centered autonomy frameworks, and investigates multiple domains including autonomous driving, social navigation, collaborative manufacturing, and collaborative cooking. This dissertation has three parts of studies which span from human prediction, through integration of prediction and planning, to robot planning across the levels of partially observable intent and fully observable trajectory. In the part of human prediction, I introduce a simultaneous intention estimation and trajectory prediction algorithm by combining particle filtering and recurrent neural networks for modeling pedestrians in autonomous driving applications. I investigate pedestrian attention during crowd motion and observe that an agent pays attention to a limited number of neighbors. I use Gumbel Softmax to learn a sparse interaction graph of agents, which is used to aggregate information from the most important neighbors to make multi-agent trajectory prediction. In the part of integration of prediction and planning, I derive intention tracking on a probabilistic graphical model of intention-evolving human-robot collaboration, and extend the derivation to intention hierarchy. I track human intentions at different levels to switch robot control mode and guide robot task and motion planning in a manufacturing setting. I develop language-driven intention tracking by proposing a language probabilistic graphical model and harnessing large language models and vision language models. I use language-driven intention tracking to build an embodied artificial intelligence agent capable of open world understanding, open human intention tracking, and intention-grounded planning, and demonstrate a robot sous-chef application. In addition, I study how to take human trajectory prediction error into consideration for probabilistically safe crowd navigation. I design interaction-aware conformal prediction algorithm to capture mutual influence between a robot and humans during navigation, by alternating uncertainty-aware model predictive control with calibrated human trajectory prediction error, and decision-dependent conformal prediction with human simulation assuming the robot executes the generated motion plan. In the part of robot planning, I present a motion planning algorithm Neural Informed rapidly-exploring random tree star (NIRRT*) by integrating a point-based neural network for guidance state inference into Informed RRT*. In NIRRT*, the Informed RRT* helps the point-based network focus inference on the region relevant to the planning problem for solution improvement, and the point-based network assists the Informed RRT* to sample critical states in the focused subset for optimal convergence acceleration."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/127228"],"dc:language":["en","eng"],"dc:rights":["Copyright 2024 Zhe Huang"],"dc:subject":["Robotics","Artificial Intelligence","Human-robot Interaction"],"dc:title":["Bridging prediction and planning for human-centered autonomy"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:03Z"}