{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/144945"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/144945","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Generalizable Robot Manipulation through Task and Motion Planning and Interactive Perception","abstract":"For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations. In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines.","abstract_html":"For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations. In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines.","abstract_has_math":false,"creators":["Fang, Xiaolin"],"institution":"Massachusetts Institute of Technology","degree_name":"Master","degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science","school":null,"contributors":[],"advisors":["Kaelbling, Leslie Pack","Lozano-Pérez, Tomás"],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-05","date_published":"2022-05","updated_at":"2026-07-22T22:21:48Z","subjects":[],"languages":[],"rights":["In Copyright - Educational Use Permitted","Copyright MIT"],"rights_urls":["http://rightsstatements.org/page/InC-EDU/1.0/"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1721.1/144945","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Kaelbling, Leslie Pack","Lozano-Pérez, Tomás"]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"]},{"key":"dc:creator","label":"Author","values":["Fang, Xiaolin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2022-08-29T16:22:43Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2022-08-29T16:22:43Z"]},{"key":"dc:date.issued","label":"Date","values":["2022-05"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master","Master of Science in Electrical Engineering and Computer Science"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright - Educational Use Permitted","Copyright MIT"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/page/InC-EDU/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1721.1/144945"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations. In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["S.M."]},{"key":"dc:title","label":"Title","values":["Generalizable Robot Manipulation through Task and Motion Planning and Interactive Perception"]}]}],"canonical_facts":{"dc:contributor.advisor":["Kaelbling, Leslie Pack","Lozano-Pérez, Tomás"],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"],"dc:creator":["Fang, Xiaolin"],"dc:date.accessioned":["2022-08-29T16:22:43Z"],"dc:date.available":["2022-08-29T16:22:43Z"],"dc:date.issued":["2022-05"],"dc:description.abstract":["For a robot operating in a daily household environment, generality is of great importance. It should be able to generalize to different tasks that involve different objects in varying backgrounds and configurations. In this thesis, we will move towards this goal from two perspectives. We will first present a strategy for designing a robot manipulation system that can generalize to a wide range of goals, environments, and objects. Such generality is achieved through task and motion planning with affordances estimated by both learned and engineered modules. We demonstrate that this strategy can enable a single policy to perform a wide variety of real-world manipulation tasks. Next, we will present an interactive perception solution to deal with the uncertainty in the estimated affordances, with a focus on the segmentation of objects. We adopt an object-based belief representation to estimate the uncertainty coming from predicted segmentation, and select actions to reduce that efficiently. Our experiments show that our system can generalize better to different environments and reduce uncertainty more efficiently compared to our baselines."],"dc:description.degree":["S.M."],"dc:identifier.uri":["https://hdl.handle.net/1721.1/144945"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["In Copyright - Educational Use Permitted","Copyright MIT"],"dc:rights.uri":["http://rightsstatements.org/page/InC-EDU/1.0/"],"dc:title":["Generalizable Robot Manipulation through Task and Motion Planning and Interactive Perception"],"dc:type":["Thesis"],"thesis:degree_name":["Master","Master of Science in Electrical Engineering and Computer Science"]},"updated_at":"2026-07-22T22:21:48Z"}