{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/120369"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/120369","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Realtime state estimation for contact manipulation","abstract":"In this thesis, we develop a real-time state estimation system to recover the pose and contact state of an object relative to its environment. The capability to make such estimations is important for a controller to adequately react to uncertainties in a manipulation task. We propose a framework that combines tactile and visual sensing to improve the accuracy and robustness. Visual sensing is versatile and non-intrusive but suffers from occlusions and limited accuracy, especially with regard to tasks involving contact. Tactile sensing (including contact and force) is local but provides accuracy and robustness to occlusions. The framework uses online estimation techniques to fuse kinematic measurements made by a robot, contact geometry of the object and the environment, and visual measurements. In a complex contact task such as insertion, the contact formations are hard to resolve directly. We propose a data-driven method to assess the contact formation, which is then used in real time by the state estimator. We apply our framework to two iconic tasks in robotic manipulation: planar pushing and object insertion. We evaluate the algorithm in a setup instrumented to provide ground truth. The experiments show that our approach provides an accurate and robust estimation for the studied manipulation tasks.","abstract_html":"In this thesis, we develop a real-time state estimation system to recover the pose and contact state of an object relative to its environment. The capability to make such estimations is important for a controller to adequately react to uncertainties in a manipulation task. We propose a framework that combines tactile and visual sensing to improve the accuracy and robustness. Visual sensing is versatile and non-intrusive but suffers from occlusions and limited accuracy, especially with regard to tasks involving contact. Tactile sensing (including contact and force) is local but provides accuracy and robustness to occlusions. The framework uses online estimation techniques to fuse kinematic measurements made by a robot, contact geometry of the object and the environment, and visual measurements. In a complex contact task such as insertion, the contact formations are hard to resolve directly. We propose a data-driven method to assess the contact formation, which is then used in real time by the state estimator. We apply our framework to two iconic tasks in robotic manipulation: planar pushing and object insertion. We evaluate the algorithm in a setup instrumented to provide ground truth. The experiments show that our approach provides an accurate and robust estimation for the studied manipulation tasks.","abstract_has_math":false,"creators":["Yu, Kuan-Ting, Ph. D. Massachusetts Institute of Technology"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.","school":null,"contributors":[],"advisors":["Alberto Rodriguez."],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018","date_published":"2018","updated_at":"2026-07-22T22:21:22Z","subjects":["Electrical Engineering and Computer Science."],"languages":["eng"],"rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/120369","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Alberto Rodriguez."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:creator","label":"Author","values":["Yu, Kuan-Ting, Ph. D. Massachusetts Institute of Technology"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2019-02-14T15:21:53Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2019-02-14T15:21:53Z"]},{"key":"dc:date.issued","label":"Date","values":["2018"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical Engineering and Computer Science."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1721.1/120369"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 133-140)."]},{"key":"dc:description.abstract","label":"Abstract","values":["In this thesis, we develop a real-time state estimation system to recover the pose and contact state of an object relative to its environment. The capability to make such estimations is important for a controller to adequately react to uncertainties in a manipulation task. We propose a framework that combines tactile and visual sensing to improve the accuracy and robustness. Visual sensing is versatile and non-intrusive but suffers from occlusions and limited accuracy, especially with regard to tasks involving contact. Tactile sensing (including contact and force) is local but provides accuracy and robustness to occlusions. The framework uses online estimation techniques to fuse kinematic measurements made by a robot, contact geometry of the object and the environment, and visual measurements. In a complex contact task such as insertion, the contact formations are hard to resolve directly. We propose a data-driven method to assess the contact formation, which is then used in real time by the state estimator. We apply our framework to two iconic tasks in robotic manipulation: planar pushing and object insertion. We evaluate the algorithm in a setup instrumented to provide ground truth. The experiments show that our approach provides an accurate and robust estimation for the studied manipulation tasks."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph. D."]},{"key":"dc:title","label":"Title","values":["Realtime state estimation for contact manipulation"]}]}],"canonical_facts":{"dc:contributor.advisor":["Alberto Rodriguez."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:contributor.other":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:creator":["Yu, Kuan-Ting, Ph. D. Massachusetts Institute of Technology"],"dc:date.accessioned":["2019-02-14T15:21:53Z"],"dc:date.available":["2019-02-14T15:21:53Z"],"dc:date.issued":["2018"],"dc:description":["Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 133-140)."],"dc:description.abstract":["In this thesis, we develop a real-time state estimation system to recover the pose and contact state of an object relative to its environment. The capability to make such estimations is important for a controller to adequately react to uncertainties in a manipulation task. We propose a framework that combines tactile and visual sensing to improve the accuracy and robustness. Visual sensing is versatile and non-intrusive but suffers from occlusions and limited accuracy, especially with regard to tasks involving contact. Tactile sensing (including contact and force) is local but provides accuracy and robustness to occlusions. The framework uses online estimation techniques to fuse kinematic measurements made by a robot, contact geometry of the object and the environment, and visual measurements. In a complex contact task such as insertion, the contact formations are hard to resolve directly. We propose a data-driven method to assess the contact formation, which is then used in real time by the state estimator. We apply our framework to two iconic tasks in robotic manipulation: planar pushing and object insertion. We evaluate the algorithm in a setup instrumented to provide ground truth. The experiments show that our approach provides an accurate and robust estimation for the studied manipulation tasks."],"dc:description.degree":["Ph. D."],"dc:identifier.uri":["http://hdl.handle.net/1721.1/120369"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Electrical Engineering and Computer Science."],"dc:title":["Realtime state estimation for contact manipulation"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:21:22Z"}