{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/129943"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/129943","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Representing and manipulating deformable linear objects","abstract":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_html":"Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","abstract_has_math":false,"creators":["Dinkel, Holly M."],"institution":"University of Illinois Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Aerospace Engineering","degree_department":null,"school":null,"contributors":["Bretl, Timothy","Coltin, Brian","Smith, Trey","Amato, Nancy","Tran, Huy","Yim, Justin"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-07-18","date_published":"2025-07-18","updated_at":"2026-07-22T22:25:06Z","subjects":["Robotics","Computer Vision","Robotic Perception","Perception","Robotic Manipulation","Manipulation","Object Detection","Deformable Objects","Deformable Object Detection","Object Tracking","Tracking","Deformable Object Tracking","Manipulating Deformable Objects","Prediction","Trajectory Prediction"],"languages":["en","eng"],"rights":["Copyright 2025 Holly M. Dinkel"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/129943","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Bretl, Timothy","Coltin, Brian","Smith, Trey","Amato, Nancy","Tran, Huy","Yim, Justin"]},{"key":"dc:creator","label":"Author","values":["Dinkel, Holly M."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-07-18","2025-08"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Aerospace Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Robotics","Computer Vision","Robotic Perception","Perception","Robotic Manipulation","Manipulation","Object Detection","Deformable Objects","Deformable Object Detection","Object Tracking","Tracking","Deformable Object Tracking","Manipulating Deformable Objects","Prediction","Trajectory Prediction"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2025 Holly M. Dinkel"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/129943"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Holly Dinkel, accepted the attached license on 2025-07-14 at 15:34.","The student, Holly Dinkel, submitted this Dissertation for approval on 2025-07-14 at 19:59.","This Dissertation was approved for publication on 2025-07-18 at 09:51.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22557 on 2025-10-20 at 20:15:14","This dissertation presents innovations in three areas necessary for robots interacting with Deformable Linear Objects (DLOs): detection, tracking, and manipulation. These skills are essential in tasks such as surgical suturing and cable management in engineering systems. Unlike rigid bodies with fixed geometry and well-studied dynamics, DLOs undergo continuous deformation; have many degrees of freedom; have difficult-to-measure material properties; and frequently experience self-occlusions, self-collisions, environmental occlusions, and environmental collisions. The complex visual and physics characteristics of DLOs complicate their modeling and control. This work distinguishes itself by presenting integrated end-to-end systems for perceiving and manipulating DLOs using cameras and robots, while much of the related work relies on methods developed or validated in simulators. Although this work does not solve the full complexity of suturing or cable management, it tackles fundamental perception and manipulation challenges that arise in these demanding applications, using real robot hardware to make progress toward more capable DLO autonomy. Detecting - COCOpen is an image dataset for instance segmentation of scenes containing both rigid objects and Ethernet cables. It features an augmentation approach that grounds synthetic images in a real world context by automatically labeling wire images that classic computer vision techniques can annotate reliably and combining them with varied background scenes. This strategy provides scalable training data for training Ethernet cable detectors at low acquisition and annotation cost. Tracking - MultiDLO is a real-time algorithm for simultaneously estimating the 3D shapes of multiple entangling DLOs from RGB-D videos, which had previously never been done. It initializes by applying instance segmentation on the first frame, then requires only background segmentation for the remainder of the sequence. TrackDLO is a real-time algorithm for estimating the 3D shape of a single DLO from RGB-D videos during challenging occlusion scenarios: tip occlusion, mid-section occlusion, and self-occlusion. It is the first method to achieve accurate tracking without privileged input from fiducial markers, physics-based simulation, or robot trajectories. DLO-Splatting is an algorithm for estimating the 3D shape of a single DLO from RGB-D videos and a gripper state for tracking DLO states through self-collisions. Manipulating - KnotDLO is a method for one-handed knot tying that is repeatable for varying rope initial planar configurations and requires no human demonstrations or training. Grasp and target waypoints for future DLO states are planned from the current DLO shape. GraphDLO is a method for direct trajectory prediction of a rope that computes the directory only from the current rope state and a planned gripper action sequence. It also includes the first large-scale, real-world labeled rope interaction dataset, collected autonomously over 300 hours using a cloud robotics platform. All code and data for COCOpen, MultiDLO, TrackDLO, DLO-Splatting, KnotDLO, and GraphDLO is publicly available to support future benchmarking in detection, tracking, and manipulation of DLOs. This work helps robots see, follow, and use DLOs, moving toward using them as tools for transforming the world."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Representing and manipulating deformable linear objects"]}]}],"canonical_facts":{"dc:contributor":["Bretl, Timothy","Coltin, Brian","Smith, Trey","Amato, Nancy","Tran, Huy","Yim, Justin"],"dc:creator":["Dinkel, Holly M."],"dc:date":["2025-07-18","2025-08"],"dc:description":["Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2025-10-20 without embargo terms","The student, Holly Dinkel, accepted the attached license on 2025-07-14 at 15:34.","The student, Holly Dinkel, submitted this Dissertation for approval on 2025-07-14 at 19:59.","This Dissertation was approved for publication on 2025-07-18 at 09:51.","DSpace SAF Submission Ingestion Package generated from Vireo submission #22557 on 2025-10-20 at 20:15:14","This dissertation presents innovations in three areas necessary for robots interacting with Deformable Linear Objects (DLOs): detection, tracking, and manipulation. These skills are essential in tasks such as surgical suturing and cable management in engineering systems. Unlike rigid bodies with fixed geometry and well-studied dynamics, DLOs undergo continuous deformation; have many degrees of freedom; have difficult-to-measure material properties; and frequently experience self-occlusions, self-collisions, environmental occlusions, and environmental collisions. The complex visual and physics characteristics of DLOs complicate their modeling and control. This work distinguishes itself by presenting integrated end-to-end systems for perceiving and manipulating DLOs using cameras and robots, while much of the related work relies on methods developed or validated in simulators. Although this work does not solve the full complexity of suturing or cable management, it tackles fundamental perception and manipulation challenges that arise in these demanding applications, using real robot hardware to make progress toward more capable DLO autonomy. Detecting - COCOpen is an image dataset for instance segmentation of scenes containing both rigid objects and Ethernet cables. It features an augmentation approach that grounds synthetic images in a real world context by automatically labeling wire images that classic computer vision techniques can annotate reliably and combining them with varied background scenes. This strategy provides scalable training data for training Ethernet cable detectors at low acquisition and annotation cost. Tracking - MultiDLO is a real-time algorithm for simultaneously estimating the 3D shapes of multiple entangling DLOs from RGB-D videos, which had previously never been done. It initializes by applying instance segmentation on the first frame, then requires only background segmentation for the remainder of the sequence. TrackDLO is a real-time algorithm for estimating the 3D shape of a single DLO from RGB-D videos during challenging occlusion scenarios: tip occlusion, mid-section occlusion, and self-occlusion. It is the first method to achieve accurate tracking without privileged input from fiducial markers, physics-based simulation, or robot trajectories. DLO-Splatting is an algorithm for estimating the 3D shape of a single DLO from RGB-D videos and a gripper state for tracking DLO states through self-collisions. Manipulating - KnotDLO is a method for one-handed knot tying that is repeatable for varying rope initial planar configurations and requires no human demonstrations or training. Grasp and target waypoints for future DLO states are planned from the current DLO shape. GraphDLO is a method for direct trajectory prediction of a rope that computes the directory only from the current rope state and a planned gripper action sequence. It also includes the first large-scale, real-world labeled rope interaction dataset, collected autonomously over 300 hours using a cloud robotics platform. All code and data for COCOpen, MultiDLO, TrackDLO, DLO-Splatting, KnotDLO, and GraphDLO is publicly available to support future benchmarking in detection, tracking, and manipulation of DLOs. This work helps robots see, follow, and use DLOs, moving toward using them as tools for transforming the world."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/129943"],"dc:language":["en","eng"],"dc:rights":["Copyright 2025 Holly M. Dinkel"],"dc:subject":["Robotics","Computer Vision","Robotic Perception","Perception","Robotic Manipulation","Manipulation","Object Detection","Deformable Objects","Deformable Object Detection","Object Tracking","Tracking","Deformable Object Tracking","Manipulating Deformable Objects","Prediction","Trajectory Prediction"],"dc:title":["Representing and manipulating deformable linear objects"],"dc:type":["text"],"thesis:degree_discipline":["Aerospace Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois Urbana-Champaign"]},"updated_at":"2026-07-22T22:25:06Z"}