{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/116106"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/116106","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Vision-based shape reconstruction and control of soft continuum arms","abstract":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-08-01","abstract_html":"Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-08-01","abstract_has_math":false,"creators":["Albeladi, Ali"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Electrical & Computer Engr","degree_department":null,"school":null,"contributors":["Krishnan, Girish","Hutchinson, Seth","Belabbas, Mohamad-Ali","Kim, Joohyung"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-08","date_published":"2022-08","updated_at":"2026-07-22T22:24:55Z","subjects":["Robotics","Soft Robotics","Visual servoing","Control"],"languages":["en","eng"],"rights":["Copyright 2022 Ali Albeladi"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/2142/116106","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Krishnan, Girish","Hutchinson, Seth","Belabbas, Mohamad-Ali","Kim, Joohyung"]},{"key":"dc:creator","label":"Author","values":["Albeladi, Ali"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-08","2022-07-15"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical & Computer Engr"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Robotics","Soft Robotics","Visual servoing","Control"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en","eng"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2022 Ali Albeladi"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://hdl.handle.net/2142/116106"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-08-01","The student, Ali Albeladi, accepted the attached license on 2022-07-14 at 15:23.","The student, Ali Albeladi, submitted this Dissertation for approval on 2022-07-14 at 15:58.","This Dissertation was approved for publication on 2022-07-15 at 09:24.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18314 on 2022-11-15 at 21:40:13","Interest in soft continuum arms (SCAs) has increased as their inherent material elasticity enables safe and adaptive interactions with the environment. However, to achieve full autonomy in these arms, further development in accurate shape sensing and control methods is needed. Vision-based solutions have been found to be effective for such tasks. This dissertation investigates the use of vision-based methods to estimate and control a SCA. The developed shape estimator utilizes a geometric strain based representation for the SCA's shape. This representation reduces the dimension of the curved shape to a finite set of strain basis functions, thereby allowing for efficient optimization for the shape that best fits the observed image. Experimental results demonstrate the effectiveness of the proposed approach in estimating the end effector with accuracy less than the soft arm's radius. Vision-based control, i.e. Visual Servoing (VS), for SCAs is challenging due to the difficulty in modelling them. Lately, more researchers are using the Coserrat Rod Model to accurately model SCAs, since it accounts for the material properties of the SCA and the effect of external forces. In this dissertation, a model-based VS method that relies on the Coserrat Rod model is developed. A model-free VS method is also developed for cases where the material properties are not available. Both eye-in-hand and eye-to-hand VS are demonstrated using these methods. Trade-offs arise when deciding to control SCAs with eye-in-hand or eye-to-hand VS. Cameras placed at a distance (eye-to-hand) can observe a larger workspace area and the SCA tip, while a camera at the end effector (eye-in-hand) can more accurately survey the target. In this dissertation, a hybrid eye-to-hand and eye-in-hand VS scheme to track a desired object in the SCA's worksapce is introduced. When the target is not in the field-of-view of the tip camera, hand-to-eye VS is implemented using a wide field-of-view camera on the soft robot's base, to servo the soft robot's tip to a feasible region where the target is expected to be seen by the tip camera. This region is estimated by solving an optimization problem that finds the best region to place the SCA, assuming a constant curvature model for the SCA. When the target is seen by the tip camera, the system switches to a hand-in-eye controller that keeps the target in the desired image position of the tip camera. Experimental results on the $BR^2$ SCA demonstrate the effectiveness of the hybrid VS scheme under practical settings that include external disturbances."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Vision-based shape reconstruction and control of soft continuum arms"]}]}],"canonical_facts":{"dc:contributor":["Krishnan, Girish","Hutchinson, Seth","Belabbas, Mohamad-Ali","Kim, Joohyung"],"dc:creator":["Albeladi, Ali"],"dc:date":["2022-08","2022-07-15"],"dc:description":["Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2024-08-01","The student, Ali Albeladi, accepted the attached license on 2022-07-14 at 15:23.","The student, Ali Albeladi, submitted this Dissertation for approval on 2022-07-14 at 15:58.","This Dissertation was approved for publication on 2022-07-15 at 09:24.","DSpace SAF Submission Ingestion Package generated from Vireo submission #18314 on 2022-11-15 at 21:40:13","Interest in soft continuum arms (SCAs) has increased as their inherent material elasticity enables safe and adaptive interactions with the environment. However, to achieve full autonomy in these arms, further development in accurate shape sensing and control methods is needed. Vision-based solutions have been found to be effective for such tasks. This dissertation investigates the use of vision-based methods to estimate and control a SCA. The developed shape estimator utilizes a geometric strain based representation for the SCA's shape. This representation reduces the dimension of the curved shape to a finite set of strain basis functions, thereby allowing for efficient optimization for the shape that best fits the observed image. Experimental results demonstrate the effectiveness of the proposed approach in estimating the end effector with accuracy less than the soft arm's radius. Vision-based control, i.e. Visual Servoing (VS), for SCAs is challenging due to the difficulty in modelling them. Lately, more researchers are using the Coserrat Rod Model to accurately model SCAs, since it accounts for the material properties of the SCA and the effect of external forces. In this dissertation, a model-based VS method that relies on the Coserrat Rod model is developed. A model-free VS method is also developed for cases where the material properties are not available. Both eye-in-hand and eye-to-hand VS are demonstrated using these methods. Trade-offs arise when deciding to control SCAs with eye-in-hand or eye-to-hand VS. Cameras placed at a distance (eye-to-hand) can observe a larger workspace area and the SCA tip, while a camera at the end effector (eye-in-hand) can more accurately survey the target. In this dissertation, a hybrid eye-to-hand and eye-in-hand VS scheme to track a desired object in the SCA's worksapce is introduced. When the target is not in the field-of-view of the tip camera, hand-to-eye VS is implemented using a wide field-of-view camera on the soft robot's base, to servo the soft robot's tip to a feasible region where the target is expected to be seen by the tip camera. This region is estimated by solving an optimization problem that finds the best region to place the SCA, assuming a constant curvature model for the SCA. When the target is seen by the tip camera, the system switches to a hand-in-eye controller that keeps the target in the desired image position of the tip camera. Experimental results on the $BR^2$ SCA demonstrate the effectiveness of the hybrid VS scheme under practical settings that include external disturbances."],"dc:format":["application/pdf"],"dc:identifier":["https://hdl.handle.net/2142/116106"],"dc:language":["en","eng"],"dc:rights":["Copyright 2022 Ali Albeladi"],"dc:subject":["Robotics","Soft Robotics","Visual servoing","Control"],"dc:title":["Vision-based shape reconstruction and control of soft continuum arms"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Electrical & Computer Engr"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:55Z"}