{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/106345"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/106345","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Enhancing safety in telerobotic surgery via haptic feedback","abstract":"Bilateral teleoperation with master/slave mechanism provides a means of transmitting the interactions between the slave robot and the environment to the master side by letting the user perceive the interaction force that generated by the actuators in the haptic device. In this dissertation, two frameworks for teleoperation of robotic manipulators with haptic force feedback through dynamic model-based approach and model-mediated approach integrating with non-contact sensing are presented. The obvious advantage of the two frameworks is eliminating the need for mounting force/torque sensors on the robotic manipulator. Firstly, a dynamic model-based approach is developed to monitor the robot states and use the error dynamics between the nominal robot state and the robot motor encoder measurement to generate haptic force feedback. And secondly, the idea of model-mediated telemanipulation is applied to develop a haptic rendering pipeline that providing tool-environment contact situation awareness as well as forcing the tool not to violate the interpenetration condition. In the field of robot-assisted minimally invasive surgery, the widely-used robotic system operated by the surgeon follows the master/slave architecture. On the master side, the surgeon operates on a motorized device which controls wristed instrument arm that goes inside the patient's body to perform surgical procedures. The end-effector of the instrument arm is equipped with different kinds of surgical tools, e.g., grasper, cutter, needle driver, suction irrigator, etc. The stereo vision streaming from the arm that equipped with the endoscope camera on the slave side is transmitted to the master's console in real time. Nowadays, surgeons still solely rely on visual feedback to perform surgical procedures. By investigating the adverse events reported to FDA MAUDE database and intending to expose the failure cases of the robotic system to the surgeons during the training phase, a fault injection engine is considered to reproduce the adverse events and use the first framework developed to let the surgeon obtain the instantaneous warning through haptic feedback. Human error can cause unexpected danger to the patient since the surgical robot has very limited autonomy feature and is totally under human control. The second framework aims at protecting the labeled region in the scene from contacting with the tool and providing stable haptic rendering. Experimental result data shows both of the frameworks improve the operational safety in the area of robotic surgery, and teleoperation in general.","abstract_html":"Bilateral teleoperation with master/slave mechanism provides a means of transmitting the interactions between the slave robot and the environment to the master side by letting the user perceive the interaction force that generated by the actuators in the haptic device. In this dissertation, two frameworks for teleoperation of robotic manipulators with haptic force feedback through dynamic model-based approach and model-mediated approach integrating with non-contact sensing are presented. The obvious advantage of the two frameworks is eliminating the need for mounting force/torque sensors on the robotic manipulator. Firstly, a dynamic model-based approach is developed to monitor the robot states and use the error dynamics between the nominal robot state and the robot motor encoder measurement to generate haptic force feedback. And secondly, the idea of model-mediated telemanipulation is applied to develop a haptic rendering pipeline that providing tool-environment contact situation awareness as well as forcing the tool not to violate the interpenetration condition. In the field of robot-assisted minimally invasive surgery, the widely-used robotic system operated by the surgeon follows the master/slave architecture. On the master side, the surgeon operates on a motorized device which controls wristed instrument arm that goes inside the patient's body to perform surgical procedures. The end-effector of the instrument arm is equipped with different kinds of surgical tools, e.g., grasper, cutter, needle driver, suction irrigator, etc. The stereo vision streaming from the arm that equipped with the endoscope camera on the slave side is transmitted to the master's console in real time. Nowadays, surgeons still solely rely on visual feedback to perform surgical procedures. By investigating the adverse events reported to FDA MAUDE database and intending to expose the failure cases of the robotic system to the surgeons during the training phase, a fault injection engine is considered to reproduce the adverse events and use the first framework developed to let the surgeon obtain the instantaneous warning through haptic feedback. Human error can cause unexpected danger to the patient since the surgical robot has very limited autonomy feature and is totally under human control. The second framework aims at protecting the labeled region in the scene from contacting with the tool and providing stable haptic rendering. Experimental result data shows both of the frameworks improve the operational safety in the area of robotic surgery, and teleoperation in general.","abstract_has_math":false,"creators":["Li, Xiao"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"Ph.D.","degree_level":"Dissertation","degree_discipline":"Mechanical Engineering","degree_department":null,"school":null,"contributors":["Kesavadas, Thenkurussi","Ferreira, Placid","Kalbarczyk, Zbigniew T.","Hovakimyan, Naira"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2020,"date_issued":"2020-03-02T22:12:18Z","date_published":"2020-03-02T22:12:18Z","updated_at":"2026-07-22T22:24:45Z","subjects":["surgical robot, robotic surgery, haptics, sensing"],"languages":["en"],"rights":["Copyright 2019 Xiao Li"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/106345","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Kesavadas, Thenkurussi","Ferreira, Placid","Kalbarczyk, Zbigniew T.","Hovakimyan, Naira"]},{"key":"dc:creator","label":"Author","values":["Li, Xiao"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2020-03-02T22:12:18Z","2022-03-03T10:15:08Z","2019-11-26","2019-12"]},{"key":"dc:type","label":"Dc Type","values":["text"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Mechanical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["surgical robot, robotic surgery, haptics, sensing"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2019 Xiao Li"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/106345"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Bilateral teleoperation with master/slave mechanism provides a means of transmitting the interactions between the slave robot and the environment to the master side by letting the user perceive the interaction force that generated by the actuators in the haptic device. In this dissertation, two frameworks for teleoperation of robotic manipulators with haptic force feedback through dynamic model-based approach and model-mediated approach integrating with non-contact sensing are presented. The obvious advantage of the two frameworks is eliminating the need for mounting force/torque sensors on the robotic manipulator. Firstly, a dynamic model-based approach is developed to monitor the robot states and use the error dynamics between the nominal robot state and the robot motor encoder measurement to generate haptic force feedback. And secondly, the idea of model-mediated telemanipulation is applied to develop a haptic rendering pipeline that providing tool-environment contact situation awareness as well as forcing the tool not to violate the interpenetration condition. In the field of robot-assisted minimally invasive surgery, the widely-used robotic system operated by the surgeon follows the master/slave architecture. On the master side, the surgeon operates on a motorized device which controls wristed instrument arm that goes inside the patient's body to perform surgical procedures. The end-effector of the instrument arm is equipped with different kinds of surgical tools, e.g., grasper, cutter, needle driver, suction irrigator, etc. The stereo vision streaming from the arm that equipped with the endoscope camera on the slave side is transmitted to the master's console in real time. Nowadays, surgeons still solely rely on visual feedback to perform surgical procedures. By investigating the adverse events reported to FDA MAUDE database and intending to expose the failure cases of the robotic system to the surgeons during the training phase, a fault injection engine is considered to reproduce the adverse events and use the first framework developed to let the surgeon obtain the instantaneous warning through haptic feedback. Human error can cause unexpected danger to the patient since the surgical robot has very limited autonomy feature and is totally under human control. The second framework aims at protecting the labeled region in the scene from contacting with the tool and providing stable haptic rendering. Experimental result data shows both of the frameworks improve the operational safety in the area of robotic surgery, and teleoperation in general.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2021-12-01","The student, Xiao Li, accepted the attached license on 2019-11-17 at 23:40.","The student, Xiao Li, submitted this Dissertation for approval on 2019-11-17 at 23:52.","This Dissertation was approved for publication on 2019-11-26 at 10:00.","DSpace SAF Submission Ingestion Package generated from Vireo submission #14557 on 2020-02-28 at 17:22:09","Made available in DSpace on 2020-03-02T22:12:18Z (GMT). No. of bitstreams: 3 LI-DISSERTATION-2019.pdf: 13081081 bytes, checksum: a6b8a8138907fa17a8c88345899dda4f (MD5) LICENSE.txt: 4204 bytes, checksum: 049e6eba45c8958458657ad2d02ab275 (MD5) PROQUEST_LICENSE.txt: 4550 bytes, checksum: ac61830ff50c48eef2789ddf73c8d613 (MD5) Previous issue date: 2019-11-26","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:12:26Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:15:21Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:18:25Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 113886 on 2022-03-03T10:15:08Z."]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Enhancing safety in telerobotic surgery via haptic feedback"]}]}],"canonical_facts":{"dc:contributor":["Kesavadas, Thenkurussi","Ferreira, Placid","Kalbarczyk, Zbigniew T.","Hovakimyan, Naira"],"dc:creator":["Li, Xiao"],"dc:date":["2020-03-02T22:12:18Z","2022-03-03T10:15:08Z","2019-11-26","2019-12"],"dc:description":["Bilateral teleoperation with master/slave mechanism provides a means of transmitting the interactions between the slave robot and the environment to the master side by letting the user perceive the interaction force that generated by the actuators in the haptic device. In this dissertation, two frameworks for teleoperation of robotic manipulators with haptic force feedback through dynamic model-based approach and model-mediated approach integrating with non-contact sensing are presented. The obvious advantage of the two frameworks is eliminating the need for mounting force/torque sensors on the robotic manipulator. Firstly, a dynamic model-based approach is developed to monitor the robot states and use the error dynamics between the nominal robot state and the robot motor encoder measurement to generate haptic force feedback. And secondly, the idea of model-mediated telemanipulation is applied to develop a haptic rendering pipeline that providing tool-environment contact situation awareness as well as forcing the tool not to violate the interpenetration condition. In the field of robot-assisted minimally invasive surgery, the widely-used robotic system operated by the surgeon follows the master/slave architecture. On the master side, the surgeon operates on a motorized device which controls wristed instrument arm that goes inside the patient's body to perform surgical procedures. The end-effector of the instrument arm is equipped with different kinds of surgical tools, e.g., grasper, cutter, needle driver, suction irrigator, etc. The stereo vision streaming from the arm that equipped with the endoscope camera on the slave side is transmitted to the master's console in real time. Nowadays, surgeons still solely rely on visual feedback to perform surgical procedures. By investigating the adverse events reported to FDA MAUDE database and intending to expose the failure cases of the robotic system to the surgeons during the training phase, a fault injection engine is considered to reproduce the adverse events and use the first framework developed to let the surgeon obtain the instantaneous warning through haptic feedback. Human error can cause unexpected danger to the patient since the surgical robot has very limited autonomy feature and is totally under human control. The second framework aims at protecting the labeled region in the scene from contacting with the tool and providing stable haptic rendering. Experimental result data shows both of the frameworks improve the operational safety in the area of robotic surgery, and teleoperation in general.","Submission published under a 24 month embargo labeled 'U of I Access', the embargo will last until 2021-12-01","The student, Xiao Li, accepted the attached license on 2019-11-17 at 23:40.","The student, Xiao Li, submitted this Dissertation for approval on 2019-11-17 at 23:52.","This Dissertation was approved for publication on 2019-11-26 at 10:00.","DSpace SAF Submission Ingestion Package generated from Vireo submission #14557 on 2020-02-28 at 17:22:09","Made available in DSpace on 2020-03-02T22:12:18Z (GMT). No. of bitstreams: 3 LI-DISSERTATION-2019.pdf: 13081081 bytes, checksum: a6b8a8138907fa17a8c88345899dda4f (MD5) LICENSE.txt: 4204 bytes, checksum: 049e6eba45c8958458657ad2d02ab275 (MD5) PROQUEST_LICENSE.txt: 4550 bytes, checksum: ac61830ff50c48eef2789ddf73c8d613 (MD5) Previous issue date: 2019-11-26","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:12:26Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:15:21Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","Embargo set by: Seth Robbins for item 113886 Lift date: 2022-03-02T22:18:25Z Reason: Author requested U of Illinois access only (OA after 2yrs) in Vireo ETD system","U of I Only Restriction Lifted for Item 113886 on 2022-03-03T10:15:08Z."],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/106345"],"dc:language":["en"],"dc:rights":["Copyright 2019 Xiao Li"],"dc:subject":["surgical robot, robotic surgery, haptics, sensing"],"dc:title":["Enhancing safety in telerobotic surgery via haptic feedback"],"dc:type":["text"],"thesis:degree_discipline":["Mechanical Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:45Z"}