{"id":{"repo_id":"uiuc","oai_identifier":"oai:www.ideals.illinois.edu:2142/108527"},"canonical_url":"https://search.dev.ndltd.org/etd/uiuc/oai:www.ideals.illinois.edu:2142/108527","repository":{"repo_id":"uiuc","name":"University of Illinois - Urbana-Champaign","base_url":"https://www.ideals.illinois.edu/oai-pmh"},"display":{"title":"Investigating pre-touch sensing to predict grip success in compliant grippers using machine learning techniques","abstract":"This work explores the application of pre-touch sensing to a compliant gripper in order to navigate the last few centimeters while grasping fruit in an occluded, cluttered environment. Machine learning was used in conjunction with pre-touch sensors to provide qualitative feedback about the success of the gripper in picking the target fruit prior to contact. Three compliant grippers were each designed to pick a specific fruit (miracle berries, cherry tomatoes and small figs) without damaging them. These grippers were designed to be mounted on the hybrid soft-rigid arm of a mobile field robot. An IR reflectance, time of flight and color sensor were used as pre-touch sensors and arranged on the gripper in various combinations to explore the contribution of each sensor. The gripper-sensor system was trained by positioning it relative to a dummy fruit using a 6 DOF arm and gripping the target. Using the training data, five machine learning methods were explored: nearest neighbor, decision trees, support vector machines, multi-layer perceptrons and a naive Bayes classifier. The various sensor configuration-machine learning combinations were tested and evaluated based on their ability to predict grip success. Additional training was conducted to demonstrate the ability to differentiate fruit from foreign matter (e.g. leaves) that are in the gripper opening. Time of flight sensors using nearest neighbor and support vector machines along with the set of all three sensors using support vector machines and multi-layer perceptrons showed the highest prediction precision (= 90%) with the color sensor playing a key role in detecting foreign objects. The machine learning methods were similar in their ability to predict grip success with nearest neighbor showing the best overall results, while sensor ‘richness’ play an important role in differentiating the sensors with the three sensor combination showing the best results.","abstract_html":"This work explores the application of pre-touch sensing to a compliant gripper in order to navigate the last few centimeters while grasping fruit in an occluded, cluttered environment. Machine learning was used in conjunction with pre-touch sensors to provide qualitative feedback about the success of the gripper in picking the target fruit prior to contact. Three compliant grippers were each designed to pick a specific fruit (miracle berries, cherry tomatoes and small figs) without damaging them. These grippers were designed to be mounted on the hybrid soft-rigid arm of a mobile field robot. An IR reflectance, time of flight and color sensor were used as pre-touch sensors and arranged on the gripper in various combinations to explore the contribution of each sensor. The gripper-sensor system was trained by positioning it relative to a dummy fruit using a 6 DOF arm and gripping the target. Using the training data, five machine learning methods were explored: nearest neighbor, decision trees, support vector machines, multi-layer perceptrons and a naive Bayes classifier. The various sensor configuration-machine learning combinations were tested and evaluated based on their ability to predict grip success. Additional training was conducted to demonstrate the ability to differentiate fruit from foreign matter (e.g. leaves) that are in the gripper opening. Time of flight sensors using nearest neighbor and support vector machines along with the set of all three sensors using support vector machines and multi-layer perceptrons showed the highest prediction precision (= 90%) with the color sensor playing a key role in detecting foreign objects. The machine learning methods were similar in their ability to predict grip success with nearest neighbor showing the best overall results, while sensor ‘richness’ play an important role in differentiating the sensors with the three sensor combination showing the best results.","abstract_has_math":false,"creators":["Walt, Benjamin Thomas"],"institution":"University of Illinois at Urbana-Champaign","degree_name":"M.S.","degree_level":"Thesis","degree_discipline":"Mechanical Engineering","degree_department":null,"school":null,"contributors":["Krishnan, Girish"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2020,"date_issued":"2020-10-07T21:00:06Z","date_published":"2020-10-07T21:00:06Z","updated_at":"2026-07-22T22:24:48Z","subjects":["robotics","soft robotics","gripper","pre-touch sensing","machine learning","grip prediction"],"languages":["en"],"rights":["Copyright 2020 Benjamin Thomas Walt"],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/2142/108527","outbound_label":"Handle","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Krishnan, Girish"]},{"key":"dc:creator","label":"Author","values":["Walt, Benjamin Thomas"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2020-10-07T21:00:06Z","2020-07-22","2020-08"]},{"key":"dc:type","label":"Dc Type","values":["text","Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Mechanical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S."]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of Illinois at Urbana-Champaign"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["robotics","soft robotics","gripper","pre-touch sensing","machine learning","grip prediction"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Copyright 2020 Benjamin Thomas Walt"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["http://hdl.handle.net/2142/108527"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This work explores the application of pre-touch sensing to a compliant gripper in order to navigate the last few centimeters while grasping fruit in an occluded, cluttered environment. Machine learning was used in conjunction with pre-touch sensors to provide qualitative feedback about the success of the gripper in picking the target fruit prior to contact. Three compliant grippers were each designed to pick a specific fruit (miracle berries, cherry tomatoes and small figs) without damaging them. These grippers were designed to be mounted on the hybrid soft-rigid arm of a mobile field robot. An IR reflectance, time of flight and color sensor were used as pre-touch sensors and arranged on the gripper in various combinations to explore the contribution of each sensor. The gripper-sensor system was trained by positioning it relative to a dummy fruit using a 6 DOF arm and gripping the target. Using the training data, five machine learning methods were explored: nearest neighbor, decision trees, support vector machines, multi-layer perceptrons and a naive Bayes classifier. The various sensor configuration-machine learning combinations were tested and evaluated based on their ability to predict grip success. Additional training was conducted to demonstrate the ability to differentiate fruit from foreign matter (e.g. leaves) that are in the gripper opening. Time of flight sensors using nearest neighbor and support vector machines along with the set of all three sensors using support vector machines and multi-layer perceptrons showed the highest prediction precision (= 90%) with the color sensor playing a key role in detecting foreign objects. The machine learning methods were similar in their ability to predict grip success with nearest neighbor showing the best overall results, while sensor ‘richness’ play an important role in differentiating the sensors with the three sensor combination showing the best results.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2020-10-02 without embargo terms","The student, Benjamin Walt, accepted the attached license on 2020-07-21 at 13:51.","The student, Benjamin Walt, submitted this Thesis for approval on 2020-07-21 at 14:10.","This Thesis was approved for publication on 2020-07-22 at 14:19.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15712 on 2020-10-02 at 15:15:04","Made available in DSpace on 2020-10-07T21:00:06Z (GMT). No. of bitstreams: 2 WALT-THESIS-2020.pdf: 20210763 bytes, checksum: 103a68b59ea8cd60018a2245967cd143 (MD5) LICENSE.txt: 4210 bytes, checksum: 688ae7b9f4da90c3255de537fa6f3bc3 (MD5) Previous issue date: 2020-07-22"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Investigating pre-touch sensing to predict grip success in compliant grippers using machine learning techniques"]}]}],"canonical_facts":{"dc:contributor":["Krishnan, Girish"],"dc:creator":["Walt, Benjamin Thomas"],"dc:date":["2020-10-07T21:00:06Z","2020-07-22","2020-08"],"dc:description":["This work explores the application of pre-touch sensing to a compliant gripper in order to navigate the last few centimeters while grasping fruit in an occluded, cluttered environment. Machine learning was used in conjunction with pre-touch sensors to provide qualitative feedback about the success of the gripper in picking the target fruit prior to contact. Three compliant grippers were each designed to pick a specific fruit (miracle berries, cherry tomatoes and small figs) without damaging them. These grippers were designed to be mounted on the hybrid soft-rigid arm of a mobile field robot. An IR reflectance, time of flight and color sensor were used as pre-touch sensors and arranged on the gripper in various combinations to explore the contribution of each sensor. The gripper-sensor system was trained by positioning it relative to a dummy fruit using a 6 DOF arm and gripping the target. Using the training data, five machine learning methods were explored: nearest neighbor, decision trees, support vector machines, multi-layer perceptrons and a naive Bayes classifier. The various sensor configuration-machine learning combinations were tested and evaluated based on their ability to predict grip success. Additional training was conducted to demonstrate the ability to differentiate fruit from foreign matter (e.g. leaves) that are in the gripper opening. Time of flight sensors using nearest neighbor and support vector machines along with the set of all three sensors using support vector machines and multi-layer perceptrons showed the highest prediction precision (= 90%) with the color sensor playing a key role in detecting foreign objects. The machine learning methods were similar in their ability to predict grip success with nearest neighbor showing the best overall results, while sensor ‘richness’ play an important role in differentiating the sensors with the three sensor combination showing the best results.","Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2020-10-02 without embargo terms","The student, Benjamin Walt, accepted the attached license on 2020-07-21 at 13:51.","The student, Benjamin Walt, submitted this Thesis for approval on 2020-07-21 at 14:10.","This Thesis was approved for publication on 2020-07-22 at 14:19.","DSpace SAF Submission Ingestion Package generated from Vireo submission #15712 on 2020-10-02 at 15:15:04","Made available in DSpace on 2020-10-07T21:00:06Z (GMT). No. of bitstreams: 2 WALT-THESIS-2020.pdf: 20210763 bytes, checksum: 103a68b59ea8cd60018a2245967cd143 (MD5) LICENSE.txt: 4210 bytes, checksum: 688ae7b9f4da90c3255de537fa6f3bc3 (MD5) Previous issue date: 2020-07-22"],"dc:format":["application/pdf"],"dc:identifier":["http://hdl.handle.net/2142/108527"],"dc:language":["en"],"dc:rights":["Copyright 2020 Benjamin Thomas Walt"],"dc:subject":["robotics","soft robotics","gripper","pre-touch sensing","machine learning","grip prediction"],"dc:title":["Investigating pre-touch sensing to predict grip success in compliant grippers using machine learning techniques"],"dc:type":["text","Thesis"],"thesis:degree_discipline":["Mechanical Engineering"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["M.S."],"thesis:institution_name":["University of Illinois at Urbana-Champaign"]},"updated_at":"2026-07-22T22:24:48Z"}