{"id":{"repo_id":"texas","oai_identifier":"oai:repositories.lib.utexas.edu:2152/81209"},"canonical_url":"https://search.dev.ndltd.org/etd/texas/oai:repositories.lib.utexas.edu:2152/81209","repository":{"repo_id":"texas","name":"University of Texas","base_url":"https://repositories.lib.utexas.edu/server/oai/request"},"display":{"title":"Enhancing touch interactions with passive finger acoustics","abstract":"In this report, we introduce a unique method of interacting with mobile devices through passive finger acoustics. Phone users typically use one of two fingers when interacting with a touchscreen device, leaving the other fingers idle. The motivation is that users can make use of their idle fingers to enhance the experience of an application. By wearing minimally obtrusive rings on the thumb and index finger, users can make distinguishable clicking sounds to quickly perform actions, without having to interact directly with the screen. Our system leverages the microphone embedded in the mobile device to capture sound and recognize sound in real-time without requiring Internet connection. The different sounds introduce new ways for users to interact with their devices, without cluttering the screen. We evaluated our system on an Android drawing application, which allows the user to switch tools based on clicks. We optimized our system based on accuracy, classification speed, and ease of use, in order to create a comfortable user experience","abstract_html":"In this report, we introduce a unique method of interacting with mobile devices through passive finger acoustics. Phone users typically use one of two fingers when interacting with a touchscreen device, leaving the other fingers idle. The motivation is that users can make use of their idle fingers to enhance the experience of an application. By wearing minimally obtrusive rings on the thumb and index finger, users can make distinguishable clicking sounds to quickly perform actions, without having to interact directly with the screen. Our system leverages the microphone embedded in the mobile device to capture sound and recognize sound in real-time without requiring Internet connection. The different sounds introduce new ways for users to interact with their devices, without cluttering the screen. We evaluated our system on an Android drawing application, which allows the user to switch tools based on clicks. We optimized our system based on accuracy, classification speed, and ease of use, in order to create a comfortable user experience","abstract_has_math":false,"creators":["Gong, Yifan"],"institution":"The University of Texas at Austin","degree_name":"Master of Science in Information Studies","degree_level":"Masters","degree_discipline":"Information Studies","degree_department":null,"school":null,"contributors":[],"advisors":["Thomaz, Edison","Gurari, Danna"],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019-06-26","date_published":"2019-06-26","updated_at":"2026-07-24T05:01:06Z","subjects":["Machine learning","Finger acoustics","Passive finger acoustics","Mobile device interaction","Mobile device user experience"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://dx.doi.org/10.26153/tsw/8222"],"render_values":[{"text":"http://dx.doi.org/10.26153/tsw/8222","href":"http://dx.doi.org/10.26153/tsw/8222","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/2152/81209","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Thomaz, Edison","Gurari, Danna"]},{"key":"dc:creator","label":"Author","values":["Gong, Yifan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2020-05-07T18:33:57Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2020-05-07T18:33:57Z"]},{"key":"dc:date.issued","label":"Date","values":["2019-06-26"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Information Studies"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science in Information Studies"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["The University of Texas at Austin"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Machine learning","Finger acoustics","Passive finger acoustics","Mobile device interaction","Mobile device user experience"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/2152/81209","http://dx.doi.org/10.26153/tsw/8222"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["In this report, we introduce a unique method of interacting with mobile devices through passive finger acoustics. Phone users typically use one of two fingers when interacting with a touchscreen device, leaving the other fingers idle. The motivation is that users can make use of their idle fingers to enhance the experience of an application. By wearing minimally obtrusive rings on the thumb and index finger, users can make distinguishable clicking sounds to quickly perform actions, without having to interact directly with the screen. Our system leverages the microphone embedded in the mobile device to capture sound and recognize sound in real-time without requiring Internet connection. The different sounds introduce new ways for users to interact with their devices, without cluttering the screen. We evaluated our system on an Android drawing application, which allows the user to switch tools based on clicks. We optimized our system based on accuracy, classification speed, and ease of use, in order to create a comfortable user experience"]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dc:title","label":"Title","values":["Enhancing touch interactions with passive finger acoustics"]}]}],"canonical_facts":{"dc:contributor.advisor":["Thomaz, Edison","Gurari, Danna"],"dc:creator":["Gong, Yifan"],"dc:date.accessioned":["2020-05-07T18:33:57Z"],"dc:date.available":["2020-05-07T18:33:57Z"],"dc:date.issued":["2019-06-26"],"dc:description.abstract":["In this report, we introduce a unique method of interacting with mobile devices through passive finger acoustics. Phone users typically use one of two fingers when interacting with a touchscreen device, leaving the other fingers idle. The motivation is that users can make use of their idle fingers to enhance the experience of an application. By wearing minimally obtrusive rings on the thumb and index finger, users can make distinguishable clicking sounds to quickly perform actions, without having to interact directly with the screen. Our system leverages the microphone embedded in the mobile device to capture sound and recognize sound in real-time without requiring Internet connection. The different sounds introduce new ways for users to interact with their devices, without cluttering the screen. We evaluated our system on an Android drawing application, which allows the user to switch tools based on clicks. We optimized our system based on accuracy, classification speed, and ease of use, in order to create a comfortable user experience"],"dc:format.mimetype":["application/pdf"],"dc:identifier.uri":["https://hdl.handle.net/2152/81209","http://dx.doi.org/10.26153/tsw/8222"],"dc:subject":["Machine learning","Finger acoustics","Passive finger acoustics","Mobile device interaction","Mobile device user experience"],"dc:title":["Enhancing touch interactions with passive finger acoustics"],"dc:type":["Thesis"],"thesis:degree_discipline":["Information Studies"],"thesis:degree_level":["Masters"],"thesis:degree_name":["Master of Science in Information Studies"],"thesis:institution_name":["The University of Texas at Austin"]},"updated_at":"2026-07-24T05:01:06Z"}