{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/151615"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/151615","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Non-Invasive Vision-Based Measurement of Hand Kinematics and Interaction","abstract":"The ability to manipulate and interact with the world is a key part of what distinguishes humanity from other animals, and the human hand is perhaps the most powerful tool we have to do so. As such, a great deal of research goes towards better understanding how the hand behaves during interaction tasks. Study of physical interaction requires measurement of hand kinematics and interaction forces. Unfortunately, current methods involve cumbersome sensors or external forces that inherently change the way that the subject behaves. In order to avoid these confounding factors, this thesis presents an approach to measuring hand kinematics, dynamics, and physical interaction using a non-encumbering vision-based tool. The proposed tool consists of (1) Vision-based hand tracking of hand kinematics in joint space (2) Synergy extraction and synergy space projection (3) Visual soft tissue deformation based contact detection (4) An exploration of force estimation at the fingertips. This pipeline is applied to a piano-based experiment for validation and comparison with existing tools. The results indicate that vision-based kinematics measurement is largely comparable to and at times shows more sensitivity to joint angle variation than traditionally instrumented approaches. However, force estimation is not yet a consistent alternative to physical sensor interfaces.","abstract_html":"The ability to manipulate and interact with the world is a key part of what distinguishes humanity from other animals, and the human hand is perhaps the most powerful tool we have to do so. As such, a great deal of research goes towards better understanding how the hand behaves during interaction tasks. Study of physical interaction requires measurement of hand kinematics and interaction forces. Unfortunately, current methods involve cumbersome sensors or external forces that inherently change the way that the subject behaves. In order to avoid these confounding factors, this thesis presents an approach to measuring hand kinematics, dynamics, and physical interaction using a non-encumbering vision-based tool. The proposed tool consists of (1) Vision-based hand tracking of hand kinematics in joint space (2) Synergy extraction and synergy space projection (3) Visual soft tissue deformation based contact detection (4) An exploration of force estimation at the fingertips. This pipeline is applied to a piano-based experiment for validation and comparison with existing tools. The results indicate that vision-based kinematics measurement is largely comparable to and at times shows more sensitivity to joint angle variation than traditionally instrumented approaches. However, force estimation is not yet a consistent alternative to physical sensor interfaces.","abstract_has_math":false,"creators":["Wang, Margaret"],"institution":"Massachusetts Institute of Technology","degree_name":"Master","degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science","school":null,"contributors":[],"advisors":["Hogan, Neville"],"committee_chairs":[],"committee_members":[],"year":2023,"date_issued":"2023-06","date_published":"2023-06","updated_at":"2026-07-22T22:21:36Z","subjects":[],"languages":[],"rights":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"],"rights_urls":["https://rightsstatements.org/page/InC-EDU/1.0/"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1721.1/151615","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Hogan, Neville"]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"]},{"key":"dc:creator","label":"Author","values":["Wang, Margaret"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2023-07-31T19:52:58Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2023-07-31T19:52:58Z"]},{"key":"dc:date.issued","label":"Date","values":["2023-06"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master","Master of Engineering in Electrical Engineering and Computer Science"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"]},{"key":"dc:rights.uri","label":"Rights URI","values":["https://rightsstatements.org/page/InC-EDU/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1721.1/151615"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The ability to manipulate and interact with the world is a key part of what distinguishes humanity from other animals, and the human hand is perhaps the most powerful tool we have to do so. As such, a great deal of research goes towards better understanding how the hand behaves during interaction tasks. Study of physical interaction requires measurement of hand kinematics and interaction forces. Unfortunately, current methods involve cumbersome sensors or external forces that inherently change the way that the subject behaves. In order to avoid these confounding factors, this thesis presents an approach to measuring hand kinematics, dynamics, and physical interaction using a non-encumbering vision-based tool. The proposed tool consists of (1) Vision-based hand tracking of hand kinematics in joint space (2) Synergy extraction and synergy space projection (3) Visual soft tissue deformation based contact detection (4) An exploration of force estimation at the fingertips. This pipeline is applied to a piano-based experiment for validation and comparison with existing tools. The results indicate that vision-based kinematics measurement is largely comparable to and at times shows more sensitivity to joint angle variation than traditionally instrumented approaches. However, force estimation is not yet a consistent alternative to physical sensor interfaces."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M.Eng."]},{"key":"dc:title","label":"Title","values":["Non-Invasive Vision-Based Measurement of Hand Kinematics and Interaction"]}]}],"canonical_facts":{"dc:contributor.advisor":["Hogan, Neville"],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science"],"dc:creator":["Wang, Margaret"],"dc:date.accessioned":["2023-07-31T19:52:58Z"],"dc:date.available":["2023-07-31T19:52:58Z"],"dc:date.issued":["2023-06"],"dc:description.abstract":["The ability to manipulate and interact with the world is a key part of what distinguishes humanity from other animals, and the human hand is perhaps the most powerful tool we have to do so. As such, a great deal of research goes towards better understanding how the hand behaves during interaction tasks. Study of physical interaction requires measurement of hand kinematics and interaction forces. Unfortunately, current methods involve cumbersome sensors or external forces that inherently change the way that the subject behaves. In order to avoid these confounding factors, this thesis presents an approach to measuring hand kinematics, dynamics, and physical interaction using a non-encumbering vision-based tool. The proposed tool consists of (1) Vision-based hand tracking of hand kinematics in joint space (2) Synergy extraction and synergy space projection (3) Visual soft tissue deformation based contact detection (4) An exploration of force estimation at the fingertips. This pipeline is applied to a piano-based experiment for validation and comparison with existing tools. The results indicate that vision-based kinematics measurement is largely comparable to and at times shows more sensitivity to joint angle variation than traditionally instrumented approaches. However, force estimation is not yet a consistent alternative to physical sensor interfaces."],"dc:description.degree":["M.Eng."],"dc:identifier.uri":["https://hdl.handle.net/1721.1/151615"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["In Copyright - Educational Use Permitted","Copyright retained by author(s)"],"dc:rights.uri":["https://rightsstatements.org/page/InC-EDU/1.0/"],"dc:title":["Non-Invasive Vision-Based Measurement of Hand Kinematics and Interaction"],"dc:type":["Thesis"],"thesis:degree_name":["Master","Master of Engineering in Electrical Engineering and Computer Science"]},"updated_at":"2026-07-22T22:21:36Z"}