A kinematic analysis of sign language

Signed languages develop among deaf populations and employ manual communication instead of voiced communication. Stokoe attributes classify individual signs in American Sign Language (ASL) and include handshape, hand location, movement, orientation, and facial expression. Signed and oral languages are not mutually understood, and many deaf individuals live in linguistic isolation. This research addresses computer translation between signing and speech, investigating sign duration in sentence context versus in isolation and identifying kinematic sign markers. To date, there has been little study of continuous signing kinematics; it was previously unknown if kinematic markers existed. Kinematic data were collected from a proficient signer with electromagnetic Flock of Birds sensors (position! orientation of both wrists) and CyberGloves (18 joint angles/ hand). The data were collected for each sign in isolation and in sentences. Mean sign duration decreased in sentence context due to coarticulation. There was evidence of finger joint and wrist velocity coordination, synchronicity and hand preshaping. Angular velocity maxima and minima indicated differentiation between handshapes. Minima in the wrists' tangential velocity signified Stokoe locations, and maxima indicated movement (sign midpoints or transition midpoints), which can serve as anchors in the segmentation process. These segmented locations and movements can be combined with handshape and wrist orientation to identify likely signs based on the kinematic database developed at NJIT.

Name thesis:degree_name

Master of Science in Biomedical Engineering - (M.S.)

Discipline thesis:degree_discipline

Biomedical Engineering

Year

2007

Author dc:creator

• Koech, Chemuttaai C.

Contributors dc:contributor

• Richard A. Foulds
• Sergei Adamovich
• Bruno A. Mantilla

• Kinematic analysis
• American Sign Language
• Oral language
• Translation
• Biomedical Engineering and Bioengineering

Repository record dc:identifier

https://digitalcommons.njit.edu/theses/381

OAI identifier oai:identifier

oai:digitalcommons.njit.edu:theses-1380