Use of a wearable camera system in conversation : toward a companion tool for social-emotional learning in autism

Self-Cam is a wearable camera system that allows a person to collect video and audio from the movements of her own head and face. Like looking in a mirror, live feedback or video playback from the camera can be used to experience and learn how you look to others. Video playback and analysis tools can also be used to review and learn how others wearing the Self-Cam express themselves to you. We are developing a tool to teach the kind of facial analysis that an empathetic person might notice in interpretation of everyday interaction. Because it works from real life experience from a single person's point of view, we hypothesize that this analysis of self and immediate social environment will help the process of generalization of facial expression and mental state inference for that person, giving them a better understanding of the significance of facial movements and improvement in recognition of social cues. As steps toward this investigation, this thesis constructs a wearable camera system, designs a process of expression collection and analysis, and develops and implements a video test to evaluate the recognition abilities of study subjects throughout the investigation. Preliminary results show a great difference in ability between individual autistic subjects, some of whom approach the abilities of well scoring neurotypical individuals.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Architecture. Program in Media Arts and Sciences.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2007

Author dc:creator

• Teeters, Alea Chandler

Advisor dc:contributor.advisor

• Rosalind W. Picard.

• Architecture. Program in Media Arts and Sciences.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/41564

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/41564