Affective social quest (ASQ) : teaching emotion recognition with interactive media & wireless expressive toys

In this thesis, I investigate new ways to use affective computing and multimedia tools to augment a child's learning of emotional expression. I develop the hypothesis that these tools can be particularly useful to children with autism and their practitioners. I test the hypothesis by building a candidate research system that comprises a screen on which are shown emotionally charged animated movie clips, together with a set of stuffed dolls through which a child can interact with the movies. Each doll embodied an emotional expression: happy, angry, sad, and surprise. In operation, the test children are shown one of 200 emotive clips and they respond by touching the doll whose expression matches that of the clip. An online guide and registration system allows a therapist to control and monitor the interactions. Six volunteer test children used the system at the Dan Marino Center in Ft Lauderdale and their reactions were observed. This served as verification that a system that manipulated movies and haptic interfaces was feasible and second, such a system could augment and potentially automate some of the human-intensive, repetitive aspects of existing behavioral therapy techniques. All six children responded to and attended to the system, with five of them completing three one-hour day visits comprising multiple sessions. Some children showed improvement in their matching of emotions and one child demonstrated generalization in a home setting.

Department dc:contributor.department

Massachusetts Institute of Technology. Dept. of Architecture. Program In Media Arts and Sciences.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

1999

Author dc:creator

• Blocher, Katharine Howard, 1961-

Advisor dc:contributor.advisor

• Andrew Lippman.

• Architecture. Program In Media Arts and Sciences.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/61106

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/61106