My Personalized Movies : novel system for automatically animating a movie based on personal data and evaluation of its impact on affective and cognitive experience

Storytelling is a fundamental way in which human beings make sense of the world. Animated movies tell stories that engage audience across culture and age groups. I designed and built My Personalized Movies (MPM), a novel system where animated stories are automatically created based on data provided by individuals. The data include self-tracked mood and behavior captured in quantitative measures and descriptive text. MPM is designed to engage viewers through an emotive narrative, induce self-reflection about their mood and behavior patterns, and to improve self-compassion and self-esteem, which mediates behavior change. I demonstrate with a few stages of studies, involving in total 107 participants, that viewers show strong emotional engagement with MPM and can explicitly connect animated characters' stories to one's past experiences. An analysis of 22 participants' facial expression data during MPM reveals that participants' change in implicit self-esteem is positively correlated with the happiness of their facial expression. Participants with higher depression severity, as measured by PHQ9, showed less positive facial expression at the happy moments in the animation.

Department dc:contributor.department

Program in Media Arts and Sciences (Massachusetts Institute of Technology)

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2018

Author dc:creator

• Peng, Fengjiao

Advisor dc:contributor.advisor

• Rosalind W. Picard.

• Program in Media Arts and Sciences ()

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/120674

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/120674