Measuring and modifying the intrinsic memorability of images

this thesis, I developed and carried out a procedure to measure the memorability of an image by running hundreds of human-trials and making use of a custom designed image dataset, the Mem60k dataset. The large store of ground-truth memorability data enabled a variety of insights and applications. The data revealed information about what qualities (emotional content, aesthetic appeal, etc.) in an image make it memorable. Convolutional neural networks (CNNs) trained on the data could predict an image's relative memorability with high accuracy. CNNs could also generate memorability heat maps which pinpoint which parts of an image are memorable. Finally, with additional usage of a massive image database, I designed a pipeline that could modify the intrinsic memorability of an image. The performance of each application was tested and measured by running further human trials.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2015

Author dc:creator

• Raju, Akhil (Akhil G.)

Advisor dc:contributor.advisor

• Antonio Torralba.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/100685

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/100685