Emergent patterns of task-specific neurons in deep neural networks

Visual cognition has long been the subject of curiosity within the realm of deep learning. While much research has gone into the development of neural network models that can at times outperform humans, the underlying principles behind truly understanding visual concepts remain elusive. Utilizing a multitask learning paradigm, we first explore the capacity for networks to generalize to understand visual reasoning concepts. We introduce a simplified visual reasoning dataset to train several network architectures, including a recently proposed model built specifically for relational reasoning. We collect the best performing networks and view their behavior on a neuronal level: visualizing task selectivity through patterns of activations from each network layer. Finally, we adjust our focus to a simpler form of visual reasoning involving the extraction of single attributes from attribute compositions. Here, we are able to both visualize and quantify the neuron task selectivity that leads to generalization.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2020

Author dc:creator

• Dozier, Jamell(Jamell A.)

Advisor dc:contributor.advisor

• Tomaso Poggio.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/129875

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/129875