Object discovery via layer disposal

A key limitation of semantic image segmentation approaches is that they require large amounts of densely labeled training data. In this thesis, we introduce a method to learn to segment images with unlabeled data. The intuition behind the approach is that removing objects from images will yield natural images, however removing random patches will yield unnatural images. We capitalize on this signal to develop an auto-encoder that decomposes an image into layers, and when all layers are combined, it reconstructs the input image. However, when a layer is removed, the model learns to produce a different image that still looks natural to an adversary, which is possible by removing objects. Experiments and visualizations suggest that this model automatically learns to segment objects in images better than baselines. Some parts of this thesis represent joint work with Dr. Carl Vondrick and Professor Antonio Torralba.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2017

Author dc:creator

• Oktay, Deniz, M. Eng. Massachusetts Institute of Technology

Advisor dc:contributor.advisor

• Antonio Torralba.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/119538

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/119538