Reasoning about objects under full occlusion

While state-of-the-art machine learning models can outperform humans on certain tasks, most of them generalize poorly across domains and cannot reason about complex scenes. In this paper, we attempt to resolve this shortcoming by incorporating a physics engine as a prior for scene understanding. We test our approach on two computer vision tasks -- pose estimation and object matching -- under full occlusion, and demonstrate superior performance over state-of-the-art methods. We also present a preliminary case study which demonstrates that our model is consistent with human behavior. Our work demonstrates a successful approach to a novel and challenging task, provides a general framework to infer latent factors of scene via physics simulation, and extends support for intuitive physics-based approaches for robust visual reasoning.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2018

Author dc:creator

• Ray Chaudhuri, Shraman

Advisor dc:contributor.advisor

• Joshua B. Tenenbaum.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/119721

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/119721