Predictive vision

Anticipating outcomes is the root of intelligence. This thesis investigates Predictive Vision with the goal to develop robust methods that anticipate the next events that may happen in images or videos. Importantly, we develop methods for eciently scaling learning algorithms to learn an extensive set of rules that enable richer visual understanding. While large annotated datasets fuel progress in object recognition, the knowledge required for event understanding is vast and potentially ambiguous. To tackle this challenge, we develop predictive vision algorithms that instead learn these rules directly from large amounts of raw, unlabeled data. Capitalizing on millions of natural videos, this work develops algorithms that learn to anticipate the visual future, forecast human actions, and recognize ambient sounds.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2017

Author dc:creator

• Vondrick, Carl (Carl Martin)

Advisor dc:contributor.advisor

• Antonio Torralba.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/112001

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/112001