Zero-shot learning to execute tasks with robots

This thesis explores multiple approaches for improving the state of the art in robotic planning with reinforcement learning. We are interested in designing a generalizable framework with several features, namely: allowing for zero-shot learning agents that are robust and resilient in the event of failing midway during a task, allowing us to detect failures, and being highly generalizable to new environments. Initially, we focused mostly on training agents that are resilient in the event of failure and robust to changing environments. For this, we first explore the use of deep Q networks to control a robot. Upon finding deep Q learning too unstable, we determine that Q networks alone are insufficient for attaining true resilience. Second, we explore the use of more powerful actor-critic methods, augmented with hindsight experience replay (HER). We determine that approaches requiring low-dimensional representations of the environment, such as HER, will not scale gracefully to handle more complex environments. Finally, we explore the use of generative models to learn a reward function that tightly couples the context of a linguistic command to the reward of a reinforcement learning agent. We hypothesize that a learned reward function will satisfy all of our criteria, and is part of our ongoing research.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2020

Author dc:creator

• Alverio, Julian(Julian A.)

Advisor dc:contributor.advisor

• Boris Katz.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/129898

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/129898