Robust Flight Navigation with Liquid Neural Networks

Autonomous robots can learn to perform visual navigation tasks from offline human demonstrations, and generalize well to online and unseen scenarios within the same environment they have been trained on. It is fundamentally challenging for these intelligent agents to take a step further and robustly generalize to new environments with drastic scenery changes they have never encountered before. Here, we present a method to create robust flight navigation agents that successfully perform vision-based fly-to-target tasks beyond their training environment under drastic distribution shifts. To this end, we design an imitation learning framework utilizing liquid neural networks, a brain-inspired class of continuous-time neural models that are causal and adapt to changing conditions. We observe that liquid agents learn to distill the task they are given from visual inputs, and drop irrelevant features. This way, they transfer their learned navigation skills to new environments. When compared to other advanced deep agents, we confirm this level of robustness in decision-making is exclusive to liquid networks, both in their differential equation and closed-form representation.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2022

Author dc:creator

• Kao, Patrick

Advisor dc:contributor.advisor

• Rus, Daniela L.

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright MIT

Licence dc:rights.uri

• http://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/144657

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/144657