Adversarial Inverse Reinforcement Learning with Noisy Observations

<p>Inverse reinforcement learning (IRL) has emerged as a popular approach for training robots from human/expert demonstration, where a learner/robot infers the expert's hidden reward function using the demonstrations and a simulator. We argue that noise is inevitable in certain parts of the demonstration, and show that such noise does indeed deteriorate the performance of a popular and widely applied IRL method, called Adversarial IRL (AIRL). To render AIRL robust to noise, we formulate the problem of reward inference as one of log-likelihood optimization that accommodates noisy input. We adopt two techniques from the literature on learning hidden representations in sequential decision tasks and combine them with AIRL to solve this unified optimization problem. Experiments in four benchmark OpenAI Gym environments show that our proposed methods are effective in overcoming demonstration noise for the task of reward learning, but less so for the task of reproducing the expert behavior.</p>

Name thesis:degree_name

Master of Science (MS)

Level thesis:degree_level

Masters Thesis

Year dc:date.available

2025

Author dc:creator

• Shrestha, Sagar

Contributors dc:contributor

• Dr. Bikramjit Banerjee
• Dr. Andrew Sung
• Dr. Bo Li

• Inverse Reinforcement Learning
• Adversarial Inverse Reinforcement Learning
• Demonstration Noise
• Reward Inference
• Log-Likelihood Optimization
• Expert Behavior Reproduction
• Artificial Intelligence and Robotics
• Other Computer Engineering
• Probability
• Robotics

Repository record dc:identifier

https://aquila.usm.edu/masters_theses/1110

OAI identifier oai:identifier

oai:aquila.usm.edu:masters_theses-2182