Autonomous adaptive acoustic relay positioning

We consider the problem of maximizing underwater acoustic data transmission by adaptively positioning an autonomous mobile relay so as to learn and exploit spatial variations in channel performance. The acoustic channel is the main practical method of underwater wireless communication and improving channel throughput and reliability is key to improving the capabilities of underwater vehicles. Predicting the performance of the acoustic channel in the shallow-water environment is challenging and usually requires extensive modeling of the environment. However, a mobile relay can learn about the unknown channel as it transmits. The relay must balance searching unknown sites to gain more information, which may pay off in the future, and exploiting already-visited sites for immediate reward. This is a classic exploration vs. exploitation problem that is well-described by a multi-armed bandit formulation with an elegant solution in the form of Gittins indices. For an autonomous ocean vehicle traveling between distant waypoints, however, switching costs are significant. The multi-armed bandit with switching costs has no optimal index policy, so we have developed an adaptation of the Gittins index rule with limited policy enumeration and asymptotic performance bounds. We describe extensive shallow-water field experiments conducted in the Charles River (Boston, MA) with autonomous surface vehicles and acoustic modems, and use the field data to assess performance of the MAB decision policies and comparable heuristics. We find the switching-costs-aware algorithm offers superior real-time performance in decision-making and efficient learning of the unknown field.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Mechanical Engineering

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2013

Author dc:creator

• Cheung, Mei Yi, Ph. D. Massachusetts Institute of Technology

Advisor dc:contributor.advisor

• Franz S. Hover.

• Mechanical Engineering.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/85504

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/85504