HearThere : infrastructure for ubiquitous augmented-reality audio

This thesis presents HearThere, a system to present spatial audio that preserves alignment between the virtual audio sources and the user's environment. HearThere creates an auditory augmented reality with minimal equipment required for the user. Sound designers can create large-scale experiences to sonify a city with no infrastructure required, or by installing tracking anchors can take advantage of sub-meter location information to create more refined experiences. Audio is typically presented to listeners via speakers or headphones. Speakers make it extremely difficult to control what sound reaches each ear, which is necessary for accurately spatializing sounds. Headphones make it trivial to send separate left and right channels, but discard the relationship between the head the the rest of the world, so when the listener turns their head the whole world rotates with them. Head-tracking headphone systems have been proposed and implemented as a best of both worlds solution, but typically only operate within a small detection area (e.g. Oculus Rift) or with coarse-grained accuracy (e.g. GPS) that makes up-close interactions impossible. HearThere is a multi-technology solution to bridge this gap and provide large-area and outdoor tracking that is precise enough to imbue nearby objects with virtual sound that maintains the spatial persistence as the user moves throughout the space. Using bone-conduction headphones that don't occlude the ears along with this head tracking will enable true auditory augmented reality, where real and virtual sounds can be seamlessly mixed.

Department dc:contributor.department

Program in Media Arts and Sciences (Massachusetts Institute of Technology)

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2015

Author dc:creator

• Russell, Spencer (Spencer Franklin)

Advisor dc:contributor.advisor

• Joseph A. Paradiso.

• Architecture. Program in Media Arts and Sciences.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/101826

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/101826