A platform for reaching into the environment of a remote collaborator

In this thesis we present ShowMe++, an immersive mobile collaboration system that allows a remote user to communicate with a peer using video, audio and hand gestures. We explore the use of a Head Mounted Display (HMD), depth camera and wearable haptic devices to create a system that (1) enables a remote user to be immersed in another first-person's point of view, (2) offers a new way for the remote expert to provide guidance through three dimensional, real-time hand gestures and voice, (3) allows natural interactions with interfaces of Internet of Things (IoT) devices and (4) provides haptic feedback when interacting with remote or virtual interfaces. Using our system, both users feel present in the same physical environment and can perceive realtime communication from one another in the form of 2-handed gestures and voice. We discuss the design and implementation of the system as well as applications scenarios such as remote maintenance, 3D exploration and remote ghost presence. The user study demonstrates that hand transmission, first person point of view and immersion improve the feeling of co-presence and make remote teaching more effective.

Department dc:contributor.department

Program in Media Arts and Sciences (Massachusetts Institute of Technology)

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2016

Author dc:creator

• Benavides Palos, Xavier

Advisor dc:contributor.advisor

• Pattie Maes.

• Program in Media Arts and Sciences ()

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/106062

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/106062