Towards a multimodal Ouija Board for aircraft carrier deck operations

In this thesis, I present DeckAssistant, a novel interface for planning aircraft carrier deck operations. DeckAssistant is an intelligent, multimodal aircraft carrier Ouija Board. DeckAssistant's design is inspired by traditional Ouija Boards, featuring a large digital tabletop display with a scale model of an aircraft carrier deck and aircraft. Users plan aircraft operations by using this interface to mock situations on deck. Unlike traditional Ouija Board technology, DeckAssistant is designed to contribute to the planning process. We enable DeckAssistant with a basic understanding of deck operations and add multimodal functionality to our system. Users manipulate our model of the deck by issuing commands using speech and gestures. The system responds to users with its own synthesized speech and graphics. The result is a conversation of sorts between users and the Ouija Board as they work together to accomplish tasks.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2015

Author dc:creator

• Acquah, Kojo (Kojo F.)

Advisor dc:contributor.advisor

• Randall Davis.

• Electrical Engineering and Computer Science.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/100330

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/100330