Flow : a framework for reality-based interfaces

This thesis outlines the design, development and evaluation of a computer vision framework known as Flow. Flow utilizes a wearable head mounted camera to observe user interactions, providing recognition of objects, locations, people, and gestures via machine vision and understanding. This supports the creation of a hybrid interaction environment, allowing users to access digital functionality and actions based on their interactions within the physical environment. Flow highlights the potential of cross device, environment interactions by providing the architecture to connect between existing platforms and devices. Example applications scenarios are provided to evaluate the framework. Each demonstrates the versatility of the system in supporting human computer interaction and prototyping of ubiquitous systems. Insight through user feedback and a technical evaluation is also provided. The work outlined in this thesis demonstrates the potential of passive observational computer vision systems in the augmentation of user interactions and the potential for further dissolved computing environments.

Department dc:contributor.department

Program in Media Arts and Sciences (Massachusetts Institute of Technology)

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2014

Author dc:creator

• Hemsley, Robert Michael

Advisor dc:contributor.advisor

• Henry Holtzman.

• Architecture. Program in Media Arts and Sciences.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/91818

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/91818