Situated mappings : augmented-reality clay and adaptive interfacing

Our collectively developed methods of structuring information through graphical and natural user interfaces (GUI, NUI) largely emphasize visual and visuo-spatial representation over other types of sensory information. As our interfaces continue to develop we seem to select for fidelity of visual stimulation, while neglecting the behavioral aspects of physical materiality. In this thesis, I advocate for the use of expressive mediums of material engagement as part of the design of interaction within interfaces. I present an approach to interfacing using Computer-Mediated Material Interaction (CMMI), by augmenting the visual appearance and behavior of clay. This approach considers the subject's situated learning as the crucial factor in building coherent and immersive interfacing. Taking precedents from the domains of perceptual science and cognitive ecology, such as information-search, affordances and adaptive learning, I suggest that the sense of immersion and ease of learning in an interaction stems from how much it supports the subject's self-guided, iterative, discovery process. To illustrate this approach, I present a series of oil clay augmented-reality prototypes that encourage situated mappings to be discovered by the subject. I also discuss how interface design could further honor the adaptive principles latent in human-material-interactions.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Architecture.

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2016

Author dc:creator

• Litman-Cleper, Julia

Advisor dc:contributor.advisor

• Terry Knight and Ruth Rosenholtz.

• Architecture.

Statement dc:rights

• M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/106417

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/106417