Using surface particles to interact with complex everyday surfaces

Tomorrow's display and interaction technology will go beyond standard computer monitors, television and mobile screens and will enable projecting digital content onto any complex physical surface. While devices like the IPod and IPad have received tremendous commercial success, the interaction capabilities for users are still limited to a small mobile screen. As projectors continue to decrease in size, cost and power consumption, projection technology has the potential to become as ubiquitous as the standard television or digital cameras in our mobile devices. With this potential comes the opportunity to transform everyday passive objects into interactive display surfaces, freeing content from the confines of a flat monitor display. In this thesis, I explore interacting with everyday objects by representing content as interactive surface particles. Users can build their own physical world, map virtual content onto their physical construction and interact directly with surface using a stylus. While researchers have explored using projectors for interacting with surfaces in our environment, many of these displays are still relegated to walls, tabletop surfaces or simplistic scenes. Furthermore, even fewer research projects describe methods for content creation on complex physical objects. By using a surface particle representation, interaction designers can create programmed content that is independent of the display object and is reusable on many surfaces. I present a detailed description of the surface particle representation though a projector-camera system that acquires the object geometry and enables direct interaction though an infrared tracked stylus. I also demonstrate three motivating examples each displayed on three example surfaces and discuss a set of interaction techniques that show possible avenues for structuring interaction on complex everyday objects.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2011

Author dc:creator

• Sodhi, Rajinder S.

Contributors dc:contributor

• Campbell, Roy H.

• Spatial Augmented Reality
• Projector Camera Systems
• Structured Light
• Surface Particles
• Surface Adaptive Graphical User Interface (GUI)

Statement dc:rights

• Copyright 2010 Rajinder Singh Sodhi

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/18476

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/18476