Augmenting complex surfaces with projector-camera systems

Display and interaction real-estate is fundamentally limited by the size of the screen in traditional display devices. Projection-based interfaces allow interaction with appropriated, everyday, passive surfaces. Instead of restricting interaction to a single rectangle, projection-based augmented reality makes interaction ubiquitous, taking the computer out of the box. Extending interaction to almost any surface enables new possibilities in a host of new domains, including entertainment, consumer electronics, advertising, medicine and many more. Overlaying virtual elements onto complex physical surfaces under real-world conditions, presents a variety of challenges, many which are open research problems. A wealth of previous work has focused on projection onto constrained surfaces like planes, parabolic curves, etc. In this research, we explore projection onto arbitrarily complex physical surfaces. We describe a complete, practical approach embodied in a projector-camera system. Our system is constructed of low-cost, commodity hardware and demonstrates some of the exciting applications of Spatial Augmented Reality. We present a novel initial homography estimation for interactive projector-camera calibration. We introduce a unique hybrid projector pattern codification technique for improved correspondences. Finally, we present interactive surface particles, which are a surface independent content representation that enables reusable interaction with complex physical surfaces. This thesis outlines the fundamental preliminaries of projector-camera systems, the current state of the art, along with our design decisions, implementation details and results. Covered topics include camera calibration, structured light 3D scanning and surface augmentation. This work demonstrates the technical and practical feasibility of appropriating complex surfaces as information displays; hopefully encouraging a future where a display device is no longer a discrete entity, but where our environment is our display and interface.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2011

Author dc:creator

• Jones, Brett R.

Contributors dc:contributor

• Campbell, Roy H.

• spatial augmented reality
• projection mapping
• projector
• camera
• projector-camera
• interactive surface particles

Statement dc:rights

• Copyright 2010 Brett Jones

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/18407

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/18407