Resynthesizing reality : driving vivid virtual environments from sensor networks

The rise of ubiquitous sensing enables the harvesting of massive amounts of data from the physical world. This data is often used to drive the behavior of devices, but when presented to users, it is most commonly visualized quantitatively, as graphs and charts. Another approach for the representation of sensor network data presents the data within a rich, virtual environment. This thesis introduces the concept of Resynthesizing Reality through the construction of Doppelmarsh, the virtual counterpart of a real marsh located in Plymouth Massachusetts, where the Responsive Environments Group has deployed and maintained a network of environmental sensors. By freely exploring such environments, users gain a vivid, multi-modal, and experiential perspective into large, multi-dimensional datasets. We present a variety of approaches to manifesting data in "avatar landscape", including landscapes generated off live video, tinting frames in correspondence with temperature, or representing sensor history in the appearance and behavior of animals. The concept of virtual lenses is also introduced, which makes it easy to dynamically switch sensor-to-reality mapping from within virtual environments. In this thesis, we describe the implementation and design of Doppelmarsh, present techniques to visualize sensor data within virtual environments, and discuss potential applications for Resynthesizing Reality.

Department dc:contributor.department

Program in Media Arts and Sciences (Massachusetts Institute of Technology)

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2018

Author dc:creator

• Haddad, Don Derek

Advisor dc:contributor.advisor

• Joseph A. Paradiso.

• Program in Media Arts and Sciences ()

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/115728

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/115728