DoppelMarsh (2017)¶
Doppelmarsh from Responsive Environments on Vimeo.
DopelMarsh3¶
DoppelMarsh3 from Responsive Environments on Vimeo.
Description¶
The rise of ubiquitous sensing enables the harvesting of massive amounts of data from the physical world. This data is often used to drive the behavior of devices, but when presented to users, it is most commonly visualized quantitatively, as graphs and charts. Another approach for the representation of sensor network data presents the data within a rich, virtual environment. By freely exploring such environments, users gain a vivid, multi-modal, and experiential perspective into large, multi-dimensional datasets. We present a variety of approaches to manifesting data in “avatar landscape”, including landscapes generated off live video, representing sensor history in the appearance and behavior of animals, or tinting frames in correspondence with temperature.
The project forms part of the Tidmarsh Living Laboratory
References¶
Doppelmarsh is a cross-reality sensor data browser built for experimenting with presence and multimodal sensory experiences. Built on evolving terrain data from a physical wetland landscape, the software integrates real-time data from an environmental sensor network with real-time audio streams and other media from the site. Sensor data is rendered in the scene in both visual representations and as 3D sonification. Users can explore this data by walking on the virtual terrain in a first person view, or flying high above it. This flexibility allows Doppelmarsh to serve as an interface to other research platforms on the site, such as Quadrasense, an augmented reality UAV system that blends a flying live camera view with a virtual camera from Doppelmarsh. We are currently investigating methods for representing subsurface data, such as soil and water temperatures at depth, as well as automation in scene and terrain painting.
Doppelmarsh began in 2014 as an evolution of Doppellab, a similar effort focused on smart buildings. It has since been developed and maintained by a group of students in the Responsive Environments group, and is undergoing active development by Don Derek Haddad for his 2017 master's thesis.