Research Article
AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression
@INPROCEEDINGS{10.1007/978-3-319-73062-2_5, author={Bastian Dewitz and Roman Wiche and Chris Geiger and Frank Steinicke and Jochen Feitsch}, title={AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression}, proceedings={Intelligent Technologies for Interactive Entertainment. 9th International Conference, INTETAIN 2017, Funchal, Portugal, June 20-22, 2017, Proceedings}, proceedings_a={INTETAIN}, year={2018}, month={2}, keywords={Musical human-computer interaction Haptic and force feedback devices Interactive sound art and installations Novel controllers and interfaces for musical expression Continuous tangible user interfaces On-body interaction Spatial user interface Projection mapping}, doi={10.1007/978-3-319-73062-2_5} }- Bastian Dewitz
Roman Wiche
Chris Geiger
Frank Steinicke
Jochen Feitsch
Year: 2018
AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression
INTETAIN
Springer
DOI: 10.1007/978-3-319-73062-2_5
Abstract
In this paper we introduce a novel interface combining spatial and continuous tangible interaction for creating and manipulating audio-visual effects. Our goal is to provide a ready-to-use, “hands-on” interface that does not need protracted explanation to the user, yet provides possibilities for expression. Therefore, our interface exploits the three-dimensional topology of physical sand, which is distributed over a tabletop surface. We discovered, that users of the system were engaged by the natural interaction and playful manner of the installation, as it resembles the play in a sandbox. We demonstrate an artistic setup that produces ambient soundscapes using a Lattice Boltzmann based particle simulation running through a deformable landscape. Visual feedback is front-projected onto the sand as well as the user’s hand. The user can explore and change the landscape by using his or her hands and use spatial gestures via on-body projection to control AR content and further settings. The focus of this work lies on the simultaneous interaction with sand and the user’s own body, and it’s contribution to audio-visual installations.