Intelligent Technologies for Interactive Entertainment. 9th International Conference, INTETAIN 2017, Funchal, Portugal, June 20-22, 2017, Proceedings

Research Article

AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression

Download
252 downloads
  • @INPROCEEDINGS{10.1007/978-3-319-73062-2_5,
        author={Bastian Dewitz and Roman Wiche and Chris Geiger and Frank Steinicke and Jochen Feitsch},
        title={AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression},
        proceedings={Intelligent Technologies for Interactive Entertainment. 9th International Conference, INTETAIN 2017, Funchal, Portugal, June 20-22, 2017, Proceedings},
        proceedings_a={INTETAIN},
        year={2018},
        month={2},
        keywords={Musical human-computer interaction Haptic and force feedback devices Interactive sound art and installations Novel controllers and interfaces for musical expression Continuous tangible user interfaces On-body interaction Spatial user interface Projection mapping},
        doi={10.1007/978-3-319-73062-2_5}
    }
    
  • Bastian Dewitz
    Roman Wiche
    Chris Geiger
    Frank Steinicke
    Jochen Feitsch
    Year: 2018
    AR Sound Sandbox: A Playful Interface for Musical and Artistic Expression
    INTETAIN
    Springer
    DOI: 10.1007/978-3-319-73062-2_5
Bastian Dewitz1,*, Roman Wiche1,*, Chris Geiger1,*, Frank Steinicke2,*, Jochen Feitsch1,*
  • 1: Duesseldorf University of Applied Sciences
  • 2: University of Hamburg
*Contact email: bastian.dewitz@hs-duesseldorf.de, roman.w92@web.de, geiger@hs-duesseldorf.de, steinicke@informatik.uni-hamburg.de, jochen.feitsch@hs-duesseldorf.de

Abstract

In this paper we introduce a novel interface combining spatial and continuous tangible interaction for creating and manipulating audio-visual effects. Our goal is to provide a ready-to-use, “hands-on” interface that does not need protracted explanation to the user, yet provides possibilities for expression. Therefore, our interface exploits the three-dimensional topology of physical sand, which is distributed over a tabletop surface. We discovered, that users of the system were engaged by the natural interaction and playful manner of the installation, as it resembles the play in a sandbox. We demonstrate an artistic setup that produces ambient soundscapes using a Lattice Boltzmann based particle simulation running through a deformable landscape. Visual feedback is front-projected onto the sand as well as the user’s hand. The user can explore and change the landscape by using his or her hands and use spatial gestures via on-body projection to control AR content and further settings. The focus of this work lies on the simultaneous interaction with sand and the user’s own body, and it’s contribution to audio-visual installations.