sg 15(5): e4

Research Article

An Open Platform for Full Body Interactive Sonification Exergames

Download1031 downloads
  • @ARTICLE{10.4108/icst.intetain.2015.259584,
        author={Simone Ghisio and Paolo Coletta and Stefano Piana and Paolo Alborno and Gualtiero Volpe and Antonio Camurri and Ludovica Primavera and Carla Ferrari and Carla Guenza and Paolo Moretti and Valeria Bergamaschi and Andrea Ravaschio},
        title={An Open Platform for Full Body Interactive Sonification Exergames},
        journal={EAI Endorsed Transactions on Serious Games},
        keywords={rehabilitation, exergames, multimodal analysis},
  • Simone Ghisio
    Paolo Coletta
    Stefano Piana
    Paolo Alborno
    Gualtiero Volpe
    Antonio Camurri
    Ludovica Primavera
    Carla Ferrari
    Carla Guenza
    Paolo Moretti
    Valeria Bergamaschi
    Andrea Ravaschio
    Year: 2015
    An Open Platform for Full Body Interactive Sonification Exergames
    DOI: 10.4108/icst.intetain.2015.259584
Simone Ghisio1, Paolo Coletta1, Stefano Piana1, Paolo Alborno1,*, Gualtiero Volpe1, Antonio Camurri1, Ludovica Primavera2, Carla Ferrari2, Carla Guenza2, Paolo Moretti2, Valeria Bergamaschi2, Andrea Ravaschio2
  • 1: University of Genoa
  • 2: Inst G. Gaslini
*Contact email:


This paper addresses the use of a remote interactive platform to support home-based rehabilitation for children with motor and cognitive impairment. The interaction between user and platform is achieved on customizable full-body interactive serious games (exergames). These exergames perform real-time analysis of multimodal signals to quantify movement qualities and postural attitudes. Interactive sonification of movement is then applied for providing a real-time feedback based on “aesthetic resonance” and engagement of the children. The games also provide log file recordings therapists can use to assess the performance of the children and the effectiveness of the games. The platform allows the customization of the games to address the children’s needs. The platform is based on the EyesWeb XMI software, and the games are designed for home usage, based on Kinect for Xbox One and simple sensors including 3-axis accelerometers available in low-cost Android smartphones.