Intelligent Technologies for Interactive Entertainment. 4th International ICST Conference, INTETAIN 2011, Genova, Italy, May 25-27, 2011, Revised Selected Papers

Research Article

Automatic Recognition of Affective Body Movement in a Video Game Scenario

Download
334 downloads
  • @INPROCEEDINGS{10.1007/978-3-642-30214-5_17,
        author={Nikolaos Savva and Nadia Bianchi-Berthouze},
        title={Automatic Recognition of Affective Body Movement in a Video Game Scenario},
        proceedings={Intelligent Technologies for Interactive Entertainment. 4th International ICST Conference, INTETAIN 2011, Genova, Italy, May 25-27, 2011, Revised Selected Papers},
        proceedings_a={INTETAIN},
        year={2012},
        month={10},
        keywords={Body movement automatic emotion recognition exertion game},
        doi={10.1007/978-3-642-30214-5_17}
    }
    
  • Nikolaos Savva
    Nadia Bianchi-Berthouze
    Year: 2012
    Automatic Recognition of Affective Body Movement in a Video Game Scenario
    INTETAIN
    Springer
    DOI: 10.1007/978-3-642-30214-5_17
Nikolaos Savva1,*, Nadia Bianchi-Berthouze1,*
  • 1: University College London
*Contact email: nikolaos.savva.09@ucl.ac.uk, n.berthouze@ucl.ac.uk

Abstract

This study aims at recognizing the affective states of players from non-acted, non-repeated body movements in the context of a video game scenario. A motion capture system was used to collect the movements of the participants while playing a Nintendo Wii tennis game. Then, a combination of body movement features along with a machine learning technique was used in order to automatically recognize emotional states from body movements. Our system was then tested for its ability to generalize to new participants and to new body motion data using a sub-sampling validation technique. To train and evaluate our system, online evaluation surveys were created using the body movements collected from the motion capture system and human observers were recruited to classify them into affective categories. The results showed that observer agreement levels are above chance level and the automatic recognition system achieved recognition rates comparable to the observers’ benchmark.