Intelligent Technologies for Interactive Entertainment. 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28–30, 2016, Revised Selected Papers

Research Article

A Conversational Agent that Reacts to Vocal Signals

Download130 downloads
  • @INPROCEEDINGS{10.1007/978-3-319-49616-0_29,
        author={Daniel Formolo and Tibor Bosse},
        title={A Conversational Agent that Reacts to Vocal Signals},
        proceedings={Intelligent Technologies for Interactive Entertainment. 8th International Conference, INTETAIN 2016, Utrecht, The Netherlands, June 28--30, 2016, Revised Selected Papers},
        proceedings_a={INTETAIN},
        year={2017},
        month={1},
        keywords={Virtual agents Social skills training Speech analysis Vocal signals Emotions},
        doi={10.1007/978-3-319-49616-0_29}
    }
    
  • Daniel Formolo
    Tibor Bosse
    Year: 2017
    A Conversational Agent that Reacts to Vocal Signals
    INTETAIN
    Springer
    DOI: 10.1007/978-3-319-49616-0_29
Daniel Formolo1,*, Tibor Bosse1,*
  • 1: VU University Amsterdam
*Contact email: d.formolo@vu.nl, t.bosse@vu.nl

Abstract

Conversational agents are increasingly being used for training of social skills. One of their most important benefits is their ability to provide natural interaction with humans. This work proposes to extend conversational agents’ benefits for social skills training by analysing the emotion conveyed by the user’s speech. For that, we developed a new system that captures emotions from human voice and, combined with the context of a particular situation, uses this to influence the internal state of the agent and change its behaviour. An example of the system’s use is shown and its limitations and advantages are discussed, together with the internal workflow of the system.