Interactivity, Game Creation, Design, Learning, and Innovation. 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2–3, 2016, Proceedings

Research Article

Emotion Index of Cover Song Music Video Clips Based on Facial Expression Recognition

Download
191 downloads
  • @INPROCEEDINGS{10.1007/978-3-319-55834-9_29,
        author={Georgios Kavalakis and Nikolaos Vidakis and Georgios Triantafyllidis},
        title={Emotion Index of Cover Song Music Video Clips Based on Facial Expression Recognition},
        proceedings={Interactivity, Game Creation, Design, Learning, and Innovation. 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, May 2--3, 2016, Proceedings},
        proceedings_a={ARTSIT \& DLI},
        year={2017},
        month={3},
        keywords={Facial expression recognition SIFT Cover song video clips},
        doi={10.1007/978-3-319-55834-9_29}
    }
    
  • Georgios Kavalakis
    Nikolaos Vidakis
    Georgios Triantafyllidis
    Year: 2017
    Emotion Index of Cover Song Music Video Clips Based on Facial Expression Recognition
    ARTSIT & DLI
    Springer
    DOI: 10.1007/978-3-319-55834-9_29
Georgios Kavalakis1,*, Nikolaos Vidakis1,*, Georgios Triantafyllidis2,*
  • 1: TEI of Crete
  • 2: Aalborg University Copenhagen
*Contact email: gkavalakis@gmail.com, nv@ie.teicrete.gr, gt@create.aau.dk

Abstract

This paper presents a scheme of creating an emotion index of cover song music video clips by recognizing and classifying facial expressions of the artist in the video. More specifically, it fuses effective and robust algorithms which are employed for expression recognition, along with the use of a neural network system using the features extracted by the SIFT algorithm. Also we support the need of this fusion of different expression recognition algorithms, because of the way that emotions are linked to facial expressions in music video clips.