Interactivity, Game Creation, Design, Learning, and Innovation. 6th International Conference, ArtsIT 2017, and Second International Conference, DLI 2017, Heraklion, Crete, Greece, October 30–31, 2017, Proceedings

Research Article

Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time

  • @INPROCEEDINGS{10.1007/978-3-319-76908-0_39,
        author={Markos Fragkopoulos and Athanasios Malamos and Spyros Panagiotakis},
        title={Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time},
        proceedings={Interactivity, Game Creation, Design, Learning, and Innovation. 6th International Conference, ArtsIT 2017, and Second International Conference, DLI 2017, Heraklion, Crete, Greece, October 30--31, 2017, Proceedings},
        proceedings_a={ARTSIT 2017 AND DLI},
        year={2018},
        month={3},
        keywords={Web audio Javascript HTML5 Pitch detection Onset detection MIDI},
        doi={10.1007/978-3-319-76908-0_39}
    }
    
  • Markos Fragkopoulos
    Athanasios Malamos
    Spyros Panagiotakis
    Year: 2018
    Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time
    ARTSIT 2017 AND DLI
    Springer
    DOI: 10.1007/978-3-319-76908-0_39
Markos Fragkopoulos1,*, Athanasios Malamos1,*, Spyros Panagiotakis1,*
  • 1: Media, Networks and Communications Lab, Department of Informatics Engineering
*Contact email: exog3n@gmail.com, amalamos@ie.teicrete.gr, spanag@ie.teicrete.gr

Abstract

Note recognizer is an online web application. In order to overcome the performance issues of the internet infrastructure (browser, devices, OS platforms) traditional algorithms have been re-designed and novel processes based on the Web Audio API have been implemented. It is the first time that open standard web tools offered in all the commercial browsers are used to build an application that usually required dedicated signal processing libraries. These novel processes and algorithms provide MIDI (Musical Instrument Digital Interface) information out of audio files or microphone. Our application may assist musical education by allowing students to transform their inspiration or a performance into notes.