Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time

Markos Fragkopoulos; Athanasios Malamos; Spyros Panagiotakis

Interactivity, Game Creation, Design, Learning, and Innovation. 6th International Conference, ArtsIT 2017, and Second International Conference, DLI 2017, Heraklion, Crete, Greece, October 30–31, 2017, Proceedings

Research Article

Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time

Download

170 downloads

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.1007/978-3-319-76908-0_39,
    author={Markos Fragkopoulos and Athanasios Malamos and Spyros Panagiotakis},
    title={Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time},
    proceedings={Interactivity, Game Creation, Design, Learning, and Innovation. 6th International Conference, ArtsIT 2017, and Second International Conference, DLI 2017, Heraklion, Crete, Greece, October 30--31, 2017, Proceedings},
    proceedings_a={ARTSIT \& DLI},
    year={2018},
    month={3},
    keywords={Web audio Javascript HTML5 Pitch detection Onset detection MIDI},
    doi={10.1007/978-3-319-76908-0_39}
}

Markos Fragkopoulos
Athanasios Malamos
Spyros Panagiotakis
Year: 2018
Note Recognizer: Web Application that Assists Music Learning by Detecting and Processing Musical Characteristics from Audio Files or Microphone in Real-Time
ARTSIT & DLI
Springer
DOI: 10.1007/978-3-319-76908-0_39

Markos Fragkopoulos¹^,*, Athanasios Malamos¹^,*, Spyros Panagiotakis¹^,*

1: Media, Networks and Communications Lab, Department of Informatics Engineering

*Contact email: exog3n@gmail.com, amalamos@ie.teicrete.gr, spanag@ie.teicrete.gr

Abstract

Note recognizer is an online web application. In order to overcome the performance issues of the internet infrastructure (browser, devices, OS platforms) traditional algorithms have been re-designed and novel processes based on the Web Audio API have been implemented. It is the first time that open standard web tools offered in all the commercial browsers are used to build an application that usually required dedicated signal processing libraries. These novel processes and algorithms provide MIDI (Musical Instrument Digital Interface) information out of audio files or microphone. Our application may assist musical education by allowing students to transform their inspiration or a performance into notes.

Keywords: Web audio Javascript HTML5 Pitch detection Onset detection MIDI

Published: 2018-03-08
Appears in: SpringerLink

: http://dx.doi.org/10.1007/978-3-319-76908-0_39