Research Article
MappEMG: Enhancing Music Pedagogy by Mapping Electromyography to Multimodal Feedback
@INPROCEEDINGS{10.1007/978-3-031-55312-7_24, author={Ziyue Piao and Marcelo M. Wanderley and Felipe Verdugo}, title={MappEMG: Enhancing Music Pedagogy by Mapping Electromyography to Multimodal Feedback}, proceedings={ArtsIT, Interactivity and Game Creation. 12th EAI International Conference, ArtsIT 2023, S\"{a}o Paulo, Brazil, November 27-29, 2023, Proceedings, Part II}, proceedings_a={ARTSIT PART 2}, year={2024}, month={3}, keywords={Music Pedagogy Electromyography STEAM Multimodal Interaction Digital Musical Interfaces}, doi={10.1007/978-3-031-55312-7_24} }- Ziyue Piao
Marcelo M. Wanderley
Felipe Verdugo
Year: 2024
MappEMG: Enhancing Music Pedagogy by Mapping Electromyography to Multimodal Feedback
ARTSIT PART 2
Springer
DOI: 10.1007/978-3-031-55312-7_24
Abstract
Music learning and practice may be enhanced by the use of biofeedback based on both learners’ and teachers’ muscle activity, an essential component of music performance typically unavailable to listeners. By incorporating haptic vibrations, MappEMG enables the audience to experience the performers’ muscle effort. This paper updates the MappEMG system to make muscle effort explicit in music lessons. We integrated a low-cost EMG system (BITalino MuscleBIT) and modified processing, communication, and mobile application modules. We conducted a series of experimental teaching workshops where a piano professor guided beginner and intermediate piano students with the updated MappEMG. Four interaction scenarios with MappEMG were identified from these workshops, and we gathered feedback on the initial effectiveness of using MappEMG in music pedagogy.
