Proceedings of the 6th International Conference on Applied Engineering, ICAE 2023, 7 November 2023, Batam, Riau islands, Indonesia

Research Article

Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7

Download69 downloads
  • @INPROCEEDINGS{10.4108/eai.7-11-2023.2342940,
        author={Nurul Indah Mawaddah and Charlie Rolando Andrian Tamba and Donny Prasetya Hutagalung and Frans Danielius Nainggolan and Eka Mutia Lubis and Eko Rudiawan Jamzuri},
        title={Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7},
        proceedings={Proceedings of the 6th International Conference on Applied Engineering, ICAE 2023, 7 November 2023, Batam, Riau islands, Indonesia},
        publisher={EAI},
        proceedings_a={ICAE},
        year={2024},
        month={1},
        keywords={human-robot interaction automatic speech recognition humanoid robot hri asr},
        doi={10.4108/eai.7-11-2023.2342940}
    }
    
  • Nurul Indah Mawaddah
    Charlie Rolando Andrian Tamba
    Donny Prasetya Hutagalung
    Frans Danielius Nainggolan
    Eka Mutia Lubis
    Eko Rudiawan Jamzuri
    Year: 2024
    Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7
    ICAE
    EAI
    DOI: 10.4108/eai.7-11-2023.2342940
Nurul Indah Mawaddah1,*, Charlie Rolando Andrian Tamba1, Donny Prasetya Hutagalung1, Frans Danielius Nainggolan1, Eka Mutia Lubis1, Eko Rudiawan Jamzuri1
  • 1: Politeknik Negeri Batam
*Contact email: nurulindah1504@gmail.com

Abstract

This paper proposes a Human-Robot Interaction (HRI) system through voice commands. The study used the Barelang 7 humanoid dancing robot platform comprising 29 Degrees of Freedom (DoF). Automatic Speech Recognition (ASR) was developed using Python programming language and the VOSK Offline Speech Recognition toolkit to recognize five instructions spoken by random speakers. The voice recognition results in ASR are then sent to the robot via serial communication to realize movements according to spoken instructions. From tests conducted on five speakers randomly with 100 attempts, a Word Error Rate (WER) value of 0.096 was obtained. Meanwhile, testing the entire HRI system achieved a success rate of 92%. These results indicate that the HRI system has been successfully implemented on humanoid robots, although there are still some errors in the ASR system, that affect the overall performance of the HRI system. The results of this research contribute to the research and development of HRI systems, especially in humanoid robots, which are still not widely studied.