Research Article
Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7
@INPROCEEDINGS{10.4108/eai.7-11-2023.2342940, author={Nurul Indah Mawaddah and Charlie Rolando Andrian Tamba and Donny Prasetya Hutagalung and Frans Danielius Nainggolan and Eka Mutia Lubis and Eko Rudiawan Jamzuri}, title={Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7}, proceedings={Proceedings of the 6th International Conference on Applied Engineering, ICAE 2023, 7 November 2023, Batam, Riau islands, Indonesia}, publisher={EAI}, proceedings_a={ICAE}, year={2024}, month={1}, keywords={human-robot interaction automatic speech recognition humanoid robot hri asr}, doi={10.4108/eai.7-11-2023.2342940} }- Nurul Indah Mawaddah
Charlie Rolando Andrian Tamba
Donny Prasetya Hutagalung
Frans Danielius Nainggolan
Eka Mutia Lubis
Eko Rudiawan Jamzuri
Year: 2024
Automatic Speech Recognition for Human-Robot Interaction on The Humanoid Robot Barelang 7
ICAE
EAI
DOI: 10.4108/eai.7-11-2023.2342940
Abstract
This paper proposes a Human-Robot Interaction (HRI) system through voice commands. The study used the Barelang 7 humanoid dancing robot platform comprising 29 Degrees of Freedom (DoF). Automatic Speech Recognition (ASR) was developed using Python programming language and the VOSK Offline Speech Recognition toolkit to recognize five instructions spoken by random speakers. The voice recognition results in ASR are then sent to the robot via serial communication to realize movements according to spoken instructions. From tests conducted on five speakers randomly with 100 attempts, a Word Error Rate (WER) value of 0.096 was obtained. Meanwhile, testing the entire HRI system achieved a success rate of 92%. These results indicate that the HRI system has been successfully implemented on humanoid robots, although there are still some errors in the ASR system, that affect the overall performance of the HRI system. The results of this research contribute to the research and development of HRI systems, especially in humanoid robots, which are still not widely studied.