Research Article
Sound Waves Gesture Recognition for Human-Computer Interaction
@INPROCEEDINGS{10.1007/978-3-319-29236-6_5, author={Nguyen Binh}, title={Sound Waves Gesture Recognition for Human-Computer Interaction}, proceedings={Context-Aware Systems and Applications. 4th International Conference, ICCASA 2015, Vung Tau, Vietnam, November 26-27, 2015, Revised Selected Papers}, proceedings_a={ICCASA}, year={2016}, month={4}, keywords={In-air gesture sensing Doppler effect Interaction technique}, doi={10.1007/978-3-319-29236-6_5} }- Nguyen Binh
Year: 2016
Sound Waves Gesture Recognition for Human-Computer Interaction
ICCASA
Springer
DOI: 10.1007/978-3-319-29236-6_5
Abstract
Gestures, a natural language of humans, provide an intuitive and effortless interface for communication with the computers. However, the achievements do not satisfy researcher’s demands because of the complexity and instability of human gestures. We propose a new method to recognize gestures from sound waves. The main contribution of this paper is to recognize gestures based on the analysis of short-time Fourier transforms (STFT) using the Doppler effect to sense gestures. To do this, we generate an inaudible tone, which gets frequency-shifted when it reflects off moving objects like the hand. We measure this shift with the microphone to infer various gestures. Experimenting method and evaluating results by using the hand gestures of many different people to browse applications such as website, document and images in the browser on the computers in the classroom and library environment for accurate results. In addition, we describe the phenomena and recognition algorithm, demonstrate a variety of gestures, and present an informal evaluation on the robustness of this approach across Laptop device and people.