Research Article
A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications
@INPROCEEDINGS{10.4108/icst.intetain.2015.259629, author={Federico Manuri and Giovanni Piumatti}, title={A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications}, proceedings={7th International Conference on Intelligent Technologies for Interactive Entertainment}, publisher={IEEE}, proceedings_a={INTETAIN}, year={2015}, month={8}, keywords={augmented reality hybrid user interface human-computer interaction speech recognition gesture recognition}, doi={10.4108/icst.intetain.2015.259629} }- Federico Manuri
Giovanni Piumatti
Year: 2015
A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications
INTETAIN
ICST
DOI: 10.4108/icst.intetain.2015.259629
Abstract
Augmented Reality (AR) applications are nowadays largely diffused in many fields of use, especially for entertainment, and the market of AR applications for mobile devices grows faster and faster. Moreover, new and innovative hardware for human-computer interaction has been deployed, such as the Leap Motion Controller. This paper presents some preliminary results in the design and development of a hybrid interface for hand-free augmented reality applications. The paper introduces a framework to interact with AR applications through a speech and gesture recognition-based interface. A Leap Motion Controller is mounted on top of AR glasses and a speech recognition module completes the system. Results have shown that, using the speech or the gesture recognition modules singularly, the robustness of the user interface is strongly dependent on environmental conditions. On the other hand, a combined usage of both modules can provide a more robust input.