7th International Conference on Intelligent Technologies for Interactive Entertainment

Research Article

A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications

Download712 downloads
  • @INPROCEEDINGS{10.4108/icst.intetain.2015.259629,
        author={Federico Manuri and Giovanni Piumatti},
        title={A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications},
        proceedings={7th International Conference on Intelligent Technologies for Interactive Entertainment},
        publisher={IEEE},
        proceedings_a={INTETAIN},
        year={2015},
        month={8},
        keywords={augmented reality hybrid user interface human-computer interaction speech recognition gesture recognition},
        doi={10.4108/icst.intetain.2015.259629}
    }
    
  • Federico Manuri
    Giovanni Piumatti
    Year: 2015
    A Preliminary Study of a Hybrid User Interface for Augmented Reality Applications
    INTETAIN
    ICST
    DOI: 10.4108/icst.intetain.2015.259629
Federico Manuri1,*, Giovanni Piumatti1
  • 1: Politecnico di Torino
*Contact email: federico.manuri@polito.it

Abstract

Augmented Reality (AR) applications are nowadays largely diffused in many fields of use, especially for entertainment, and the market of AR applications for mobile devices grows faster and faster. Moreover, new and innovative hardware for human-computer interaction has been deployed, such as the Leap Motion Controller. This paper presents some preliminary results in the design and development of a hybrid interface for hand-free augmented reality applications. The paper introduces a framework to interact with AR applications through a speech and gesture recognition-based interface. A Leap Motion Controller is mounted on top of AR glasses and a speech recognition module completes the system. Results have shown that, using the speech or the gesture recognition modules singularly, the robustness of the user interface is strongly dependent on environmental conditions. On the other hand, a combined usage of both modules can provide a more robust input.