Research Article
Exploring the User Interaction with a Multimodal Web-Based Video Annotator
@INPROCEEDINGS{10.1007/978-3-030-99188-3_2, author={Rui Rodrigues and Rui Neves Madeira and Nuno Correia}, title={Exploring the User Interaction with a Multimodal Web-Based Video Annotator}, proceedings={Intelligent Technologies for Interactive Entertainment. 13th EAI International Conference, INTETAIN 2021, Virtual Event, December 3-4, 2021, Proceedings}, proceedings_a={INTETAIN}, year={2022}, month={3}, keywords={Multimodal interfaces Video annotations Performing arts User study HCI}, doi={10.1007/978-3-030-99188-3_2} }- Rui Rodrigues
Rui Neves Madeira
Nuno Correia
Year: 2022
Exploring the User Interaction with a Multimodal Web-Based Video Annotator
INTETAIN
Springer
DOI: 10.1007/978-3-030-99188-3_2
Abstract
People interact with their surroundings using several multimodal methods. Human-computer interaction is performed using these capabilities in order to provide, as much as possible, the most natural and productive experiences through speech, touch, vision, and gesture. The Web-based application used in this paper is a multi-platform video annotation tool that supports multimodal interaction. MotionNotes has the primary goal of fostering the creativity of both professional and amateur users. It is possible to interact with this tool using keyboard, touch, and voice, making it possible to add different types of annotations: voice, drawings, text, and marks. Furthermore, a feature of human poses identification in real-time was integrated into the annotation tool, enabling the identification of possible annotations. This paper presents and discusses results from a user study conducted to explore the user interaction with the tool, evaluating the prototype and its different interaction methods. User feedback shows that this approach to video annotation is stimulating and can enhance the user’s creativity and productivity.
