ct 21(27): e5

Research Article

From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields

Download2292 downloads
  • @ARTICLE{10.4108/eai.12-5-2021.169913,
        author={Nuno N. Correia and Atau Tanaka},
        title={From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields},
        journal={EAI Endorsed Transactions on Creative Technologies},
        volume={8},
        number={27},
        publisher={EAI},
        journal_a={CT},
        year={2021},
        month={5},
        keywords={user interface, toolkit, interface builder, audiovisual, cross-modal interaction},
        doi={10.4108/eai.12-5-2021.169913}
    }
    
  • Nuno N. Correia
    Atau Tanaka
    Year: 2021
    From GUI to AVUI: Situating Audiovisual User Interfaces Within Human-Computer Interaction and Related Fields
    CT
    EAI
    DOI: 10.4108/eai.12-5-2021.169913
Nuno N. Correia1,*, Atau Tanaka2
  • 1: University of Greenwich and ITI/LARSyS
  • 2: Goldsmiths, University of London
*Contact email: n.correia@greenwich.ac.uk

Abstract

INTRODUCTION: We propose AudioVisual User Interfaces (AVUI), a novel type of UI linking interaction, sound and image. It extends the concept of Graphical User Interface (GUI) by adding interconnected sound and image.

OBJECTIVES: We aim to situate AVUIs in relation to identified relevant fields: Human-Computer Interaction (HCI), sonic interaction design, cognitive psychology and audiovisual art, and to identify benefits of AVUIs inthe context of those fields.

METHODS: In this research, we combine literature review of related concepts with a user-centered design methodology, involving a community of audiovisual artists and performers.

RESULTS: We contextualize AVUI within the identified fields and identify benefits for the implementation of AVUIs in relation to those fields.

CONCLUSION: These results can contribute to the further adoption of AVUIs by the HCI community, particularly those interested in multisensory experience involving sound and image.