Research Article
Real-Time Dynamic Digital Scenography: An Electronic Opera as a Use Case
@INPROCEEDINGS{10.1007/978-3-030-95531-1_11, author={C\^{a}tia Ro\`{e}a and Carlos Alberto Augusto and S\^{e}rgio M. Rebelo and Pedro Martins}, title={Real-Time Dynamic Digital Scenography: An Electronic Opera as a Use Case}, proceedings={ArtsIT, Interactivity and Game Creation. Creative Heritage. New Perspectives from Media Arts and Artificial Intelligence. 10th EAI International Conference, ArtsIT 2021, Virtual Event, December 2-3, 2021, Proceedings}, proceedings_a={ARTSIT}, year={2022}, month={2}, keywords={Scenography Computer vision Interaction}, doi={10.1007/978-3-030-95531-1_11} }- Cátia Roça
Carlos Alberto Augusto
Sérgio M. Rebelo
Pedro Martins
Year: 2022
Real-Time Dynamic Digital Scenography: An Electronic Opera as a Use Case
ARTSIT
Springer
DOI: 10.1007/978-3-030-95531-1_11
Abstract
In scenography, digital media has been increasingly used to design richer and more immersive experiences, for example, using video mapping or holographic projection. However, such technologies may sometimes collide with the natural (and sometimes unavoidable) improvisation moments of live interpretation. Thus, to ensure the control of these effects, large technical teams are often needed in the production of such events, which may become unfeasible in smaller size productions with smaller budgets. To test possible solutions to this problem, we endorsed the creation of an interactive low-budget scenario for the electronic operaTMIE, Standing on the Threshold of the Outside World, by the composer Carlos Alberto Augusto. To accomplish that, image projection techniques are combined with software to create scenarios that are capable of dynamically changing during the opera and interact with artists in real-time. This paper presents some of the experiments done so far, such as a set of interactive digital effects automatically controlled using computer vision, and simple software to manually control or time the sequence of effects during the show. Then, we discuss the potential of these techniques aimed at enabling the generation of atypical graphic solutions for live shows, as well as the practicality of having a user interface to easily manage the entry and exit times of each of the developed scenarios.
