
Research Article
PirouNet: Creating Dance Through Artist-Centric Deep Learning
@INPROCEEDINGS{10.1007/978-3-031-28993-4_31, author={Mathilde Papillon and Mariel Pettee and Nina Miolane}, title={PirouNet: Creating Dance Through Artist-Centric Deep Learning}, proceedings={ArtsIT, Interactivity and Game Creation. 11th EAI International Conference, ArtsIT 2022, Faro, Portugal, November 21-22, 2022, Proceedings}, proceedings_a={ARTSIT}, year={2023}, month={4}, keywords={Deep learning Neural network Semi-supervised Generative Recurrent LSTM VAE Pose Laban}, doi={10.1007/978-3-031-28993-4_31} }
- Mathilde Papillon
Mariel Pettee
Nina Miolane
Year: 2023
PirouNet: Creating Dance Through Artist-Centric Deep Learning
ARTSIT
Springer
DOI: 10.1007/978-3-031-28993-4_31
Abstract
Using Artificial Intelligence (AI) to create dance choreography is still at an early stage. Methods that conditionally generate dance sequences remain limited in their ability to follow choreographer-specific creative direction, often relying on external prompts or supervised learning. In the same vein, fully annotated dance datasets are rare and labor intensive. To fill this gap and help leverage deep learning as a meaningful tool for choreographers, we propose “PirouNet”, a semi-supervised conditional recurrent variational autoencoder together with a dance labeling web application. PirouNet allows dance professionals to annotate data with their own subjective creative labels and subsequently generate new bouts of choreography based on their aesthetic criteria. Thanks to the proposed semi-supervised approach, PirouNet only requires a small portion of the dataset to be labeled, typically on the order of 1%. We demonstrate PirouNet’s capabilities as it generates original choreography based on the “Laban Time Effort”, an established dance notion describing a given intention for a movement’s time dynamics. We extensively evaluate PirouNet’s dance creations through a series of qualitative and quantitative metrics, validating its applicability as a tool for choreographers.