el 15(8): e3

Research Article

Digital Facial Augmentation for Interactive Entertainment

Download337 downloads
  • @ARTICLE{10.4108/icst.intetain.2015.259444,
        author={Naoto Hieda and Jeremy Cooperstock},
        title={Digital Facial Augmentation for Interactive Entertainment},
        journal={EAI Endorsed Transactions on e-Learning},
        volume={2},
        number={8},
        publisher={EAI},
        journal_a={EL},
        year={2015},
        month={8},
        keywords={projection mapping, augmented reality},
        doi={10.4108/icst.intetain.2015.259444}
    }
    
  • Naoto Hieda
    Jeremy Cooperstock
    Year: 2015
    Digital Facial Augmentation for Interactive Entertainment
    EL
    EAI
    DOI: 10.4108/icst.intetain.2015.259444
Naoto Hieda1,*, Jeremy Cooperstock1
  • 1: McGill University
*Contact email: nhieda@cim.mcgill.ca

Abstract

Digital projection technology allows for effective and entertaining spatial augmented reality applications. Leveraging the capabilities of reasonably accurate object tracking using commodity cameras and/or depth sensors to determine the 3D position and pose of objects in real time, it is possible to project dynamic graphical content on arbitrary surfaces, such as a person’s face. Coupling these capabilities with a simple drawing application, participants can have the experience of "painting" on someone’s face, or even on their own, by observing the projection in a mirror. Similarly, integrating 2D rigid-body, fluid and gravity simulation, one may interact with virtual objects projected on their own face or body.