E-Learning, E-Education, and Online Training. Third International Conference, eLEOT 2016, Dublin, Ireland, August 31 – September 2, 2016, Revised Selected Papers

Research Article

Holographic Signing Avatars for Deaf Education

Download69 downloads
  • @INPROCEEDINGS{10.1007/978-3-319-49625-2_7,
        author={Nicoletta Adamo-Villani and Saikiran Anasingaraju},
        title={Holographic Signing Avatars for Deaf Education},
        proceedings={E-Learning, E-Education, and Online Training. Third International Conference, eLEOT 2016, Dublin, Ireland, August 31 -- September 2, 2016, Revised Selected Papers},
        proceedings_a={ELEOT},
        year={2017},
        month={1},
        keywords={Signing avatars Deaf education Augmented reality},
        doi={10.1007/978-3-319-49625-2_7}
    }
    
  • Nicoletta Adamo-Villani
    Saikiran Anasingaraju
    Year: 2017
    Holographic Signing Avatars for Deaf Education
    ELEOT
    Springer
    DOI: 10.1007/978-3-319-49625-2_7
Nicoletta Adamo-Villani1,*, Saikiran Anasingaraju1,*
  • 1: Purdue University
*Contact email: nadamovi@purdue.edu, sanasing@purdue.edu

Abstract

The paper describes the development and initial evaluation of an Augmented Reality (AR) system aimed at improving deaf children’s competence in mathematics. The system allows for creating 3D animated avatars that translate from spoken English to Signed English (SE) in real time. The virtual sign language interpreters, displayed as 3D holograms in a mixed reality environment, can be used in the classroom to translate in real time the math lessons delivered by the teacher, at home to facilitate communication between hearing parents and deaf children, and at home or in the lab when children interact with math digital learning materials. An initial formative evaluation with deaf students, parents and educators supports the usability and usefulness of the AR system.