6th International Conference on Mobile Computing, Applications and Services

Research Article

Expression: A Dyadic Conversation Aid using Google Glass for People who are Blind or Visually Impaired

Download863 downloads
  • @INPROCEEDINGS{10.4108/icst.mobicase.2014.257780,
        author={ASM Iftekhar Anam and Shahinur Alam and Mohammed Yeasin},
        title={Expression: A Dyadic Conversation Aid using Google Glass for People who are Blind or Visually Impaired},
        proceedings={6th International Conference on Mobile Computing, Applications and Services},
        publisher={IEEE},
        proceedings_a={MOBICASE},
        year={2014},
        month={11},
        keywords={wearable system visually impaired assistive technology recognition of nonverbal behaviors},
        doi={10.4108/icst.mobicase.2014.257780}
    }
    
  • ASM Iftekhar Anam
    Shahinur Alam
    Mohammed Yeasin
    Year: 2014
    Expression: A Dyadic Conversation Aid using Google Glass for People who are Blind or Visually Impaired
    MOBICASE
    IEEE
    DOI: 10.4108/icst.mobicase.2014.257780
ASM Iftekhar Anam1,*, Shahinur Alam1, Mohammed Yeasin1
  • 1: University of Memphis
*Contact email: aanam@memphis.edu

Abstract

This paper presents 'Expression' - an integrated assistive solution using Google Glass. The key function of the system is to enable the user in perceiving social signals during a natural dyadic conversation. The design and implementation of the system addressed a number of technical and research challenges - video acquisition and communication over Wi-Fi, efficient detection and tracking of faces, overheating of Google Glass, robust detection of facial features and modeling behavioral expressions, and feedback system for perceiving social signals. Performance evaluation was conducted to ensure the completeness and generalizability of models. Furthermore, usability studies were performed with ten (10) subjects (six visually impaired and four blind-folded) to illustrate the utility of the Expression. Subjective evaluation of Expression was performed using a five (5) point Likert Scale and was found to be excellent(4.383).