amsys 16(12): e1

Research Article

Low-cost Gaze and Pulse Analysis using RealSense

Download1074 downloads
  • @ARTICLE{10.4108/eai.14-10-2015.2261657,
        author={Qiang Qiu and Zhuoqing Chang and Mark Draelos and Jie Chen and Alex Bronstein and Guillermo Sapiro},
        title={Low-cost Gaze and Pulse Analysis using RealSense},
        journal={EAI Endorsed Transactions on Ambient Systems},
        keywords={gaze tracker, pulse rate, depth camera, infrared, mobile health, mental health, human computer interaction},
  • Qiang Qiu
    Zhuoqing Chang
    Mark Draelos
    Jie Chen
    Alex Bronstein
    Guillermo Sapiro
    Year: 2015
    Low-cost Gaze and Pulse Analysis using RealSense
    DOI: 10.4108/eai.14-10-2015.2261657
Qiang Qiu1,*, Zhuoqing Chang1, Mark Draelos1, Jie Chen2, Alex Bronstein3, Guillermo Sapiro1
  • 1: Duke University
  • 2: University of Oulu
  • 3: Tel Aviv University
*Contact email:


Intel’s newly-announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invariant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1cm at 20 − 30cm for the gaze tracker and 2.26bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.