Mobile Lifelogger – Recording, Indexing, and Understanding a Mobile User’s Life

Snehal Chennuru; Peng-Wen Chen; Jiang Zhu; Joy Zhang

Mobile Computing, Applications, and Services. Second International ICST Conference, MobiCASE 2010, Santa Clara, CA, USA, October 25-28, 2010, Revised Selected Papers

Research Article

Mobile Lifelogger – Recording, Indexing, and Understanding a Mobile User’s Life

Download

477 downloads

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.1007/978-3-642-29336-8_15,
    author={Snehal Chennuru and Peng-Wen Chen and Jiang Zhu and Joy Zhang},
    title={Mobile Lifelogger -- Recording, Indexing, and Understanding a Mobile User’s Life},
    proceedings={Mobile Computing, Applications, and Services. Second International ICST Conference, MobiCASE 2010, Santa Clara, CA, USA, October 25-28, 2010, Revised Selected Papers},
    proceedings_a={MOBICASE},
    year={2012},
    month={10},
    keywords={Lifelogger activity language mobile computing indexing heterogenous data},
    doi={10.1007/978-3-642-29336-8_15}
}

Snehal Chennuru
Peng-Wen Chen
Jiang Zhu
Joy Zhang
Year: 2012
Mobile Lifelogger – Recording, Indexing, and Understanding a Mobile User’s Life
MOBICASE
Springer
DOI: 10.1007/978-3-642-29336-8_15

Snehal Chennuru¹^,*, Peng-Wen Chen¹^,*, Jiang Zhu¹^,*, Joy Zhang¹^,*

1: Carnegie Mellon University

*Contact email: snehal.chennuru@sv.cmu.edu, pengwen.chen@sv.cmu.edu, jiang.zhu@sv.cmu.edu, joy.zhang@sv.cmu.edu

Abstract

Lifelog system involves capturing personal experiences in the form of digital multimedia during an entire lifespan. Recent advancements in mobile sensor technologies have helped to develop these systems using commercial smart phones. These systems have the potential to act as a secondary memory and also aid people who struggle with episodic memory impairment (EMI). Despite their huge potential, there are major challenges that need to be addressed to make them useful. One of them is how to index the inherently large lifelog data so that the person can efficiently retrieve the log segments that interest him / her most. In this paper, we present an ongoing research of using mobile phones to record and index lifelogs using activity language. By converting sensory data such as accelerometer and GPS readings into activity language, we are able to apply statistical natural language processing techniques to index, recognize, segment, cluster, retrieve, and infer high-level semantic meanings of the collected lifelogs. Based on this indexing approach, our lifelog system supports easy retrieval of log segments representing past similar activities and automatic lifelog segmentation for efficient browsing and activity summarization.

Keywords: Lifelogger activity language mobile computing indexing heterogenous data

Published: 2012-10-17

: http://dx.doi.org/10.1007/978-3-642-29336-8_15