Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences

Bernhard Reiterer; Cyril Concolato; Hermann Hellwagner

User Centric Media. First International Conference, UCMedia 2009, Venice, Italy, December 9-11, 2009, Revised Selected Papers

Research Article

Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences

Download

383 downloads

Cite: BibTeX Plain Text

@INPROCEEDINGS{10.1007/978-3-642-12630-7_10,
    author={Bernhard Reiterer and Cyril Concolato and Hermann Hellwagner},
    title={Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences},
    proceedings={User Centric Media. First International Conference, UCMedia 2009, Venice, Italy, December 9-11, 2009, Revised Selected Papers},
    proceedings_a={UCMEDIA},
    year={2012},
    month={10},
    keywords={image adaptation text analysis image annotation digital cultural heritage computer animation},
    doi={10.1007/978-3-642-12630-7_10}
}

Bernhard Reiterer
Cyril Concolato
Hermann Hellwagner
Year: 2012
Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences
UCMEDIA
Springer
DOI: 10.1007/978-3-642-12630-7_10

Bernhard Reiterer¹^,*, Cyril Concolato²^,*, Hermann Hellwagner¹^,*

1: Klagenfurt University
2: TELECOM ParisTech

*Contact email: Bernhard.Reiterer@uni-klu.ac.at, cyril.concolato@telecom-paristech.fr, Hermann.Hellwagner@uni-klu.ac.at

Abstract

We describe an approach for viewing any large, detail-rich picture on a small display by generating a video from the image, as taken by a virtual camera moving across it at varying distance. Our main innovation is the ability to build the virtual camera’s motion from a textual description of a picture, e.g., a museum caption, so that relevance and ordering of image regions are determined by co-analyzing image annotations and natural language text. Furthermore, our system arranges the resulting presentation such that it is synchronized with an audio track generated from the text by use of a text-to-speech system.

Keywords: image adaptation text analysis image annotation digital cultural heritage computer animation

Published: 2012-10-23

: http://dx.doi.org/10.1007/978-3-642-12630-7_10