Research Article
Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences
413 downloads
@INPROCEEDINGS{10.1007/978-3-642-12630-7_10, author={Bernhard Reiterer and Cyril Concolato and Hermann Hellwagner}, title={Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences}, proceedings={User Centric Media. First International Conference, UCMedia 2009, Venice, Italy, December 9-11, 2009, Revised Selected Papers}, proceedings_a={UCMEDIA}, year={2012}, month={10}, keywords={image adaptation text analysis image annotation digital cultural heritage computer animation}, doi={10.1007/978-3-642-12630-7_10} }- Bernhard Reiterer
Cyril Concolato
Hermann Hellwagner
Year: 2012
Natural-Language-Based Conversion of Images to Mobile Multimedia Experiences
UCMEDIA
Springer
DOI: 10.1007/978-3-642-12630-7_10
Abstract
We describe an approach for viewing any large, detail-rich picture on a small display by generating a video from the image, as taken by a virtual camera moving across it at varying distance. Our main innovation is the ability to build the virtual camera’s motion from a textual description of a picture, e.g., a museum caption, so that relevance and ordering of image regions are determined by co-analyzing image annotations and natural language text. Furthermore, our system arranges the resulting presentation such that it is synchronized with an audio track generated from the text by use of a text-to-speech system.
Copyright © 2009–2024 ICST
