Workshop on the Crowdsensing and intelligent sensing on Mobile Media Analytics

Research Article

Crowdsensing based Multi-Modal Storytelling of Urban Emergency Events using Social Media

  • @INPROCEEDINGS{10.4108/eai.18-6-2016.2264084,
        author={Zheng Xu and Hui Zhang and Yunhuai Liu and Lin Mei},
        title={Crowdsensing based Multi-Modal Storytelling of Urban Emergency Events using Social Media},
        proceedings={Workshop on the Crowdsensing and intelligent sensing on Mobile Media Analytics},
        publisher={ACM},
        proceedings_a={SMMA},
        year={2016},
        month={12},
        keywords={crowdsensing emergency events multimedia storytelling social media},
        doi={10.4108/eai.18-6-2016.2264084}
    }
    
  • Zheng Xu
    Hui Zhang
    Yunhuai Liu
    Lin Mei
    Year: 2016
    Crowdsensing based Multi-Modal Storytelling of Urban Emergency Events using Social Media
    SMMA
    ACM
    DOI: 10.4108/eai.18-6-2016.2264084
Zheng Xu1,*, Hui Zhang1, Yunhuai Liu2, Lin Mei2
  • 1: Tsinghua University
  • 2: TRIMPS
*Contact email: juven_xz@163.com

Abstract

With the development of Web 2.0, ubiquitous computing, and corresponding technologies, social media has the ability to provide the concepts of information contribution, diffusion, and exchange. Different from the permitting the general public to issue the user-generated information, social media has enabled them to avoid the need to use centralized, authoritative agencies. One of the important functions of Weibo is to monitor real time urban emergency events, such as fire, explosion, traffic jam, etc. Weibo user can be seen as social sensors and Weibo can be seen as the sensor platform. In this paper, the proposed method focuses on the step for storytelling of urban emergency events: given the Weibo posts related to a detected urban emergency event, the proposed method targets at mining the multi-modal information (e.g., images, videos, and texts), as well as storytelling the event precisely and concisely. To sum up, we propose a novel urban emergency event storytelling method to generate multi-modal summary from Weibo. Specifically, the proposed method consists of three stages: irrelevant Weibo post filtering, mining multi-modal information and storytelling generation. We conduct extensive case studies on real-world microblog datasets to demonstrate the superiority of the proposed framework.