Industrial Networks and Intelligent Systems. Second International Conference, INISCOM 2016, Leicester, UK, October 31 – November 1, 2016, Revised Selected Papers

Research Article

Walking into Panoramic and Immersive 3D Video

  • @INPROCEEDINGS{10.1007/978-3-319-52569-3_12,
        author={Yingbin Nie and Jianmin Jiang},
        title={Walking into Panoramic and Immersive 3D Video},
        proceedings={Industrial Networks and Intelligent Systems. Second International Conference, INISCOM 2016, Leicester, UK, October 31 -- November 1, 2016, Revised Selected Papers},
        proceedings_a={INISCOM},
        year={2017},
        month={6},
        keywords={Panoramic 3D videos Free-view video processing Dynamic video playback Video stitching Fake-3D True-3D Virtual reality},
        doi={10.1007/978-3-319-52569-3_12}
    }
    
  • Yingbin Nie
    Jianmin Jiang
    Year: 2017
    Walking into Panoramic and Immersive 3D Video
    INISCOM
    Springer
    DOI: 10.1007/978-3-319-52569-3_12
Yingbin Nie1,*, Jianmin Jiang1,*
  • 1: Shenzhen University
*Contact email: nyb1992@gmail.com, jianmin.jiang@szu.edu.cn

Abstract

To enable viewers to perceive the video content as if he or she is walking inside the video scenes, we need to have two essential video technologies. One is to present the audience with panoramic videos with 360°, and the other is view-adaptive video playback, i.e. presenting video scenes in accordance with the change of viewing angles. For the first technology, we propose a fast video stitching algorithm via exploiting the audio information for frame synchronization, and for the second, we propose a Fake-3D and True-3D mix method to immerse viewers inside the video scene via its dynamic playback of panoramic videos, adaptive to multi-view changes. Our proposed technologies have great potential in practical applications, such as virtual reality gaming and new concept movie shows etc.