6th International ICST Conference on Communications and Networking in China

Research Article

Fusion Side Information Based on Spatio-temporal Correlation in Distributed Multi-view Video Coding

  • @INPROCEEDINGS{10.1109/ChinaCom.2011.6158123,
        author={Qing Huang and Bin Li and Yumei Wang and Lin Zhang and Yu Liu},
        title={Fusion Side Information Based on Spatio-temporal Correlation in Distributed Multi-view Video Coding},
        proceedings={6th International ICST Conference on Communications and Networking in China},
        publisher={IEEE},
        proceedings_a={CHINACOM},
        year={2012},
        month={3},
        keywords={distributed multi-view video coding side information intra-view estimation inter-view estimation fusion spatio-temporal},
        doi={10.1109/ChinaCom.2011.6158123}
    }
    
  • Qing Huang
    Bin Li
    Yumei Wang
    Lin Zhang
    Yu Liu
    Year: 2012
    Fusion Side Information Based on Spatio-temporal Correlation in Distributed Multi-view Video Coding
    CHINACOM
    IEEE
    DOI: 10.1109/ChinaCom.2011.6158123
Qing Huang1,*, Bin Li1, Yumei Wang1, Lin Zhang1, Yu Liu1
  • 1: Key Lab of Universal Wireless Communications, Ministry of Education Beijing University of Posts and Telecommunications Beijing
*Contact email: huangjiangfan@gmail.com

Abstract

Generating accurate SI is crucial to the decoding performance and the quality of reconstructed frames in distributed multi-view video coding (DMVC). There have been some fusion methods between intra-view estimation and interview estimation to get accurate SI. In this paper, we present a new fusion scheme to get more accurate SI by exploiting the spatio-temporal correlation, i.e. the inherent spatial correlation of the inter-view estimation, and the temporal correlation obtained by the feature of Motion Vector (MV) during intra-view estimation. After getting the block’s MV, the fusion scheme distinguishes the motion characteristics of this block so that it can select from triple pairs of KFs in the adjacent views to finish inter-view estimation. Then the fusion mechanism works on the temporal SI and the selected spatial SI to get the final SI. Experimental results show that up to 1.3dB of PSNR improvement can be obtained for “Ballroom” and about 1.0dB for “Exit” than the initial fusion method in [9].