2nd International ICST Conference on Immersive Telecommunications

Research Article

Depth image-based rendering from multiple cameras with 3D propagation algorithm

Download615 downloads
  • @INPROCEEDINGS{10.4108/immerscom.2009.13,
        author={Quang H. Nguyen and Minh N. Do and Sanjay J. Patel},
        title={Depth image-based rendering from multiple cameras with 3D propagation algorithm},
        proceedings={2nd International ICST Conference on Immersive Telecommunications},
        publisher={ICST},
        proceedings_a={IMMERSCOM},
        year={2010},
        month={5},
        keywords={Depth image-based rendering massively parallel architecture bilateral filtering},
        doi={10.4108/immerscom.2009.13}
    }
    
  • Quang H. Nguyen
    Minh N. Do
    Sanjay J. Patel
    Year: 2010
    Depth image-based rendering from multiple cameras with 3D propagation algorithm
    IMMERSCOM
    ICST
    DOI: 10.4108/immerscom.2009.13
Quang H. Nguyen1,*, Minh N. Do1,*, Sanjay J. Patel1,*
  • 1: Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign
*Contact email: qnguyen2@illinois.edu, minhdo@illinois.edu, sjp@illinois.edu

Abstract

This paper proposes a new 3D propagation algorithm for the depth image-based rendering problem with multiple color and range cameras at arbitrary positions. The proposed algorithm efficiently renders novel images at arbitrary virtual views by propagating all available depth information from range cameras to color cameras, and then all available depth and color information from color cameras to the virtual views. Furthermore, the algorithm significantly enhances the propagated depth images by applying a new occlusion removal method and a new depth-color bilateral filtering. The paper also describes the parallelism structure of our algorithm and outlines a mapping onto massively parallel architectures such as general-purpose graphics processing units (GPGPUs). Experimental results show that the proposed algorithm provides good rendering quality while staying within computational bounds for real-time applications.