2nd International ICST Conference on Immersive Telecommunications

Research Article

3-D Video Generation using Hybrid Camera System

Download659 downloads
        author={Eun-Kyung Lee and Yun-Suk Kang and Yo-Sung Ho and Young-Kee Jung},
        title={3-D Video Generation using Hybrid Camera System},
        proceedings={2nd International ICST Conference on Immersive Telecommunications},
        keywords={3-D video generation depth camera depth estimation multiview camera},
  • Eun-Kyung Lee
    Yun-Suk Kang
    Yo-Sung Ho
    Young-Kee Jung
    Year: 2010
    3-D Video Generation using Hybrid Camera System
    DOI: 10.4108/ICST.IMMERSCOM2009.6301
Eun-Kyung Lee1,*, Yun-Suk Kang1,*, Yo-Sung Ho1,*, Young-Kee Jung2,*
  • 1: Gwangju Institute of Science and Technology (GIST), 1 Oryong-dong, Buk-gu, Gwangju, 500-712, Korea
  • 2: Honam University, Eodeungno 330, Gwangsan-gu, Gwangju, Korea
*Contact email: eklee78@gist.ac.kr, yunsuk@gist.ac.kr, hoyo@gist.ac.kr, ykjung@honam.ac.kr


In this paper, we present a new camera system combining a time-of-flight depth camera and multiple video cameras to generate a multiview video-plus-depth. In order to get the 3-D video using the hybrid camera system, we first obtain a multiview image from the multiview camera and a depth map from the depth camera. Then, initial depths of each view image are estimated by performing 3-D warping with the depth map. Thereafter, multiview depth estimation using the initial depths is carried out to get each view initial disparity map. Finally, we refine the initial disparity map using a belief propagation algorithm so that we can generate the high-quality multiview disparity map. Experimental results show that the proposed hybrid camera system produces a 3-D video with more accurate multiview depths and supports more natural 3-D views than the previous works.