3-D Video Generation using Hybrid Camera System

In this paper, we present a new camera system combining a time-of-flight depth camera and multiple video cameras to generate a multiview video-plus-depth. In order to get the 3-D video using the hybrid camera system, we first obtain a multiview image from the multiview camera and a depth map from the depth camera. Then, initial depths of each view image are estimated by performing 3-D warping with the depth map. Thereafter, multiview depth estimation using the initial depths is carried out to get each view initial disparity map. Finally, we refine the initial disparity map using a belief propagation algorithm so that we can generate the high-quality multiview disparity map. Experimental results show that the proposed hybrid camera system produces a 3-D video with more accurate multiview depths and supports more natural 3-D views than the previous works.