Please read the White Paper Copyright Notice

Download
WHP153 0.4 Mb

BBC R&D White Paper WHP153

A Bayesian Framework for Simultaneous Matting and 3D Reconstruction
J.-Y. Guillemaut, A. Hilton, J. Starck, J. Kilner, O. Grau

Keywords
3D reconstruction, segmentation, image-based rendering

Abstract
Conventional approaches to 3D scene reconstruction often treat matting and reconstruction as two separate problems, with matting a prerequisite to reconstruction. The problem with such an approach is that it requires taking irreversible decisions at the first stage, which may translate into reconstruction errors at the second stage. In this paper, we propose an approach which attempts to solve both problems jointly, thereby avoiding this limitation. A general Bayesian formulation for estimating opacity and depth with respect to a reference camera is developed. In addition, it is demonstrated that in the special case of binary opacity values (background/foreground) and discrete depth values, a global solution can be obtained via a single graph-cut computation. We demonstrate the application of the method to novel view synthesis in the case of a large-scale outdoor scene. An experimental comparison with a two–stage approach based on chroma–keying and shape–from–silhouette illustrates the advantages of the new method.

This document was originally published in Proc. of The 6th International Conference on 3–D Digital Imaging and Modeling (3DIM’07), August 21–23, 2007, Montréal, Québec, Canada.