Please read the White Paper Copyright Notice

Download
WHP086 671 Kb

BBC R&D White Paper WHP086

A combined studio production system for 3D capturing of live action and immersive actor feedback
O. Grau, T. Pullen and G.A. Thomas

Keywords
studio system, 3D reconstruction, view-dependent projection, Virtual Reality, distributed system

Abstract
A new studio system for the production of 3D content is introduced. The system combines the ability to capture dynamic scenes, based on a multi-camera system in a chromakey environment, with a view-dependent projection for actor feedback. The system allows the generation and rendering of 3D models in preview quality for on-set visualisation in real time, and in high quality for post-production applications in an off-line phase. The shape reconstruction is based on the computation of the visual hull. The view-dependent projection component allows actors to be immersed into a virtual scene and to interact with virtual components. The functional modules of the system were implemented in a highly distributed system using standard, inexpensive IT components. Therefore the system is quite scalable and can be fitted into most studio environments. For the integration of the system components a middleware architecture was developed.

This document was originally published in IEEE Transactions on Circuits and Systems for Video Technology. Volume 14, No. 3, March 2003.