A new studio system for the production of 3D content is introduced. The system combines the ability to capture dynamic scenes, based on a multi-camera system in a Chroma key environment, with a view-dependent projection for actor feedback. The system allows the generation and rendering of 3D models in preview quality for on-set visualisation in real time, and in high quality for post-production applications in an off-line phase. The shape reconstruction is based on the computation of the visual hull. The view-dependent projection component allows actors to be immersed into a virtual scene and to interact with virtual components. The functional modules of the system were implemented in a highly distributed system using standard, inexpensive IT components. Therefore the system is quite scalable and can be fitted into most studio environments. For the integration of the system components a middleware architecture was developed.

This document was originally published in IEEE Transactions on Circuits and Systems for Video Technology, Volume 14, No. 3, March 2003.