VirtualStudio2Go: Digital Video Composition for Real Environ

We present a simple and flexible way of projecting corrected keying patterns and other spatial codes onto arbitrary diffuse surfaces using synchronized projectors and radiometric compensation. Thereby, the reflectance of the underlying real surface is widely neutralized. A temporal multiplexing between projection and flash illumination allows capturing the fully lit scene, while still being able to key the foreground objects. Since the entire scene is recorded while no physical blue screen blocks the view, the footage of the full background scene can be used for video composition. Thus, recordings have not to be taken twice and keying is invariant to foreground colors. In addition, we embed other spatial codes into the projected images to enable tracking of the camera, environment matting, and displaying in-place moderator information. Furthermore, the reconstruction of the scene geometry is implicitly supported, and allows special composition effects, such as shadow casts, occlusions and reflections. We propose a concept that combines all of these techniques into one single compact system that is fully compatible with common digital video composition pipelines, and offers an immediate plug-and-play applicability.

Category:

Science & Technology

Tags:

• Virtual
• Studio
• Augmented
• Reality
• projection
• computer