Markerless Augmented Reality

A markerless augmented reality system with realistic direct lighting of virtual objects. Our approach exploits a two camera system consisting of a TV-camera and a fish-eye camera. The TV-camera captures the video for the augmentation while the fish-eye camera observes the upper hemisphere to track the light sources. Accordingly, direct lighting can be used to render virtual objects. Additionally, we propose an easy method to place virtual objects in the scene and to compute the shadows of these objects. This work was done as part of the MATRIS project at the Christian Albrechts University of Kiel (www.mip.informatik.uni-kiel.de)
Find more details in Jan-Michael Frahm, Kevin Köser, Daniel Grest and Reinhard Koch, "Markerless Augmented Reality with Light Source Estimation for Direct Illumination", Conference on Visual Media Production 2005, Dec., London

Category:

Howto & Style

Tags:

• virtual
• illumination
• augmented
• reality
• computer
• vision
• markerless
• tv
• broadcast

[IceMetalPunk]

The lighting is one of the best features of this. But it seems it all has to be manually prepared beforehand. Is there a way to get such realistic lighting in realtime for an AR system?

-IMP ;) :)

[MacsMedia]

Wow! That's an amazing system, nice work!!