Ambient Point Clouds for View Interpolation

GRIS is a research group at the TU Darmstadt, working on MultiView Stereo reconstruction of scenes from Internet pictures and the presentation of the results. This is the video accompanying the SIGGRAPH 2010 paper "Ambient Point Clouds for View Interpolation" ( http://www.gris.informatik.tu-darmstadt.de/~mgoesele/projects/AmbientPointClo... ). Unfortunately there are some compression artifacts visible, visit our webpage for a better quality video.

Abstract: View interpolation and image-based rendering algorithms often
produce visual artifacts in regions where the 3D scene geome-
try is erroneous, uncertain, or incomplete. In this paper, we in-
troduce ambient point clouds constructed from uncertain colored
depth pixels, which help reduce these artifacts while providing non-
photorealistic background coloring and enhancing the sense of 3D
motion. Our point clouds are constructed by randomly sampling
colored points along the viewing rays associated with uncertain pix-
els. These are combined with more traditional rigid 3D point clouds
and colored surface meshes obtained using multi-view stereo. Our
real-time rendering system is able to handle larger-range view tran-
sitions with fewer visible artifacts than previous approaches.

Category:

Science & Technology

Tags:

• Multi
• View
• Stereo
• Ambient
• point
• cloud
• siggraph
• reconstruction
• 3d

[tenegon]

Amazing trick.

[CodyRicheson]

@netlorens, perhaps I was being hasty. It won't be long before there is a fully seamless and realistic transition using this technology.

[netlorens]

@CodyRicheson, every time I read your reply I smile a bit and shake my head. Perhaps these transitions do not look like you were moving a video camera between these camera viewpoints in the real world, but this is still a superior way to view a series of photos than a simple 2D sequential slideshow or a typical online photo album.

The spatial relationships are clearly evident when using this + it certainly is an improvement over what is currently available in Photosynth + Google Street View.

[MrFuzzy3d]

really impressive

[CodyRicheson]

The technology is cool, but the transitions still look very bad. What is the point of this technology if the appearance is so unnatural?