Interactive 3D Scene Transitioning via Interpolative Reconstructions Using Random Multi-View Video

Unstructured Video-Based Rendering: Interactive Exploration of Casually Captured Videos




Abstract: We present an algorithm designed for navigating around a performance that was filmed as a "casual" multi-view video collection: real-world footage captured on hand held cameras by a few audience members. The objective is to easily navigate in 3D, generating a video-based rendering (VBR) of a performance filmed with widely separated cameras. Casually filmed events are especially challenging because they yield footage with complicated backgrounds and camera motion. Such challenging conditions preclude the use of most algorithms that depend on correlation-based stereo or 3D shape-from-silhouettes. Our algorithm builds on the concepts developed for the exploration of photo-collections of empty scenes. Interactive performer-specific view-interpolation is now possible through innovations in interactive rendering and offline-matting relating to i) modeling the foreground subject as video-sprites on billboards, ii) modeling the background geometry with adaptive view-dependent textures, and iii) view interpolation that follows a performer. The billboards are embedded in a simple but realistic reconstruction of the environment. The reconstructed environment provides very effective visual cues for spatial navigation as the user transitions between viewpoints. The prototype is tested on footage from several challenging events, and demonstrates the editorial utility of the whole system and the particular value of our new billboard-to-billboard optimization.

http://cvg.ethz.ch/research/unstructured-vbr/OrbitFigBig.jpg http://cvg.ethz.ch/research/unstructured-vbr/paper.pdf

Supplementary videos:

User interaction (camera captured) http://cvg.ethz.ch/research/unstructured-vbr/user_interaction01.avi

User interaction (screen captured) http://cvg.ethz.ch/research/unstructured-vbr/Jug_screen.avi

Segmentation results http://cvg.ethz.ch/research/unstructured-vbr/SegmentationResults.avi

User interaction: Juggler http://cvg.ethz.ch/research/unstructured-vbr/JugPlay.avi

User interaction: Magician http://cvg.ethz.ch/research/unstructured-vbr/MagPlay.avi

User interaction: Rothman http://cvg.ethz.ch/research/unstructured-vbr/RotPlay.avi

"Simon Shack" is a high-level infiltrator shill.

http://www.ozzybinoswald.com
http://ozzybinoswald.us.tc

FNORDGWAR the thousand year reich triple double secret mixxx
http://www.youtube.com/watch?v=1zpaEhx9S4s

Category:

Science & Technology

Tags:

• billboard
• optimization
• seamless
• 3d
• transitions
• orbiting
• fakery
• 911
• september
• matrix
• simulation
• rendering
• reconstruction
• ozzybinoswald
• point cloud
• FNORDGWAR
• fn8wr

[OzzybanOswald]

Well look at that. YT finally stopped holding the view count at 303 after all these weeks.

[ProtectAus]

Informative! Thanx

[Sparkeli]

Uni Zürich?.. Really impressive :)

[nameofthepen]

WWIII - The War for Men's Minds.  Awesome video, Ozzy.

[ZionistWorldOrder]

Great for applications ranging from live feed false flag ops to tennis matches, soccer or can you imagine the olympics with live scene transitioning? Wow. Imagine those replays!

[xcgfhfdg]

....first Google Earth...and now even more 9/11 technology going private sector....!?!

.....time for another "killer app"...!!

...9/11 wasn't enough !!.......I want to create my own personal myths and illusions....!!!!

....we'll call them "the home movies that changed history"....the Zapruder family at their summer beach house.....

...the fantasy takes shape....the illusion now has color....texture...and taste...

....radio....black and white TV ...color TV....live simulated reality...

[random331]

Video got scrambled.