Using Photographs to Enhance Videos of a Static Scene

The work presents a system for automatically producing a wide variety of video enhancements and visual effects. Unlike traditional visual effects software (e.g., After Effects, Shake, Boujou, etc), the system is completely automatic and no manual labor is required from the user. The major limitation of the work is that it can currently handle only videos of static scenes (i.e., videos shot with a moving camera but containing no moving objects in the scene). Efforts are being made to lift this restriction in future work.

Applications of the system include:
High resolution/definition video,
High dynamic range video,
Removing objects from a video,
Creating painterly (NPR) videos,
Video stabilization,
Easy video editing

Project website:
http://grail.cs.washington.edu/projects/videoenhancement/videoEnhancement.htm

Category:

Film & Animation

Tags:

• HD-Video
• HDR-Video
• Video-editing
• Painterly-video
• Video-stabilization
• Visual-effects
• Special-effects
• research

[pixelslinger]

This is great! PravinBhat, what's the website?

Thanks

[PravinBhat]

The url for the project website can be found in the video description section on the right (click on "more"). Youtube doesn't allow urls to be posted as comments.

[PravinBhat]

Our new project attempts to make these effects work with dynamic scenes. I think if we accomplish this goal then we will see some real impact. The effects industry will actually want to implement such a system since it will work for dynamic scenes. I'm also trying to write the new code with the intention of releasing it as a user-friendly open-source beta. But it's hard to write research code with that goal in mind since the biggest payoff in research comes from quick and dirty prototyping.

[PravinBhat]

However, the spacetime fusion algorithm could be integrated into all video vfx packages right away because it works with dynamic scenes. Imagine editing a video in After Effects (e.g., say adding a decal on a moving car) and having your all your edits be consistent with the lighting in the scene.

[PravinBhat]

Ideally, a product team like Adobe would carry the torch from here on and create a professional quality implementation of the ideas presented in this work. But that's not likely to happen because the current work only handles static scenes.

[PravinBhat]

Unfortunately, all the software written for this project is research quality code. There is no UI, no error checking, and it's slow. I need to put in the engineering effort to create a user-friendly system around the research software and release it as an open-source beta. But that is going to be hard to do with the new research projects I'm working on.

[criminalistic]

you think you've seen it all with PhotoShop

Now introducing VIDEOShop

[dsjfh09kjmsd3kjh]

WOW

[hugsfornatalie]

This is very very frightening.

[mruef]

Very nice algorithm. CSI-like video enhancements are coming ;)

[Roshkin]

Just liked, favorited, subscribed, and now commented. This is mind-blowingly amazing. Imagine creating HD well-lit video footage from a cell phone camera. Or editing out the pedestrian that walks through your family video. Simply amazing.

[MRSstraightA]

When !!!

[monovich01]

they aren't released programs, they are in-development. Many are research based not for commercial consumption yet.

Hopefully the tech will get purchased or licensed by a big company (adobe) and get released to the foaming masses.

[Meja69]

Awesome. :)

[Ozzy0sbourne]

wow i see alot of these amazing things but they never show the program -.-''