Augmented Reality for Non-Rigid Surfaces

[jnickence]

Very cool. No glitching!

[sgerar37]

Simply, congratulations, this technology is amazing. Are you using deformable Lucas-Kanade to compute the cloth deformation? The dynamic ligthing is also superb, really convincing. My deepest admiration! :)

[shemademagic]

OH LOL :D no way............. just realized..

[shemademagic]

wtf cant see shit ;(

[DetectiveMiau]

Cool! Just like 9/11!

[remcadiz]

It's amazing! I have been following the AR market since a year and your software is light-years from commercial toolkits. I would appreciate so much to have an open source toolkit from this....

Congratulations!

[itjil]

awesome job! I really wouldnt have been able to tell if your finger hadnt gone through it. Amazing.

[schokker64]

Absolutely brilliant.

[audiowiz]

Hard to believe this. I'm on the fence

[jimalliban]

I have to admit, when I first saw this I thought you were having a laugh. Excellent work. Well done.

[lievenvv]

very, VERY nice man!

[clnmyjts]

crazy...?

I did catch the tip of the figure slip after reading the comment below..

Look good for being fake...LOL

[robslabs]

Big thumbs up, it looks completely real!

[TitanFind]

Errrm....the demo would look more impressive if you changed the image dynamically, or turned it on or off. That could simply be a normal T-shirt. It's a bit like saying you're going to demonstrate invisibility, and then pointing a camera at an empty room and claiming there's an invisible chair in it.

[JulienPilet]

come to SIGGRAPH Asia this december, in Yokohama, Japan. You'll be able to wear animated T-shirts.

[twdarkflame]

If you actually look closely, you can see its not always perfectly sycned, and at some points his figure slips under the image.

Its very definitely augmented reality, but the fact you couldn't tell shows how amazing this demo is.

[BriansOtherVideos]

00:37 his finger disappeared, there are a bunch of things like that in here, just look... 00:24

[Armyfractal]

this would look amazing with animation

contact me if you need some help in that area

nice job

[98Zai]

craaazy, Never seen anything like it!

Most impressive!

[LedoBom]

Impressive! I´m a brazilian IT student, starting to do some art instalations with AR. Would you be king enough to share you knowledge about that? How does this operate on algorithm level?

[twdarkflame]

Wow this is really impressive stuff.

[JulienPilet]

On my macbook pro, it runs at about 12 fps. Without occlusion segmentation, it goes to 15 fps. The graphcut segmentation takes some time.

well, many parameters can be tuned to influence speed and visual quality.

Also, the computation is done on the CPU. A better use of GPU could improve speed. It is not properly multithreaded, also.

[neozenith]

@JulienPilet That is really awesome leap forward for AR. Have you got any papers on this?

[r0u1i]

Hi Juilen,

I really like this video, and I'll try to find the time to read some of your articles.

One question though - what's the processing power needed for all those neat tricks to run smoothly (as they do in this demo)?

[r0u1i]

and sorry for the typo in the most important word, Julien :)