Compiz Webcam Headtracking #2

[TheWobblyboy]

daddy

[InnerGoat]

nice stuff

[FleetAdmiralBacon]

I need a good lawyer to rub snot in Apple's face. The original code for this was committed back in February of 2008, remember that.

[FleetAdmiralBacon]

I first showed this off over a year ago with a Wiimote back in what had to have been mid-October. After a number of months without it thanks to an upgrade to 9.04 on my netbook, I finally got OpenCV to compile again and am back at work tweaking the interface. Hopefully I can smooth out the glitches.

[TjtheVintageDj]

where to got plugin?

[migero2]

can you share your settings for the compiz manager ?

[TheTilde]

This is really impressive, congrats!

You are working on the Future!

[migero2]

yea the windows stacing is cool

[FleetAdmiralBacon]

I have an extremely poor "how-to" on my blog, though it's mostly just a list of reminders, like "make sure you have all of the compiz -dev libraries or this is never going to work". There's a link to a safe commit of OpenCV that we found which should compile without issue and also provide the required functionality (HAAR tracking).

[FleetAdmiralBacon]

I also just found out that the libraries shipped in Ubuntu (should go back to Hardy, not sure) /can/ work with the plugin, but not even remotely well. You need to comment out the |CV_HAAR_... though. Trust me, not worth it, just get a fresh CV.

[rpgheart]

Anyone can see that hes using his fingers to move the mouse to give it the effect of being 3d.

[FleetAdmiralBacon]

My fingers are holding the camera...

[calaverx11]

He's using his left hand to turn the laptop, genius.

[Jarige2]

He's holding the camera with both hands, genius. You can see that in the reflection of the laptop screen.

And btw, this really is ingenious! How did you get it :O

I hope my webcam is supported, it works in Cheese Webcam Booth, so it should work in Compiz too :)

[calaverx11]

Only in the first demo, "inside the cube." In the other two, he has one hand on the laptop, but I see now he's not actually turning it, just holding it.

[lb969]

Funny, the table isn't moving then. Or the netbook in relation to anything in the background.

The Camera is moving. More importantly the cube on the screen is also moving.

[LuCiFerDKs]

lol..this is the funniest reply ive ever seen in years.

[calaverx11]

Is it posted anywhere on how to set this system up for anybody? Or was this coded specifically for this hardware? Would it be possible to do this on, say, a Latitude E6400 with NVIDIA Quadro graphics and (I believe) a built-in Logitech webcam?

[FleetAdmiralBacon]

Works with anything that OpenCV works with, which should be an v4l-compatible camera. A "built-in Logitech" should work fine.

[bgdnbrnnk]

I wonder how this works.

[FleetAdmiralBacon]

I already said how it works, and all of the code is open-source.

Camera provides a video stream, OpenCV does HAAR detection (finds regions in the stream that match specific characteristics, specifically, a face), plugin does some trig to turn that into a 3d point by reversing projectiong, pumps it into a glFrustum(), and viola, headtracking 3d. The only difference between this and the other such systems is we're using it with Compiz, so you have an actual 3d "desktop".

[amrzeft]

this is the creepiest thing i've seen today

[esedani345]

isn´t for windows??

[FleetAdmiralBacon]

This is a plugin for a Linux window manager.

[neub7S]

The idea is nice but the tracking need to be improve a little bit more (Haar feature are not sufficient), with skin detection and kalman filters you can obtain good results.

Moreover you should emphasis the effect of moving for your demos.

Once again this is a nice work

[FleetAdmiralBacon]

Indeed. It's the last bit to work on, though.

As I've said, we're using /sample code/! Clearly not sufficient for this. Did I mention it kept thinking my right hand was a face while holding the camera?

My next video will be post-port to 0.9.0 ("Compiz++"), so it won't be for another week or two.

[RobLoach]

Nicely done! Compiz FTW!

[bikutorusan]

Super cool "feature". :-) Now you can actually peek behind windows in a much more natural way! It might be even more useful if the parallax effect were to be weighted a little more so that windows would slide farther so you could peek at more of the content of windows in the back, but obviously this is a fine-tuning craft of not making it too sensitive either. Pardon the long sentence.

[FleetAdmiralBacon]

Some tuning of the configuration can make the effect more dramatic, albeit, less realistic and natural.

[bikutorusan]

Ah-ha! Awesome! You mean in CCSM when you say "the configuration", right? I love configs :D

[FleetAdmiralBacon]

Indeed. Just change a few options and you can get it to really move.

[ogTJ]

For a second I didn't realize that the camera was being tracked, lol.

Thanks for the video, I'm going to try to figure out how to partition my windows 7 hdd so I can install ubuntu again... Can't wait. :)

[FleetAdmiralBacon]

Technically, it wasn't for a few seconds. The tracker has some issues with holding a camera: For one, you need to make sure your eyes are fully visible. Another problem is that with the weak sample code I'm using, it sometimes things my right hand (holding the camera) is a face.

[bobthegreatII]

Neat, I like it.

[KIWIDOGGIE]

Noice