Compiz Webcam Headtracking #2

Headtracking 3d desktop with Compiz, second video.

First clip is a simple desktop with a transparent cube to see the classic effect of the 3d box.
Second clip is while rotating the cube, so you can see how the transformation is always applied.
Third clip is showing some regular windows, stacked three-dimensionally by the plugin, giving regular work the same feel. You can literally look around windows.

Recording was done with a Canon PowerShot S5iS hybrid digital, which does some surprisingly nice video. The netbook is a Dell Mini 9 with the 1.3MP camera - no extra hardware whatsoever was used to record this, just me, my netbook, and Compiz.

The OpenCV backend used here is the SVN snapshot as of January 31st, 2009, which had a few issues I had to workaround myself (more just compilation issues).

The tracking is still a bit dodgy, but we're (I'm) working on it. Today I committed some depth-perception which also made the configuration values much more sane (instead of entering 6 in a box that could range from 1-1000 due to other tracking methods, you'd enter something like 200-300). Probably won't get a video of that because it doesn't add much (especially not when the depth method is so poor that we don't get smooth transitions).

So, that's it for today. Headtracking is going to be ported to Compiz++ at this point, so no more extra work on it until that's done.

Git: http://gitweb.compiz-fusion.org/?p=users/klange/headtracking
Wiki: http://wiki.compiz-fusion.org/Plugins/Headtracking

Category:

Science & Technology

Tags:

• opencv
• compiz
• headtracking
• facetracking
• tracking
• desktop
• effects
• linux
• webcam

[FleetAdmiralBacon]

I need a good lawyer to rub snot in Apple's face. The original code for this was committed back in February of 2008, remember that.

[FleetAdmiralBacon]

I first showed this off over a year ago with a Wiimote back in what had to have been mid-October. After a number of months without it thanks to an upgrade to 9.04 on my netbook, I finally got OpenCV to compile again and am back at work tweaking the interface. Hopefully I can smooth out the glitches.

[FleetAdmiralBacon]

I have an extremely poor "how-to" on my blog, though it's mostly just a list of reminders, like "make sure you have all of the compiz -dev libraries or this is never going to work". There's a link to a safe commit of OpenCV that we found which should compile without issue and also provide the required functionality (HAAR tracking).

[FleetAdmiralBacon]

I also just found out that the libraries shipped in Ubuntu (should go back to Hardy, not sure) /can/ work with the plugin, but not even remotely well. You need to comment out the |CV_HAAR_... though. Trust me, not worth it, just get a fresh CV.

[calaverx11]

Is it posted anywhere on how to set this system up for anybody? Or was this coded specifically for this hardware? Would it be possible to do this on, say, a Latitude E6400 with NVIDIA Quadro graphics and (I believe) a built-in Logitech webcam?

[FleetAdmiralBacon]

Works with anything that OpenCV works with, which should be an v4l-compatible camera. A "built-in Logitech" should work fine.

[TheWobblyboy]

daddy

[InnerGoat]

nice stuff

[TjtheVintageDj]

where to got plugin?

[lb969]

Funny, the table isn't moving then. Or the netbook in relation to anything in the background.

The Camera is moving. More importantly the cube on the screen is also moving.