Compiz Webcam Headtracking

A look at the cube with headtracking. Not to discourage anyone from trying it, but it looks a lot better here, when viewed through a camera, than it does normally. Darn stereoscopic vision, 'eh?

Pay attention to the left viewport, as it's the best reference point.

Tracking is done through OpenCV and is ultimately just the facedetect example thrown into a threaded environment. Compiz is then warped with my own head tracking plugin that can also be used with a Wiimote (trust me, this is much better).

Recorded with my Canon PowerShot S5IS.

Git: http://gitweb.compiz-fusion.org/?p=users/klange/headtracking
Wiki: http://wiki.compiz-fusion.org/Plugins/Headtracking

Category:

Science & Technology

Tags:

• compiz
• opencv
• headtracking
• tracking
• cube
• desktop
• facetracking

[epicn2l]

.INVERT THE DEPTH. .Holographi-cally.

looks like if you're looking into a cube, rather than space coming out of the screen hoverin over keys.

(adjustment to tracking head/keys/screen position)

[FleetAdmiralBacon]

That's kind of the point... You /are/ looking into the cube. If you want to not be looking into the cube... Um, well, you wouldn't even see anything...

[FleetAdmiralBacon]

Until I go and accidentally delete it...

[FleetAdmiralBacon]

New video is up: askKFSe3aLk (look up, I've posted it as a response)

[hotdog003]

Very nice. Seems a bit jerky, but shows lots of promise. Good work, my friend.

[FleetAdmiralBacon]

As I've said, it's because we're using some sketchy sample code from OpenCV - none of the extra steps have been taken to make it any smoother. Hopefully, in the future, I'll get a more accurate tracking solution for my own face ("train" the tracker) and add some background culling (which removes the few jumps we get from spots on the back wall looking like a face).

[FleetAdmiralBacon]

I'm working on a new video that will show off a bit more and cut out some of the bugs (all of which I can legitimately blame on OpenCV, go me!). Watch for it.

[FleetAdmiralBacon]

Apparently my last comment didn't make it...

Anyway, you can get the plugin from the Compiz git repos. I'll post the link in the description. OpenCV needs to be compiled from a recent SVN snapshot (I'm currently using the SVN trunk from two days ago). You also need the Compiz -dev packages to compile the plugin.

[calaverx11]

I'd love to see an implementation of this. Need to find a way to track progress.

[evanjm]

It's really nice to see some useful development with head tracking in CF. Great Job!