Head Tracking using faceAPI & webcam only - no wiimote

This video shows Head tracking using the Seeing Machines faceAPI and a web-camera, connected to Johnny Lee's desktop VR demo. By using the faceAPI and a webcam instead of a wiimote, the same 3D view-dependent rendering can be accomplished without having to wear anything on your head. The faceAPI automatically tracks head position and rotation in X, Y and Z. The faceAPI is available from http://www.faceapi.com.

To all the people asking how to get this effect, please note faceAPI is an API, or Application Programming Interface. It is a tool for programmers that can be used to generate effects like in this video, as well as many other applications. We do not have these visualizations available for download! They are offered as an example only, for what head tracking can be used for.

Category:

Howto & Style

Tags:

• faceAPI
• johnny
• lee
• headtracking
• headtracker
• wii
• head
• desktop
• VR
• face
• tracking
• playstation
• facetracking
• Head
• mouse
• input
• HCI

[blackcaptor2]

I have FaceAPI and I have the Desktop VR program. Could anyone help me, you know, actually get them to work?

[utkua]

it looks 3d because we see it on 2d screen, actually if you were there, illusion would be less convincing because brain uses 2 eyes to perceive 3d environment, flat screen is not enough for that.

[coasterpro]

It's astonishing to me, given the ubiquity of web cams on laptops and PCs, that we haven't seen the widespread adoption of face tracking to augment the 3D video game experience. Even if the technology is not used as a controller replacement (which I think is a bad idea anyway), natural unavoidable movements of the head, when tracked to affect the in-game camera, would evoke greater immersion on-the-cheap. No need for expensive glasses or 120Hz monitors. And it would do so quite convincingly.

[goatphilososphy]

so you dont have to the devil

[xenoepist]

@utkua Now enter 3D glasses and 3D TVs

[blackrack2008]

@blackcaptor2 hey, if you found anything show me how you did it please

[Free2101]

Johnny Lee's the man

[Chefkoch320]

THIS is going to be a big thing! Future starts here!

[Php48]

Does anybody remember the old arcade game asteroids, this teck would really make that game fun again, like you are the ship and you need to dodge the asteroids, if done right it could make for a very intense game. I can also see it as a handy way to increase desktop work space & combined with voice reco it could change the way we use computers, we could all become like dancing cobras lol, nar I actually have something more practical in mind like subtle off screen menus and zoom scroll.

[Vgeorge7]

guys i am new to this program and i want to know how to use this effect .. i saw lots of comments about using C++ or some programs like this and i dont even know what to do to to use this effect ... any tutorial / help would be greatly appreciated .. Pm me if you can