Unity3d and FaceAPI integration - 6 degrees of freedom head tracking avatar

For more information, check http://www.visionblaster.com
This video shows realtime integration of 6 degrees of freedom head tracking using a simple webcam with Unity3D.
As I move the camera closer you can see the actor rotating his head exactly like I do.
Headtracking is done with the non-commercial version of FaceAPI.
As I move my head, the camera obtains my head pose and measures pitch, yaw and roll angles. These angles are sent to Unity3D where a script maps my moves to the actor, Lerpz.
As I press the 'F' key, the player throws a lightning bolt in the direction I am looking at, adding a further degree in user interaction.
Part of this project is open source software and available at www.visionblaster.com under the Open source section.

Category:

Science & Technology

Tags:

• visionblaster
• unity3d
• faceapi
• head
• tracking
• opencv
• augmented
• reality
• degrees
• of
• freedom
• 6dof

[disvulneravel]

Very Good, Thx for share. But i having problems, Lerps is not moving his head..

I dowloaded Face API and the streamer detected my face normaly, my unity version is 2.6. What could be?................Thx. Sorry for the bad enghish :)

[dannyxyz22]

@disvulneravel Hi :)

So, can you make sure you are using both 0.90 versions and not 0.95.

You should run LerpzFaceAPI0.9.zip with faceapistreamer0.9.zip Can you confirm you are doing that?

Best regards,

Daniel

[disvulneravel]

@dannyxyz22 Hi Daniel. Im using streamer 0.9 (detect may face) and i run LerpzFaceAPI0.9.zip. Lerps still not moving.

The island mode using streamer 0.95 for unity 2.6 works good.:D Thx.

[dannyxyz22]

@disvulneravel Good. So, it's probably a misconfiguration of your firewall settings. Try turning your firewall off. If it works, turn it on again and then try to add the programs as exceptions in firewall settings.

Kind regards,

Daniel

[disvulneravel]

@dannyxyz22 I disable the firewal but still not working :_(

my unity 2.6 version could be a problem?

i will try more... thx for all the help.: )

[dannyxyz22]

@disvulneravel Well, that's hard to say. Can you send a printscreen of what's hapenning? Can you also send a printscreen with your firewall settings?

Thanks a lot,

kind regards,

Daniel

[disvulneravel]

@dannyxyz22 I disable all firewall, and dont work.

think im having problems whith my port. I will try to fix it.

[dannyxyz22]

@ableman8 Make sure you are not behing a proxy or firewall also. []'s

[ableman8]

@dannyxyz22 thanx for the suggestion daniel,but when i try activating it with internet....it gives a unkown error.....

[dannyxyz22]

@ableman8 Tell it to register through internet activation. It will open a site in your browser and then you put your e-mail and tell it to register, for free version or 30 days evaluation.

Kind regards,

Daniel