Unity3d and FaceAPI integration - 6 degrees of freedom head tracking avatar

[disvulneravel]

Very Good, Thx for share. But i having problems, Lerps is not moving his head..

I dowloaded Face API and the streamer detected my face normaly, my unity version is 2.6. What could be?................Thx. Sorry for the bad enghish :)

[dannyxyz22]

@disvulneravel Hi :)

So, can you make sure you are using both 0.90 versions and not 0.95.

You should run LerpzFaceAPI0.9.zip with faceapistreamer0.9.zip Can you confirm you are doing that?

Best regards,

Daniel

[disvulneravel]

@dannyxyz22 Hi Daniel. Im using streamer 0.9 (detect may face) and i run LerpzFaceAPI0.9.zip. Lerps still not moving.

The island mode using streamer 0.95 for unity 2.6 works good.:D Thx.

[dannyxyz22]

@disvulneravel Good. So, it's probably a misconfiguration of your firewall settings. Try turning your firewall off. If it works, turn it on again and then try to add the programs as exceptions in firewall settings.

Kind regards,

Daniel

[disvulneravel]

@dannyxyz22 I disable the firewal but still not working :_(

my unity 2.6 version could be a problem?

i will try more... thx for all the help.: )

[dannyxyz22]

@disvulneravel Well, that's hard to say. Can you send a printscreen of what's hapenning? Can you also send a printscreen with your firewall settings?

Thanks a lot,

kind regards,

Daniel

[disvulneravel]

@dannyxyz22 I disable all firewall, and dont work.

think im having problems whith my port. I will try to fix it.

[ableman8]

i cant register it...help

[dannyxyz22]

@ableman8 What do you mean by registering it?

Kind regards,

Daniel

[ableman8]

@dannyxyz22 this unity 3d is not starting...it needs a registration to start..help me

[dannyxyz22]

@ableman8 Tell it to register through internet activation. It will open a site in your browser and then you put your e-mail and tell it to register, for free version or 30 days evaluation.

Kind regards,

Daniel

[ableman8]

@dannyxyz22 thanx for the suggestion daniel,but when i try activating it with internet....it gives a unkown error.....

[dannyxyz22]

@ableman8 Make sure you are not behing a proxy or firewall also. []'s

[digimikeh]

Nice man... i have two question for you.. :

This games has 193K vertex or more, how many FPS does it runs?

- Moving your head is nice to control joints, but is it possible to do a walkcycle with this sytem?..

thank you, good video.. !

[dannyxyz22]

Hi digimikeh,

well, I should run the fps statistics to give you the best answer, but I don't notice much difference than running it without the face tracker, so it's probably more than half the original fps.

Besides, you can do the facetracker in another computer and only send the messages in a socket connection, so it relieves your cpu for the consuming task of facetracking.

[dannyxyz22]

continuing...

Now, you could surely do a walkcycle with the system. We have some Z axis data. You can define some relative distance that it will walk forward and backwards. It would be a cool idea for the next releases. You can try it out too.

Thanks for your post :)

Kind regards!

ps. you can try it out in your computer as well, just download and run the projects, ok?

[]'s

[digimikeh]

ok ! all clear!, thank you for your response, going to download the project, right now i´m traducing it to spanish for unityspain, is very long and explicative,

regards !

[dannyxyz22]

It would be cool to be in UnitySpain :)

Send a big hug for the people out there,

kind regards,

Daniel!

[artorwar]

Querer es poder jaja. ;)

[diamondtearz]

That's fantastic! I look forward to seeing this used in a 3D Environment

[dannyxyz22]

Thanks, we'll dive into fishtank view pretty soon so FPSs will benefit from it. Please, stay tuned :)

[diamondtearz]

Awesome! as my kid would say.

[dannyxyz22]

Well, that's great!

I think we should team up with these researches. I see that head pose allied with eye tracking can yield great results.

If you have some time we can sketch up some project and commit it to the ehci trunk or open a new project, work a while, and then commit results to OpenCV :)

Um grande abraço para o hermano argentino :)

[]'s

ps. I'd really like to have an open source head/eye gesture/keystroke input for handicapped people

[oVISIONo]

Hey Danny,

I haven't seen your comment before because you didn't reply mine =), so I haven't received a notification email...

It would be great to work together, unfortunately I think I don't have enough spare time as I would like, but we can try it. Let talk about it...

I will take a look to the ehci project, I have tested it before, and I liked it.

Best Regards,

[dannyxyz22]

Sorry for not replying in the right place :)

So, I think we are both running out of time, but it's ok, we'll find some very few minutes to do something nice. I think that we should first finish each one's part (there are lots of things I need to finish in ehci, maybe you need to finish it too in myEye project ). As soon as we go on we'll be able to do something together.

Thanks about ehci. Everytime I show it to others, they will ask me "Why don't you use the eyes?" And that's where you come in!

[hafiz9977]

Good job.

I've done an integration of faceAPI with Flash. Just managed to successfully do that this week. Will upload some videos demonstrating that soon.

Integration is smooth and fast. Kudos to faceAPI for their fast tracking engine.

[dannyxyz22]

Hi Hafiz :)

It would be great to see your integration. Have you done it with papervision?

Kind regards, keep in touch!

[dannyxyz22]

Hi oVISIONo, the computer vision part is due to SeeingMachines, they did make a great job. I'm just putting some glue code around :)

[oVISIONo]

yes, I know faceAPI, I was talking about your job in this video and your other videos too :)

[dannyxyz22]

Of course you know, hehe, you are such an specialist, man, sorry for the misunderstanding and thank you a lot, but you are the one who deserves a great congratulation for your excellent work with eye tracking :)

[oVISIONo]

well, thanks, but I have a lot of work to do yet...

And you have more experience than me with OpenCV! :)

keep up the good work.

[oVISIONo]

awesome! you job is very good!!!