OpenCV + OpenGL + Immersive environment enhanced

This video shows my enhanced approach to combine OpenCV head tracking with a 3d OpenGL environment so that the user will see objects from their head's point of view. Since headtracking is 2d, no depth information is obtained. Besides that, it takes around 200ms for the face recognition algorithm, which gives a low refresh rate. I'm currently trying to improve that.

Category:

Science & Technology

Tags:

• opencv
• head
• tracking
• opengl
• immersive
• 3d
• environment

[HectorUch123]

Hello friend!

I tryied to do that with threads and your hint together , it really had speedup the application. Thank for the help!

I forget to comment the project: Really great!

Best Regards,

Heitor.

[dannyxyz22]

Well done!

Thank you and congratulations :)

[]'s

[HectorUch123]

oh thanks! Will this really improve speed? I put the face tracking code inside the opengl display function(that i also use on de idle func) . This right? or i will have to open in threads? thanks

[dannyxyz22]

This will improve detection speed which is generally the bottleneck, though you'll need to try and see if it's your case.

Kind regards,

Daniel

[Djcytral]

nice!

[diem389]

really cool!!!

[HectorUch123]

Hello !

Your help was really usefull , i did that and used threads , now i posted a video showing de result, that video is also a answer for your one , i hope you like it.

Thanks once again.

[dannyxyz22]

Thank you,

this is the idea I used in the google code ehci project, but it uses POSIT to get the 6 degrees of freedom head tracking.

It needs a function to re-initialize near some known positions.

Thanks for your feedback,

Daniel

[apanap556]

Ah, I see it's already been suggested a year ago.. :) Anyway, nice demo!

[apanap556]

I tried something similar once, but instead of detecting the face on every cycle, I detected where the face was, found some features on the face and tracked them with Lucas Kanade (based on the lk example that comes with opencv), which is faster. It sometimes lost track of the face though (which I guess could be fixed by doing proper face detection every once in a while).