Head Tracking - Final project with OpenCV and Processing

[ortontim]

Im also working on a face tracker, I have something working but it needs improvement.

How did you calculate the viewing frustum? (Im using C++ and OpenGL btw, what did you use?)

Also how did you get the tunnel in world space to seem to connect to the edges of the screen?

[DaftMou5eGaMerZ]

eine nette Idee

[Narcotix89]

I'm curious: where did you put your camera to film this? Was it supposed to be constantly attached to your head? Since this is a video, does the "illusion" still work even though the camera is not really close to your eyes, as long as it moves with the head? Does it change a thing if you rotate your head (let me say, along the Z axis)?

[get2him]

@Narcotix89 :

I use an infrared marker that is tracked by the software.

therefore the marker was attached to the camera.

Head rotation doesn't change anything. but if you move along the z axis, the perspective doesn't change accordingly. it is just a 2D tracker. not a 3D tracker.

The illusion is not perfect as I had no stereoscopic display. The perspective changes, but you don't have a 3D effect like in the video above.

[Narcotix89]

@get2him oh I see :) Thanks for the answers! The first questions were because I thought you were tracking the viewer's head position by face(+eyes) detection. This would be an interesting enhancement, in my opinion... getting rid of any marker, I mean. So I'm probably going to develop something like this by myself in the next months ;) BTW very intersting work

[get2him]

There are commercial headtracking solutions like IRTrack. I think they are better suited for x-plane.

My code theoretically would be capable of doing the same. But it would be a lot of work :)

[IwantToLearnWingChun]

Would it be possible to control a game like X-Plane (a flight simulator) with it?? That's great!

[bioduds]

very cool

[xistoxs]

I dont get it,whats happening?

[Nadeeja94]

@xistoxs His head is being tracked, and according to that coordinates, the 3d cube on the monitor moves giving it a sense of depth.

[v01d4d3pt]

any restrictions upon commercial use of the opencv library.

[v01d4d3pt]

whoah you did this with processing language and opencv. Have you found anything unhappily restrictive in the opencv licensing?

[get2him]

@v01d4d3pt Nope. Do you have something in mind?