Windows Phone and Kinect to create "holographic" game engine

Another quick hack using the Kinect beta SDK and my new Windows Phone (which is great!). What you see is a simple game engine utilizing the pseudo-holographic effect from my other videos. A Kinect "sees" the position of the viewer and the 3D engine adjusts the image accordingly to give the illusion of a real 3D object. The 3D engine supports anaglyph 3D (red/cyan glasses) for a better effect in real life. A simple WP7 app controls the application and the helicopter using the accelerometers of the phone.
If you like it, check out my other videos.
Thanks for watching!

• Category

  Science & Technology

[Guillaume Doisy]

Could you tell us more about the software implementation?

How do you track the head with kinect, are you using the full skeleton tracking from the SDK ? Is the latency of the head tracking low enough to maintain the illusion when moving fast?

Do you have a link to your code somewhere?

Thanks!

[programming4fun]

Yes, I use skeleton tracking from the (beta) sdk. Latency is proportional with the tracking smoothness parameters but more than sufficient for this application, especially since I only need the head position. I think it is even supposed to be improved in the latest SDK. The morphing is done in a vertex shader in my own simple DirectX based 3d engine. Sorry, no code available.

[Jackjan4]

Where ist the Kinect in the room?

[programming4fun]

It's a few meters away, enough to have the viewer in frame.

[Jackjan4]

And Kinect is so exactcly with the calibration between holo and person? :O

[programming4fun]

Yes, precision is more than enough for this application.

[William Neeley]

This is the future of gaming!

[programming4fun]

My own, based on (old) managed DirectX 9.

[sketchup73]

you mean 10 people all around the table ...each will see a different side of the helichopter ?

[Guillaume Doisy]

Thanks for the answer! I do the same and the new SDK (V1 final) is indeed improving the robustness of the skeleton tracking. I asked you because I was wondering if you used a head only tracking which doesn't need to see the full body...

[James Croft]

Is it possible to get what the Kinect is viewing to be displayed on the Windows Phone? I'm researching into this for my final year project at university.

[mcfattyboy]

Omg dude so you realize you could do a 3d hologram chess game wooy

[TheDrako98]

How can i do that?

[Edwyn Smith]

what if you got multiple users, would it make a glitchy projection?

[REFRESH0R]

gr8 clip, man ,)

Windows Phone OS rulz! ,)