Unity + Kinect + First Person Camera + Dynamic Lighting/Shadows

(http://tinkerheavy.com ) This demonstration shows how to bind a scene camera to the head of a skeleton tracked character for first person camera perspective. The left hand contains a torch which you can use to set other objects on fire. Your right hand as a flashlight. Two hands on an object lets you pick it up.

If you have OpenNI .NET examples working a binary is available for Mac and PC: http://tinkerheavy.com/fplight.zip

Category:

Entertainment

Tags:

• Kinect Hacks
• Unity3d
• Unity
• First-person
• lighting
• torch
• fire
• flame
• flashlight
• spotlight

[8888rogue]

Excellent work! Is it possible to smooth out the jerky movements of the first-person perspective without adding too much lag? Otherwise that'll make my simulator sickness go mental. I get it with jerky mouse motion on games like Borderlands :(

[gr8tinkrer]

@8888rogue i've tried 2nd order IIR lowpass filtering but the group delay kills it. what's necessary is an adaptive filter that considers the confidence of pose estimate. especially if you can get multiple pose estimates from multiple parallel tracking methods.

[roidroid]

@gr8tinkrer like a kalman filter?

[gr8tinkrer]

@roidroid yup. like a kalman filter. it's very challenging to make a good one :)

[cravincreeper]

Hi, im looking for someone to create something similar the demonstrated version. I am willing to pay up to £300 pounds. If you are interested please email me. Thanks

[nathanthekiller]

Wow, This is the first FPS type thing I've seen with Kinect that's been demonstrated in a true FPS fashion. Demo works fine! I see alot of possibilities if people were to work on something like this!