Kinect + Unity Hand Point Cloud Extraction

This video demonstrates a method of extracting a point cloud of the hand to create virtual touch events. The point cloud is rendered by extracting points around where the OpenNI handGenerator says the hand is. The video also shows a Unity plugin drawing the camera to a texture; using a plugin gets you higher framerate, but the framerate of this video is pretty low because of the number of points i'm rendering for the hand. I'm working on filtering it down to only draw the 16 interesting points on the hand (palm, 15 joints).

Category:

Entertainment

Tags:

• Kinect
• Kinect Hakcs
• Unity3D
• Unity
• Point Cloud
• Hand Tracking
• OpenNI

[roidroid]

it doesn't look recognisable as a hand to me :(

[gr8tinkrer]

@roidroid you can tell it's your hand as you move it... the point here is to create "virtual touch" interfaces and i believe this is definitely good enough for controlling a virtual touchpad 10 feet away

[Ruwan7ace]

@gr8tinkrer Hi, Can u pls tell me how u got the video texture on to unity from the kinect.. Iv been trying to do this but without any luck.

[arundarwin]

! I like this! How's the situation Amir? I agree your apartment does look phat!