kinect - fingertip detection

algorithm (implemented with openCV) works as follows:

1. depth thresholding
2. contour extraction
3. approximate contours
4. assume vertices of convex hull to be fingertips if their interior angle is small enough

code can be found here:
http://dl.dropbox.com/u/5505209/FingertipTuio3d.zip


===================================

update 28.07.2011:

I actually have a new version running with openNI / NITE (on linux) using sekelton tracking as well:
http://dl.dropbox.com/u/5505209/kinectfingertip.zip
(currently uses OpenNI-Bin-Linux64-v1.1.0.41)

note: to avoid initial skeleton calibration, it loads a calibration from a file called "UserCalibration.bin". i did not include it into the zip file as its not compatible between different versions of NITE. you can create your own calibration file by calibrating with the openNI user tracker example and press Shift+S (this will generate a UserCalibration.bin, just copy it to the working directory of your binary)

after that your skeleton will be tracked instantly as you step in front of the kinect. this also works quite well with different people that actually were not calibrated!

Category:

Science & Technology

Tags:

• finger counting
• microsoft
• electronics
• technology
• openni
• nite
• primesense
• interface
• fingertips

[solCruiser]

when i try to run your code (openNI version)

i get no values in skeletonJointPosition?

[RobbeOfficial]

@solCruiser did you put a valid UserCalibration.bin into the working directory?

[Skeeeebl]

To the one wondering why it doesn't work on MacOS or Linux :

this program is using CL NUI, a windows only, closed source driver. It can't be used on any other OS than windows without remplacing by OpenNI.

By the way, the use of the skeleton tracking from OpenNI (or Microsoft SDK) would allow to limit detection around the hand, and prevent interferences.

[RobbeOfficial]

@Skeeeebl good point! :)

see updated video description!

[khambadk]

Hi,

Could you please tell me the necessary softwares required to install to run your application???

[yoonbell87]

Would you be able to work on mac version? please??

[ijuanjojose]

Well, I tried the new version (on Linux: ubuntu 10.10) with Openni / NITE, I've already copied the UserCalibration.bin to the local folder. I do this, "./build.sh" and then "./run.sh". (I suppose that the second has the same effect that "./KinectFingertip" or with sudo before). The thing is that the process is way to slow, and once the window (depthMatBgr) is finally showing something, it is not what i expected, it is like the raw image and very slow. Any recomendation?

[Akonkagva]

absolutely amaizing, thank you for showing your source code !

[HamsterLoad]

shits scary when your high....

[felipao456789]

hello, do you have the code for kinect sdk???

thanks

[dee1984in]

wow, that was awesome... nice work... just a question, Is it possible to make this to work like multitouch screen like? like win&i 2 beta??

[40700665]

Hi, can it run on win7, using opencv2.1 and VS 2010. Thank you very much.

[solCruiser]

@RobbeOfficial i used the UserCalibration file generated by NIUserTracker-Sample.

It seems to be a Problem with the ConvertRealWorldToProjective() method