kinect - fingertip detection

[LittleGirls]

These all C++ files I get when there in this form, or is it a Windows thing, please help.

[bkocev]

Hi,

Very nice video and implementation. I downloaded your newer version "kinectfingertip" Somehow my Sample-NiUserTracker does not allow me to save anything, it does not recognize the 'S' keyboard input. Anyhow I found a sample UserCalibration.bin, and tried your program... It does not work... I noticed that the callback function "onNewUser" is never set, but it is just defined.. Shouldn't be set as a callback function somewhere?

Cheers

[khambadk]

Hi,

Could you please tell me the necessary softwares required to install to run your application???

[yoonbell87]

Would you be able to work on mac version? please??

[ijuanjojose]

Well, I tried the new version (on Linux: ubuntu 10.10) with Openni / NITE, I've already copied the UserCalibration.bin to the local folder. I do this, "./build.sh" and then "./run.sh". (I suppose that the second has the same effect that "./KinectFingertip" or with sudo before). The thing is that the process is way to slow, and once the window (depthMatBgr) is finally showing something, it is not what i expected, it is like the raw image and very slow. Any recomendation?

[Akonkagva]

absolutely amaizing, thank you for showing your source code !

[HamsterLoad]

shits scary when your high....

[felipao456789]

hello, do you have the code for kinect sdk???

thanks

[dee1984in]

wow, that was awesome... nice work... just a question, Is it possible to make this to work like multitouch screen like? like win&i 2 beta??

[40700665]

Hi, can it run on win7, using opencv2.1 and VS 2010. Thank you very much.

[solCruiser]

when i try to run your code (openNI version)

i get no values in skeletonJointPosition?

[RobbeOfficial]

@solCruiser did you put a valid UserCalibration.bin into the working directory?

[solCruiser]

@RobbeOfficial i used the UserCalibration file generated by NIUserTracker-Sample.

It seems to be a Problem with the ConvertRealWorldToProjective() method

[carlesls]

Is ge using the kinect camera and sensor? or does he use a convencional webcam?

Thanks to all.

[IronsBrew]

Cheers for upload! I too having nightmare trying to get this to run, using VS10. At the stage of desperation where i'd be willing to pay anyone that could give me a step by step run through! if anyone is willing, just get in touch (without spaces) craigaddison2 @live.co.uk

[Skeeeebl]

To the one wondering why it doesn't work on MacOS or Linux :

this program is using CL NUI, a windows only, closed source driver. It can't be used on any other OS than windows without remplacing by OpenNI.

By the way, the use of the skeleton tracking from OpenNI (or Microsoft SDK) would allow to limit detection around the hand, and prevent interferences.

[RobbeOfficial]

@Skeeeebl good point! :)

see updated video description!

[Skeeeebl]

@RobbeOfficial Oh, that's some good news !

Thank you very much :-)

[JAMTHEMANX]

cant compile on mac.. is it just for window.. ne help?

[slaer905]

very nicely done



[POHWGAS]

what if you dont have fingers? xD

[sairam6087]

@RobbeOfficial: I'm new to using the kinect and I have a couple of quick questions about the way that you are generating the depth map.

1) why do you multiply z by 0.1? what is the range of values you get from z?

2) I noticed that the depth map that I get is such that closer objects turn darker in the map. Is there a way to change this? as in invert the map so that closer object turn more white?

3) how do you improve the resolution of the map?

[Schizophrenieous]

Hi, i want to share my Problems too:

(first of all danke herzlich!)

MY Devenvironment:

- opencv 2.1

- VS 2010 Express

Compiling work for both release & Debug

When i start debug Mode i get the error: 0xc0150002

In Release Mode i get the message "cam started" but then it hangs. After setting a break-Point it seems that the problem is on line 180 main.cpp when detectFingerTips is called. i couldn't get any better information for now.

Thanks for any Help

[vandelfi]

@Schizophrenieous

I don't know if this still helps since your post was two months ago, but I had the same setup and the same problem and I found out that it's a run-time problem and to solve it you need to instal Visual C++ 2008 express. Not to use it but its instalation will install the needed .dll-s. after doing this it worked fine. Cheers

[GLAMOROUSFUNK]

how do you run it?

[Electrum]

any chance to make it as a package for MACOSX ?

[tcboy88]

do u hav c# version of this (in emgucv)?

i m not familar w c++ T_T

[TheNordbjerg]

Shit, this is the fastest thing for Kinect I have ever seen.

[bsundsbo]

I'm trying to convert your code into C# using Emgu, though with some issues. The problem is I seem to get too many vertices on other locations than my fingertips and/or between the fingers. If I for instance put my face into the frame, the outline of my face also get circles representing fingers. Any ideas to be more sure about identifying fingers? How does your code react to things other than fingers? I was unable to compile your code in VS2010 to compare.

[RobbeOfficial]

@bsundsbo i think it's a general problem of the algorithm. it is very simple so there a some false positive and false negative detections here and there. under good conditions in should do fine though.

many people report having problems to compile. what's the error in your case?

[bsundsbo]

@RobbeOfficial The first compile problem was incorrect version of opencv. Then some issue when compiling release with references to external unresolved whatever for UdpSocket for release build.

[RobbeOfficial]

@bsundsbo that smells like TUIO to me. you could try to remove the TUIO stuff, it's not needed for the actual recognition.

[bsundsbo]

@RobbeOfficial change some settings for release build (don't remember which; a co-worker helped). Got it compiled, but error when running. Building it on my work computer, and running it at home. Will try the Kinect at work one day.

[bsundsbo]

I found this link quite interresting, though it does not so far have any source code: Search for 'Kinect Finger-tip detection' on youtube.

[JapplengUniversity]

Hey, I was wondering if you would be willing to make a plugin for MMD so it can recognize finger movement? (miku miku dance) I wouldn't care personally but I do know that there's a pretty decent sized community for it and a lot of people are hoping to see more and more kinect improvements.

[666sky999]

and what version of opencv did you used 1.0 2.0 2.1

finally i find the code, sorry,thx

[666sky999]

and what version of opencv did you used 1.0 2.0 2.1

[666sky999]

hi, nice job man, it s amazin,what kind of algorithms have you used , can u show me the source code,I start with opencv and I want to have examples

[Nerd69]

thanks this helps a lot

[RobbeOfficial]

@Nerd69 great :) .. i'm still looking for improvements of the algorithm. if you have any or just some ideas let me know.

cheers

robert

[ramaneekgill]

Hi, I was wondering if you could share the source code you used in this video.

[RobbeOfficial]

@ramaneekgill sure, this contains the code : dl.dropbox.com/u/5505209/Finge­rtipTuio3d.zip .. it's ja visual studio 2010 project. the detected fingertips are sent via TUIO. i also implemented 3d cursors for the fingertips.

have fun

robert

[Bl8runner79]

Aamazing, i would like to use this in any tactical shooter like graw for hand signs. sneaking would totally evolve. would be cool to use this simultan with a controller and if u hold a shoulder button you get the other hand free to use pointing on enemys, for hand signs, picking things up(grabing move), reloading(quick move to the waist and back beneath the controller) . imagine a multiplayer shooter where u could show the finger ;)

[dirtyvu]

if you get this on engadget or gizmodo, you'll get tons of hits!