Custom Gesture Recognition using OpenNI & Unity3D

You see my implementation of custom gesture recognition using OpenNI and Unity 3D. The sensor is the Microsoft Kinect.

Here are some functions:
-Search for multiple gestures.
-Disable or priotize gestures.
-5 gesture types to support almost all gestures: Stateless, Statefull, Directional, Bidirectional and PositionsOnly
-Customizable tolerance value and return range of the values.
-Define which axis are important for the gesture and which can be ignored.
-Define which axis are relevant for the return value.
-The Orientation of the user can be set, to be ignored, so he can rotate around.
-the joints which the gesture should include can be selected.
-Gestures can be found on every user which is in the scene, but also users can be ignored.
-Automatic calibration of the users.
-Create a gesture automatically by moving the joints, or by setting poses (like showed in this video).
-All gesture settings can be changed, after a gesture has been saved.
-Also the joints of the gesture can be changed, after is has been recorded.
-The joints of a gesture can be shown in the 3D engine, while the user walks around.
...

Category:

Science & Technology

Tags:

• OpenNI
• Unity3D
• Kinect
• Gestures

[KuzminMichael]

Sorry, the company for which I programmed this, does not allow to release the code.

[KuzminMichael]

I have released a new video!

[digimikeh]

it is possible to do animations with this or is just a realtime solution?

[KuzminMichael]

@digimikeh Animations are not supported, because it is used as a gesture recognition. But it would be also able to record animations.

[digimikeh]

hi, are you using some special sensors or just a webcam ? thanks.

[KuzminMichael]

@digimikeh I am using the Microsoft Kinect.

[Sphexible]

can you please release the source code?

[psydack]

Nice one bro. =)

Can you release a plugin or lib for tests?

PLEASE?

Or tell where I can starts with Gesture Recognition...

[NetwellCASALA]

Really enjoyed the videos. The implementation looks great. I guess I have the same question as many others here. Are you planning on releasing the code? I would be very interested in seeing if your implementation can be applied to Unity for example. Good work !

[lineautox]

@digimikeh lift your knees and turn your body for walking and direction

[digimikeh]

@lineautox oh, i see,,, this will be amazing,, there is only one thing i can imagine, how do you walk/run, since your real space might be limited, btw, is a great system..

[lineautox]

@digimikeh no like you have an invisible sword in your hand using gesture you take a step forward and slash down this engine recognizing it as an attack and thus is the damage calculated punch same when not in battle then the player controls the characters body just like their own being able to interact with objects in 3d space naturally that's what i see.