free air finger tracking in use

This shows me using a system i have developed to allow me to use the system dveloped by Johnny Chung Lee to control my mouse cursor. I have placed my monitor horizontally on my desk and positioned the infrared camera above the desk. This allows my monitor to function like a touch screen only i do not have to touch the screen, I can simply wave my hands around in the air abve my monitor to control my cursor.

Currently I am using my index finger to control the cursor position and the thumb to control clicking. This demo shows me browsing around a website in firefox but i am developing some software which will be optimised for use with the tracking system.

I also hope to get a second infra red array and wiimote so that i can get full 3d tracking.

Category:

Science & Technology

Tags:

• finger
• tracking

[MrRamquez]

WAW!!! Does it come with a transparent Arm?

[cloudflint]

@MrRamquez From the perspective of the person using it, you can see what is under your hand fine unless you put your hand really close to the monitor, in which case the user interface changes so the buttons are huge anyway :)

[elmonaliza91]

thanx cloudflint for your answer

I am very impressed by the idea and decided to use it as a project graduation in my faculty

and need your help pleaze

why do you select visual basic Precisely??

[cloudflint]

@elmonaliza91 I used visual basic because i am familiar with it and there is a wiimote library which has functions for connecting to a wiimote which is written for .net.

The source code for my project can be found at the wiimoteproject site under downloads>wiimote projects> finger tracking> Jakes Finger Tracking Suite (BETA) if you want to have a look at my source code.

[elmonaliza91]

what is the tools that you are used ?

[cloudflint]

@elmonaliza91 I used a wiimote and an array of infrared LED's for trakcing the fingers. You can see them setupo in the video "free air finger tracking setup". For the software side i used a combination of glovePie and visual basic

[dhaval17]

Hey i found a similar software available for free on net.....

DMouse by robofreaksindia

just google it out

Its camera mouse which can work with any object......

download now bcoz they have released beta version and its free.....

[cloudflint]

Yeah as it is its pretty useless, not refined enough for a practical application. However the guy who developed the tracking technology i was playing with went on to do alot of work on a project called project natal which went on to be the kinect. Small steps is the key to science :)

[cloudflint]

@accaunt4o At this stage i was counting how many points there where. when you bent your thumb one point dissapeared and it registered as a click. For the final version I counted how many points could be seen from the side camera since if the fingers where held together it would only see one point but if you clicked with one finger it would see 2.

[accaunt4o]

Hi, I want to ask how you register if the user wants to click? when the second marker is hidden, or you track the relative movement of the 2 markers?