XenoMuta - opencv + openframeworks greentracking Jedi Simulator

Early experinents on two green point angle/difference tracker with overlay graphics...

Category:

Science & Technology

Tags:

• opencv
• xenomuta
• openframeworks
• machine vision

[bahamutv8]

Nice! Can you tell me how to track green color as accurate as yours? mine has a lots of noise and not as accurate as yours..

[xenomuta]

@bahamutv8 Thanks. Well, what I do is this:

pix = r + g + b;

for every pixel, if (g / pix > .45) && (g > 0x40) i turn the pixel white else i turn it black,

then I do a 5 scale blurGaussian and then a threshold of 25 percent.

Thatĺl turn any group of noisy green pixels into a big blob you can track easily.

[ucsandeep]

hi, nice work!! can ut ell me which framework did u use for 3D model overlay ?

[xenomuta]

@ucsandeep Thanks. I am using OpenFrameworks with the ofxOpenCv addon.

Don't bee fooled by the looks of it. there's something fairly being used here as It isn't real 3D going on with the overlay, but a simple rotate and scale of images depending upon distance and angle between the two biggest green blobs found on every frame.

If you want I can send you the source code, but I am not proud of it yet, 'cause I'm just beginning to use OpenFrameworks and it might still be a little buggy.

[gaikari]

@xenomuta HI, it is a very very nice program. I am very new about opencv and openframeworks. I am doing a project for hand tracking and gesture. I would like to ask how you could take off the noise? and how you could track the hand smoothly?

[xenomuta]

@gaikari ありがと

I am not an expert myself, just learning. my case is very simple because I am only tracking colors ( green in this case ).

For noise, increase or decrease threshold on the gray diff image or play with some blur too.

hand tracking little bit more difficult.

try convexity detection or triangle detection algorithms on the hand's and finger's blobs.

However, the best results I have seen are done with convex-hull method in openCV.

[ucsandeep]

@xenomuta Thanks for the information!. The sword really looked like a 3D overlay. I will try to use OpenFrame works. It would be really helpful if you can send me the source. I was thinking of using OpenVRML and have VRML models overlayed.. but seems a bit tough.

[AladeLud]

ohoohohohoohoho

yo lo kieroooo