Laser tracking projection with Kinect and OpenCV

I finally downloaded OpenCV (an open source computer vision library) and spent some time learning about how to use it. It was actually surprisingly painless once I got the hang of it, and there are lots of things you can do once you feed it an image (in this case, the depth image). What I did was rig it to track contours on the depth image, and attempt to pick out a rectangular object.

Then, by using the detected location of the corners, I can apply it as a perspective transform to my laser projector. The end result is that the cardboard box I'm holding becomes a "virtual screen" that is tracked by the laser projection in real time and in perspective :)

Category:

Science & Technology

Tags:

• kinect
• opencv
• laser
• track
• 3d
• projection
• tracking

[casse93]

Well, luckily microsoft have decided to actually support the PC kinect modding by making it officially compatible with the pc...So now even more people will be able to make mods for it! :D

[marcan42]

@casse93 Actually, you can't use Microsoft's Kinect SDK with OpenLase and JACK as I do here because they specifically forbid you from using it together with copylefted open source software. Doing this with the Microsoft Kinect SDK would actually be illegal, while doing it with the OpenKinect libfreenect driver like I did here (or rather, its predecessor) is entirely legal.

Microsoft is trying to lock you in to their driver and delegitimize everything that came before it.

[Thoran666]

So how is Kinect useful to this? For all I see you are using OpenCV for the tracking which means any webcam stream could be used. Or am I wrong?

[marcan42]

@Thoran666 I am using OpenCV on the depth feed, not the RGB feed. The depth feed can distinguish objects independent of their contrast or color or even in total darkness. For example, using just the RGB feed, OpenCV would have a hard time differentiating between the white box and the white wall behind it, while it's trivial to pick them apart on the depth map.

[11m4357r0]

the song sounds Japanese(hard to hear), am i right, and if so, whats the name of it?



[maarigemunir]

how did u mange to integrate kinect with opencv????

im also trying to do the same bu am stuck for a while now....

thanks in advance

[radekrambo]

WOW!

I am very intrested in knowing more.

Im a VJ and laserist and have begun working with projection mapping.

I need a system that can do outlines in buildings with laser.

[Classickkkk]

1:30 for awesomeness

=

[niconicokoibito]

@11m4357r0 bad apple from touhou

[3y3n5tyn]

awe dude soo cool! if you have a tutorial on how you did this it would be soo awesome

[yidongguancai]

BAD APPLE!! I LIKE THIS~~~XD

[HowJr]

Hello. Could you please share the code? I would like to apply this concept to a projector and auto-calibrate an image onto a flat surface at an angle

[L3G3NDARYK1LL3R]

Sounds scary...

[monkeyking1b]

i have this pc also

[webmastertool]

Open source ftw.