Laser tracking projection with Kinect and OpenCV

[radekrambo]

WOW!

I am very intrested in knowing more.

Im a VJ and laserist and have begun working with projection mapping.

I need a system that can do outlines in buildings with laser.

[Classickkkk]

1:30 for awesomeness

=

[3y3n5tyn]

awe dude soo cool! if you have a tutorial on how you did this it would be soo awesome

[yidongguancai]

BAD APPLE!! I LIKE THIS~~~XD

[HowJr]

Hello. Could you please share the code? I would like to apply this concept to a projector and auto-calibrate an image onto a flat surface at an angle

[L3G3NDARYK1LL3R]

Sounds scary...

[monkeyking1b]

i have this pc also

[webmastertool]

Open source ftw.

[DunkelStern]

why camera makes noises when laser shows up?

[Mr12stringbass]

@DunkelStern

It's not the camera, it's the scanners

[11m4357r0]

the song sounds Japanese(hard to hear), am i right, and if so, whats the name of it?

[niconicokoibito]

@11m4357r0 bad apple from touhou

[xandrexandrex]

O.O great!!! i love this song

[kiyotewolf]

When you loaded up "Bad Apple" I was like, whooooa snap, I love that video, especially the hacked amber monitor version that the one guy put out. Doncha just love open source stuff?

[casse93]

Well, luckily microsoft have decided to actually support the PC kinect modding by making it officially compatible with the pc...So now even more people will be able to make mods for it! :D

[marcan42]

@casse93 Actually, you can't use Microsoft's Kinect SDK with OpenLase and JACK as I do here because they specifically forbid you from using it together with copylefted open source software. Doing this with the Microsoft Kinect SDK would actually be illegal, while doing it with the OpenKinect libfreenect driver like I did here (or rather, its predecessor) is entirely legal.

Microsoft is trying to lock you in to their driver and delegitimize everything that came before it.

[casse93]

@marcan42 I certainly see your point, but you still won't have to use the microsoft sdk if you don't want to...And what I meant was that it will make it accessible to more modders

[GamerMGO]

the anime lazer part was a good demonstration and it was pretty cool

[tompare26]

lol bad apple

[dekoky]

wich drivers did you use to let OpenCV interact with the Kinect? I'm working on a hand tracking project using OpenCV and I want to make it 3D! thnx

[Tumoxa89]

Why the fucking anime??? Hate it.

[sims3nudemod]

amazing the kinect is and still not used to its full but wow :DD

[BluAlaris]

This would be really cool for augmented reality, but also dangerous, since you don't want to blind people.

[YOUxFUCKxCATS]

Eww fag nerd music

[zedmelody]

that bad apple projection works great! really nice work!

[ChinnyxD]

Touhou!! <3

[JominatorXS]

Nice.

And what do you want to show us with that?

[phelpe]

omfg o-o' i jizzd all my pants!

[Lexygoy]

@gamesterNo0bo1 what are u referring to !!!!!!!!

Check ur name b4

[gamesterNo0bo1]

no fucking life !!!

[AdvokaraOfficial]

OMG I TOTALLY LIKED THIS VIDEO FOR BAD APPLE!!!! >: D FOREVER!!!

[darkflame603]

Furries FTW!!!

[imafurryhusky]

@darkflame603 Why on this video?

[darkflame603]

@imafurryhusky Why not :D

[imafurryhusky]

@darkflame603 ... it has nothing to do with furries....

[darkflame603]

@imafurryhusky cat ears 1:32

[imafurryhusky]

@darkflame603 ok...

[nndhawan]

How much experience have you had with computer vision? I'd like to know cause I want to mess around with the Kinect using openCV.

What helped you the most using openCV? Any tips or tricks my good man? (Just interested cause you said it wasn't too bad and I'm a bit surprised cause it seems a little tough to me).

[TiagoTiagoT]

You know what would be awesome? Overlay low poly wireframe generated in realtime based on the depth data over any object that gets in view (so if you steped in front of the system it would look like you're a low poly model of yourself with highres texture and normal maps) 8D

[jasperdj]

So when was the party, tomorrow?

Excellent work!

[NitrousDragon]

cool, and surprise Amine FTW :D

[jd18504]

omg creepiest laser video ever.....awesome

[SoulTaker1003]

this is fkn crazy how the hell u do this

[HVXSilverstar]

Amazing!

[sethkazzim]

Wow, top class. I hope you can make this into something very soon.

Keep up the innovation!!!

[Fabama08]

Wish I could see this for real. The Camera capture speed is not doing it justice.

[sammyharvest]

wow u can do all this in ur room what if u had a team of people helping u you could change the world

[880114]

cool, can you use it on window or do you need linux ? what do i need to try it :D

[badeed2]

song name is Bad Apple

[Polum824545201]

can you have it capture the outline of your body and project the laser around it as you move? kinda like a laser shadow? that would be sweet

[FndASltn]

I have that computer!

[mcloven83]

Awesome

[TheK1t3]

Wow. excellent work, man.

[Audiometricable]

awsome!!come watch my vids tho!!! thier funnnnny....:)

[alexutubeutube]

We also used OpenCV to detect and track people:

/watch?v=x--xlKWBTAE

"Real-time People detection and tracking with multiple Kinect cameras"

[meinotherside1]

cool!!! i like this project!!

[vizard00]

the dor is open 

[TheFXGuy]

13000 views, 95 likes and 0 dislikes. That *really* tells you something :)

Great job.

[ZoofTv]

Nice work man!! Love the tracking application with openCV. I've been working on similar stuff with laser, check out my vids.

[lometje]

I don't know if your laser also had UV light in it, because that could distort the kinects UV dots.

[AlexCorvis666]

Tío, no entiendo pq siendo Español, no usas nuestro querido castellano para hablar en el vídeo....pq siempre todo en Inglés??? Español coñeeeee!!!!!!

[Thoran666]

So how is Kinect useful to this? For all I see you are using OpenCV for the tracking which means any webcam stream could be used. Or am I wrong?

[marcan42]

@Thoran666 I am using OpenCV on the depth feed, not the RGB feed. The depth feed can distinguish objects independent of their contrast or color or even in total darkness. For example, using just the RGB feed, OpenCV would have a hard time differentiating between the white box and the white wall behind it, while it's trivial to pick them apart on the depth map.

[eduardoyanez54]

i got a kinect u need to show how to do this no matter how hard it is!

[aloishis89]

what kind of laser projector are you using?

[grangeke]

for those who don't know it's from touhou - bad apple

[TomsteurhToast]

Thats so Epic cool! btw whats the sing called? and is it safe to look in the laser?

[Virtualmix]

Thanks guys! My friends says it's a Canadian accent and I think they're right :-p

[Aludes]

@Virtualmix marcan is spanish

[ganstabreakincity]

@Virtualmix he has been studying english in USA.

[Virtualmix]

@ganstabreakincity: Thanks, he has a really good English. I'm impress and I wish I'll speak like this one day...

[RyxEuclie]

@liquidk9 Bad Apple

[Virtualmix]

What kind of English accent is it?

Australian accent? London accent?

(I'm not English but I try to recognise every different accent... Thanks)

[TheGameBWS09]

@Virtualmix sounds Scandinavian to me

[Virtualmix]

@TheGameBWS09 : Thanks!

[zockenderzocker]

@Virtualmix He's Spanish ;)

[masterpj55]

Really nice ;3

I hope to see a release of your openlase.

It sounds really interesting

[foxsix]

tio...haces que me sienta orgulloso de ser español

[Bowsakirby]

yay! finally a good use for kinect!... LAZORZZZ!!! XD

Awesome, man, totally awesome! =D

[dnstje]

Thats kind of nice ^^, and poor scanners making that sound at the 4 point box heh.

[fluxu5]

Fuck man, you are a genius sir!

[dkconor]

You seriously need to attach these videos to your CV.

[multisimple]

do you use linux or win? if linux which distro and which IDE to program??

[lowtone10]

@multisimple it looks like linux with KDE

[multisimple]

@lowtone10 i actually meant IDE as in Integrated development environment

[xSkidmarK]

dude!...you are the man!

[qdog1342]

Wow... Just Wow.

I'm amazed...

[dannyland1]

wtf!!! its ridiculous the power of open sourced technology, and no wonder companies don't like releasing open sourced products! they'd be competing with their consumers for technology lol

[Lollocide]

@dannyland1

Actually, I figure most companies don't like releasing open source products because they don't make half the money they could make on closed source :p

And because it only takes one dickhead programmer to make some code that royally screws the device over.

Also, AWESOME VIDEO!

[nndhawan]

@dannyland1 as it should be! 

[CongressmanPeanut]

@dannyland1 Microsoft stands to gain a lot from things like this because people who would otherwise never buy a Kinect are buying Kinects to mod like this guy did. Microsoft actually is planning to release their complete driver software so projects like this can happen more and more effectively. The technology in the Kinect that Microsoft is now making open source is revolutionary and was previously only available in labs and cost thousands of dollars, so it's a big deal.

[crajonv]

Keep making Kinect video's, all the blogs are picking it up.

[ohdreeaa]

awesome!

[Daco65]

impressive man :')

[wwjoshdew]

I am glad I subscribed to you! I also get RSS feeds on new videos. You are awesome and amazing!

[MossdeepCity]

Very nice Marcan. You're great with this stuff!

[Awesomeman552]

This reminds me a little of Jonny lee or whoever. Ya know the guy with the wiimotes.

[sk8rked]

@Awesomeman552 yeahh, I was thinking the same thing.

[Silenux]

You are Amazing!!!

[AluProductions]

lol is that touhou or something?

[Loridaz]

@AluProductions Yes, this is touhou - Bad apple

[maxsilos]

This is really cool,...

[andreiamenta]

awesome man, awesome

[vidiosity]

¿ y ese rayo láser de color verde lo proyecta kinetic? O.o

[elboru13]

@vidiosity no mira sus otros videos....

[inulani333]

coool!!!

[carlosnba]

simplemente alucinante lo que puedes hacer!

[wysong85]

Very cool!