The Kinect Sensor in Mobile Robotics: Initial Experiments

[pils7ern]

That a great accomplishment for robotic, Thank you Microsoft

[tania2020tania]

Great job

[DarthValdus]

:o

[5519822018]

the kinect robot will soon become the decepticons

[TylerSierp]

/watch?v=eyyUXZzKYr4

Mocap with kinect

[pssonyreviewer]

combine this with the 3d camera idea from Okreylos and you can reconstruct and explore 3d space

[roidroid]

i don't understand why it has a Laser rangefinder AND a Kinect.

It only needs one of them, not both.

Ditch the laser rangefinder.

[DNM195]

wow that's very cool!!!!!! how long did it take to create it??

[gbirbilis]

MRPT (mrpt.org) visualization and point cloud classes used in Xbox Kinect demo

[Topoxygen]

so short :/. MOAR

[BRICSproject]

Nice work!

[MrSayon123]

Wall-E

[Nicklaspm]

Please make another video with it, where you talk and with sound ^^

[Midevilshadow]

1:04 TARGET ACQUIRED

[snakinator9000]

Check out this new snake robot project at snakinator.pivut.com. It would be great to have this on it.

[DementedView]

I can't wait for the HAL 9000 hack.

[XpertGuides]

I saw a video with colour images, is that coming?

[JefteLopezNY]

So can it vacuum my living room without getting stuck?

[SelfDestructionPro]

That's really cool. Amazing work.

[callofgears91]

i can see this been used on the military

[WinterContingency]

You should program in voice commands since the Kinect already has a microphone built in

[Vaulkai28]

Pitch this idea to the military, would be a great way see in houses.

[vvaalleerraa]

Hi! squadbot, you can use "axis vis3d" command in Matlab for making rigid animations without irritating rescaling.

[squadbot]

@vvaalleerraa thanks for the note, very useful!

[BRICSproject]

Thanks to the Personal Robots Group @ MIT

[chahid1992]

wtf lol u made a terminatorXD

[bananenweizenD]

great work :D

[TofuRealName]

What sort of sensor does it use? Does it operate in no or low light conditions? The applications are pretty amazing.

[auspolk]

@TofuRealName It has 2 cameras, one colour one BW/IR and a projector for a grid of IR points of light for the 3d map. So yes the 3d capabilities should work great in low light, just not the colour imaging.

[GreenFish471]

lets ask it what's the sence of life....just sayin :)

[AllisterCaine]

this robot features a breaking invention. its able to avoid hitting walls!

[BinchuanWang]

Cool.

[jogi836]

pls mak more videos and push it in youtube, thx

[jogi836]

fantastic



[jeobeahon]

sooo... any see the Animatrix?

[arcadiandelsol]

If you built a shell around it to make it look like a tiny Dalek, I would buy four of them immediately.

X-TERMI-NATE!!

X-TERMI-NATE!!

[guff1988]

could you imagine the implications this could have on warfare in the future?

James Cameron did.

[kaeligh]

Wouldn't it work better with two eyes set further apart?

[bv90andy]

Microsoft, driving evolution... even if they don't want to.

[FaithlessFate87]

Didn't they already have 3D cameras that simulate the first part of the video? The second part is mean though

[EijiShinjoh]

Kinect is SkyNets eyes!

[Kaeman72]

I knew Kinect would be used for something other than games... its technology is too vast to encompass just the entertainment industry.

[metimmee]

Nice vid - its a shame Microsoft didnt release drivers/dev kit and encourage other uses for the Kinect camera.  It was obvious from the beginning that it would have applications like this.

[oMRCHUCKo]

What 3d modeling software?

[theskiesbelowme]

Nice work!

[shadowninja7194]

omfg, this is genius. Good job mate

[assbitchfucky]

Does it use thermal imaging ti detect the human?

[PhantasmRaikiri]

You see, that's why I got a robot arm. If they take over, I can at least be a half-citizen.

[jaydavey9]

This is really great work! Well done.

[zifoon]

Why do ppl assume robots will kill people if 'those things' have any sort of intelligence.

On anthoer note, I welcome our new masters, the robot master race.

[abram730]

@zifoon Because that's what they would do.

[AIchigo]

You're awesome, that's why you are in MIT, that's merit.

[sneakyboxx]

Xbox Kinect terms and conditions ; avoid producing killer robots using the kinect sensor =D

[MrRazvan19]

nice,the new terminator

[ricardochriste]

@MrRazvan19 actually, it's the earliest Terminator prototype. But they'll hook up with Skynet Venture Capital, LLC sometime in the near future.

[DANILOCONECT]

vejam meu vlog

<<<<<<

[k0llege]

nice!

[merschix]

godness

[SilverGunZoO]

omg you guys are looser, enough with killing robots, robots are perfectly saf...

-killed by a robot-

[RaheemMusic]

@SilverGunZoO pahahahahahahahaha...

-killed by robot-

[NMT1995]

i dont understand it but NICE

[vghavgha2]

Shit, we are going to need a lot of emp in 2012...

[onlyazrael]

judgment day is arrived, robots killers vs human soldiers. terminator is true.

[MasterxKenobi]

Kill it with fire.

[26octobre93]

let's hope will smith don't die..and transformers exist..

[UmaLacka]

cool... but..omg!

[k1dicarus]

Initial Experiments ... that´s what Miles Bennett Dyson tought.

[StaminaPower]

feindliche Fernlenkladung unterwegs!

[juanm35mm]

I think that these guys are gonna be killed by a terminator from the future to prevent the judgment day

[mecozir]

Basonlost nuibe come ins kiaere waure siempoe link...

[Cheevus]

omg we are all doomed

[DerRealeHater]

Dieses Video ist schlecht! Muhahaha

[innerflamer]

Congratulations, you guys have single-handedly brought the Robot Apocalypse upon us all! =D

[onlyazrael]

human recognition =robot killer, kinect future soldier ever.

[FallingRabbit]

1:04 showing directions... heil hitler hahahaha

[fanty12]

garbage.

[TaErog]

Very nice (Good use of existing tech - these are not easy to make at that price and size)

[DreamHallow]

Johnny 5 is alive!

[DwamGorgeousKids]

add a paintball gun......shoots when a person is detected....awesome

[FICTI50]

Bill Gates create SKYNET, MAC create TERMINATOR XD

[RaymondFRevalee]

fuck how much is M$ paying people to make this piece of fucking shit SEEM useful or even interesting at all? it's a fucking Playstation EYETOY for $150 save your money and just buy a PS3 bundle with MOVE controller and Playstation EYE etc.

[toipee]

@RaymondFRevalee eyetoy is copletely garbage.

[bigchoonage]

@RaymondFRevalee This video isn't anything to do with microsoft, its just some people that have bought the kinect for science type experiments. Why you mad though?

[xHexagonx]

@RaymondFRevalee LOL, you obviously have never used one. fanboi.

[GreatVomitto]

GET MY BEER BITCH!

[puronarulu]

@GreatVomitto HAHAHAHAHA xD

[lmola501]

ye but does it know where the kitchen Is

[qw211212]

wall-e

[Zeeeeeek]

4 dislikes. oO

John Connor as a mature, John Connor in his Childhood, his Mom and the good Terminator :/

[Goruneluuuuuuuuuuuuu]

3 dislikes? John Connor, his mom and terminator :(

[Pinworm4]

@Goruneluuuuuuuuuuuuu THOSE JOKES ARE STILL REALLY FUNNY

[jcwhite1288]

lets just hope it doesnt figure out how to divide by zero

[LordXmen2k]

Now thats some Terminator shit

[CamaroHappy]

We can already do waaay more advanced stuff than this its just the lack of funding that cant be released to the public or anyone else :/

if the government would give funding to these smart individuals we would be in a very futuristic world.

[sonitekca]

kinects sensing technology is amazing.

[makro9000]

looks like a remote controlled ground frisbee with a kinect glued to it

[vipers531]

Rumbas still around?

[Treboura25]

1 dislike? Hmm, must have been John Connor . . .

[feveronceagain123]

And it Records footage too , this is the FUTURE

[Gmod105020]

Kinect Robot's super power is... SHOOP DA WHOOP *Robot takes out tiny lazer gun* Guy:Oh Pfft, thats nothing we should worry about. Robot: IMA FIRIN MAH LAZAR!! Guy:OH SHHHHHH- *Huge lazer shoots out destroying half of the planet*

[coopf]

OMG A RUMBA...

[SuperYoche]

"EXTERMINATE"

[rulesandwisdom]

Unfortunately the depth sensing relies on an invisible grid which is projected out of the camera. This means as it is, only one Kinect camera can work in a space. If there was more than one, they would disrupt each other's depth perception.

[obone01]

@rulesandwisdom is it all using IR?

[MrStimpy77]

If it can map voxel space as shown in 0:32-0:37 and in 0:44-0:50 it'd be nice if it could identify flat surfaces and then texturize them with photo camera imagery, making a true 3D space recreation with image mapping. Isn't this something that John Carmack was working on for a couple years a decade or so ago? He was way ahead of his time but it seems now's the right time to make it happen.

[marcofe82]

i'm italian student and i'm studying informatic engineering..this is amazing..why i bore in italy..I WANT TO GO TO MIT!!:( Ps Good Work really :)

[jakub77a]

Looks like robot from Death Star. What will be next ? Lightsaber ?

[du0lol]

It's actually just the world, people. If it was invented for whatever other works, people would make games for it, so quit whining plz.

[1337soldiahs]

It sucks for gaming. It's awesome for lots of different things, like 3d image capture, and robotics.

Wonder if microsoft saw it coming...

[aianyoung]

The potential for home brew projects based on the kinect are far more interesting than any of the kinect games i've seen so far.

[linuxares]

Cool, nice work guys at MIT

[xKami102x]

Oh my God.

It's happening.

Find John Connor! Tell Him about thi--

-killed by the Kinect Robot-

[MrMiEsFiEs]

@xKami102x  Affirmative.

[MrMiEsFiEs]

@xKami102x Beep Beep Beep. Target terminated. Hail to the mashin---

---killed by John Connor---

[AceVanquish]

It's a TUG. They've been doing similar for years.

[thufirhawat333]

Wall-Eeeeeeeee!

[zomgpriest]

Fascinating that you could do this with the kinect device, makes you wonder if the technology used in the kinect are any similiar of the more expensive robot vacuums. Those that can navigate the room themselves.

[ElKeeed]

So is it using kinect for slam or the laser?

[DrakenZA]

@ElKeeed ? Can seen you u one the ppl who think kinect is a webcam. The kinect shoots the laser, the kinect reads the lasers, kinect finds the 3d stuff. SLAM then puts into a 3d world. Stop hating on kinect.

[AndrewMohawk]

v. cool! Are the images being processed on the robot itself, or is that whole pc just for transmitting the data over the wifi link?

[joicemedia]

Person detected in scene: DESTROY

[IWearMyCapBackwards]

@joicemedia "Boom"

[nesportskid]

incredible..great work

[canuckxpride]

this renders my entire senior design project moot. you guys rock.

[nesportskid]

@canuckxpride lol..we have a pretty similar senior project as well..i was like wow maybe we could..nope..this is def too advanced for us haha

[canuckxpride]

@nesportskid we actually ended up doing the same thing... except using really cheap sensors..

except these guys.. 1) made it in a week apparently... 2) more applicable because it uses camera vision... and 3) it just rocks...

puts our project to shame... and probably 10000 others

[canuckxpride]

this renders my entire senior design project moot. you guys rock.

[flyingpancakes1]

This is yet another amazing application for the Kinect

[gallamine]

Have you seen the bounty for hacking the Neato Robotics XV-11's lidar? It could replace Hokuyo lidar you have on top and make this a really affordable robot system. Just Google "open lidar project".

[Peon546]

this is amazing!!!!

[wheagy]

Excellent. Please share details of the code for the 3D scene construction and SLAM.

[JulianWag]

thats awsome.....!!!

[rdulgarov]

I have to say I'm impressed with the speed and resolution

[0xParse]

Looks promising! Can't wait to see what you do with it.