Kinect Augmented Reality hack with Doom 3 character

[reinventedloserben]

So now take this replace a wall in your home with an led screen, now you can have a window to a better reality, where you're standing in your living room, but the wall reflects a devil on your shoulder, or a dragon running around your couch...think of the bedridden sick kids, how much fun they could have...the elderly could see themselves in heaven as only science could show...you combine this with artificial sunlight, ambient wind and olfactory effects--you could go outside, inside.

[VagnerFesta]

Man! Do you realize what you did? This can take the virtual sex at a stratosferic levels!

[raschija]

putziges teil. will ich auch haben=)

[djberockin]

why...

[iatemeatwad]

suddenly i see that the kinect should be used hand in hand (no pun intended) with a mouse, and better yet, a PC...

[abram730]

Amazing what you've done so quick

It would interesting to make it imagine unseen parts from what it's seen before. Adaptive 3D to fill in the gaps. Construct missing geometry and create textures.. you could even up the texture resolution over time as it gains enough samples.. Then blend the video with the texture.

With enough time and effort it could have a huge number of "professional applications"

[meeniemuffin]

ld love to play hide and seek with it :D

[enwelz]

Someone needs to tell Microsoft's hr department about YouTube.... maybe then they would get some quality kinect games. Oh and fire Steve balmer, I mean the company has been mediocre at best since gates left

[TheRobot452]

He looks like an elf without the side of his head visible.

[ebgrisi]

I think you hacked this thing so much it's already better than the original

[vincent154451]

I would buy the kinect camera just to do these things!

[carl81985]

That is freaking awesome dude, I wanna video chat with scary monsters behind me as body guards, NOW!! LOL

[Harrysound]

BURN HIM!

[systemaddictshock]

all we need now is the ability to project and we now have 3D holographics. I wish I can be born again in another life after this one.

[XmegaprrX]

@systemaddictshock you probably won't need to be reborn into another life. I can pretty much guarantee you that in less than 20 years, you will have holographic technology and much MUCH more. And if you are less than 20 years old, maybe even 25, you will probably live long enough to see our lifetime expand from two digits to three.

that is of course, if we don't go extinct beforehand. ;)

[Superbradman1]

160 FPS seems really high. Is this because of the 3D?

[semphony100]

Maaaaaaaaaaaaaaaan that's what the augmented reality been missing hurray

Kinect is the perfect solution for capturing real time Z depth info for adding a CGI on it

Damn it it won't be long before we c kinect sensor on a pair of glasses like vuzix adding reltime not only CGI graphics but also real world 3d info as well

maaaaan the stars are the limit for the applications here..!!!!!!!

[okreylos]

BTW: If you want to discuss this video, or ask questions about it, please do so at the original video's comment page. This is just a copy that some dude re-uploaded. If you post a comment here, I won't see it.

Original video: /watch?v=N9dyEyub0CE

[cielseven]

Can we get some "ALICE AI" + Kinetic yet?

Until that is done, everything is wasted time... @_@

HMM MAID OS, CAN I HAVE IT? LOL

[airfaith]

boring

[Graype07]

@airfaith

Faggot

[spartand001]

@airfaith stupid kids

[sonic555gr]

can someone please explain to me what happens to the camera after 01:00 ?

[DerTiger]

@sonic555gr

kinect films him from the front and creates a 3D-Image. the viewpoint is not the real kinect-image, it's a virtual camera, so he moves a virtual camera inside this "real" 3D space.

at 1:08 you can see that kinect can't see his back, so you can only see the right side of his head and his right arm, his left arm is missing cause it's hidden by the right arm.

this is awesome

[ptekelly]

why isnt this on the kinecthacks net website?

[romanul70]

ME WANTS DOOM PET YES!!!!

[inr21sevier]

dudes u smell a holodeck in near future i love it keep it up

[TheLegendSniper]

This must-have technology will be the next decade’s laughing stock.

[hifhif123]

You just had some code lying around.... mark of a real hacker i guess

[vitto]

dude..that's awesome. I'm downloading the software right now.

[vitto]

the page doesn't word..damm

[CommanderKairu]

Dude this is so freakin awesome.

[madichelp0]

AAAAWWWWW It's so CUTE!!!

[jorgento]

sweet character :)

by the way, keep on the good work

[theatticusera]

Get this man making kinect games!

[KrazyKillProductions]

u r amazing no homo thouhg

[kyle789XBL]

large henti model and fuck her

[CatXFlash]

amazing... HENTAI NEXT!! lol jk..

[trobe23z]

Your amazing bro, well done, I think its more impressive how quickly you did this kinect is still pretty new

[peepdust]

It would be awesome if it would react to your actions

[oshergluck]

now you just need to interact with it by a gun or something that you need to built

and write a program that let you see the real image from the camera + the model that you entered

and you create the game that i ever dreamed about since i saw the episode of jonny bravo with the helmet game

[spopajr]

its the first ever holodeck.

[spopajr]

total stud.. keep it up.. good job!!

[Anfieldb0y]

Beware the goat

[artisart]

imagine what you could do with 3 kinect cameras :)

[IXPrometheusXI]

@artisart Sadly nothing... the kinects would interfere with each other. I know; I had my dreams crushed too.

[artisart]

@IXPrometheusXI that may be true, but its theoretically possible with some software hacks :)

[hesido]

You seriously need to start working on getting 2-3-4..N number of kinects work together to create one seamles perfect 3d replica of a location. The depth shadows parts could be filled from input from a second, third kinect! (I'm sure you have thought of it)

[chuckar0o]

would it be possible to hook up more than 1 kinect device to your 3d rendering software to get a better 3d models?

[uidsea]

I realized just now the kinect would be a fun as hell purchase

[dunkelblau2006]

In Soviet Russia, doom character plays YOU!!



[plandercozeron]

@dunkelblau2006 this joke isn't funny anymore

[TheEthiopianDJ]

Why Reupload?!?

[soulsummenor]

how did you make the camera go around you like your in the matrix???? that is freaky

[DeepBlueTrees]

Great work. Could it potentially work to have another Kinect camera on the other side of you, and have it model a complete 3D world from the two videos?

[dupa333jelenia]

@DeepBlueTrees

Good question.

[caius112]

I remember reading a series of articles on augmented reality back in '07, I never would've thought we'd have it this soon. Amazing. The kinect may be a worthless gaming device but it's a godly 3D tool.

[dreamkatana]

Is that a penis?

[Ablequerq]

Are you a wizard?

[SBarrettM]

@Ablequerq where is his monocle?

[FancoiseT]

@Ablequerq lol!

[svenisnumb]

Great work! Can easily be turned into a virtual pet style game! Augmented reality Kinectimals :)

[CyrusTheElder]

imagine playing small soldiers in your room... virtually!

[CyrusTheElder]

that monster is so cute!!!

[supergreg010]

so cool.

[mrnezinu]

buy a second kinect and make a full 3d room

[sarunic89]

Someone needs to buy you a few of these cameras so you can place them all around your room removing any dark areas.

[hyperkinetic]

@sarunic89 That would never work. Each Kinect projects a pattern, and multiple patterns would interfere with each other.

[Rapido3d]

@hyperkinetic Not necessarily, our body scanner works on the same principle albeit not IR we shoot 4 cameras at a time, Cyberware's body scanner uses a mix of IR and red laser, I think it can be achieved using filters.

[DustyDing0]

Well, you roughly stated most of the ideas, for supporting multiple kinects. However, polarization, which would be nice won't work of course! When you project polarized light on abritrary surfaces, the polarization won't be preserved. Therefore this won't be an option! Time multiplexing frame by frame will also be hard, since you assume that all kinects would be synchronized.

[spyro2000]

Wow, respect! Really like your work! So it's possible to do "bluescreening" without a bluescreen? If you use a bubble photo and sync this to the virtual camera...

[SammyGKay]

Dude your a genius, microsoft should hire you and next we know kinect 2.0 will be out ha ha

[8BitFox]

finnaly something awsome with the kinnect!

[FuzzyHead007]

Its just...wow...!

Its amazing what youre doing with the kinect! ;D

[Shakespeare1612]

Awesome. Could you use 2 or 3 kinects to fill in the blanks? I can see now why Microsoft expects to sell about 5 millions of these things.

[ozorg]

great!

[Cocky5vs]

wow!!!! YOU ARE GENIUS!!!!

[longerino]

Love my kinect

[discopanda1979]

Awesome, keep uploading this stuff!

[golfguyuk]

I can see this feature getting big in the porn business :) Very impressive!

[illestgon360]

@golfguyuk you sick bastard.

[loganroemer2]

Microsoft don't allow indie developers to implement kinect in theyr games.

[UnderdogSMO]

@loganroemer2 yet

[shawnzee102]

You have too much free time on your hands, you should spend your time making a game for xbox live indie games.