"Holographic projection" using Kinect SDK

[SLBPhantom]

hey, I am no expert on this, but if you use one of those transparent holographic projection screen, and put it on a rotating table that tracks you and face you all the time, then combine it with the head-tracking 3D to project an object on the rotatable screen, then you can walk right around it and look at the object from all the possible view! I really want to know how the effects look in real life...

[creap32]

4 words: Kinect is fucking awesome!

[comcipher]

This is AMAZING, very clever. Do you just track the head on the figure provided by the Kinect SDK for positioning, and move a camera in 3d space to adjust the projected image?

[programming4fun]

@comcipher Almost: the (virtual) camera is actually fixed above the scene. The actual scene is distorted to match the perspective (a technique apparently called anamorphism).

[2010Bieber]

What kind of projector ? Can it be any kind?

So u hook it up to the projector?

[programming4fun]

@2010Bieber Yes, any monitor will work too.

[ilovetheasians]

This very smart and very creative. I see a lot of potential for this idea.

[airfield20]

this would be awsome to control simple ipad apps or conect it a controller and have it control a game from birds eye view

[744268]

I figured that's how it worked.

[ModernEugenix]

Incredible stuff, the possibilities are endless in this, gaming, surgery, military applications (maps for search and rescue) and so on.

[EdEddnEddy4]

Fuck the thumbs up argument, this shit is awesome.

[GDuff123]

@alxrgoes So...thats a yes? You are angry?

And homosexual? Cuz i really don't want you putting anything up my ass.

[GDuff123]

@alxrgoes ?? Angry much?

[Degolegodyl]

Wow! Then this means we'll be playing FPS's actually having to look behind us! That will, not should, but will be cool

[LiamKeenanMOC]

imagine watching hologram porn... hurry up future

[GDuff123]

Thumbs up if you also got linked to this from the official xbox website :)

[narutogalvez]

@GDuff123 Thumbs up if this guy only wants to get thumbs up for himself xD

[GDuff123]

@narutogalvez Actually, i was just impressed that xbox's official site would link me to a youtube video.

[hockeynut4ever11]

when it said a kinect was used i stoped and thought....kinect is a camera not a projecter. it also judges objects distance. but i still have no fucking clue how they did it.. at the end i was like. really.... thats it....!

[darkcape5]

thumbs up if you came here from microsoft

[rickycolonjj]

thats freakin awesome!! can i buy you a drink? or a icecream? XD i can see how stuff like this can improve the, medical, military, gaming, construction, and design industrys

[cobr3n]

Wow nice! Now just get that room sized and have your own holodeck! :D

[sec713]

Awesome stuff. Keep pushing those limits.

[DrDoe1]

Amazing! Keep up the great work, I can't wait for the day when I can have one of these hooked up to a projector with 8+ screens on my wall, moving them around just for fun! How far away is that for us regular folk? In your opinion....?

[mrs420kantner]

That's freaking sweet, way to go dude!

[mcashatt]

Too cool!

[firemouth55]

Microsoft brought me here . . . and THIS IS AWESOME!

[bkc219]

by using the kinect to track body movements and head positioning, and wearing some fancy tv display goggles (like fpv goggles) integrated with 3D technology, we can make virtual reality gaming! thumbs up for a good idea? :)

[jdaff6539]

New 3D TV's

[gleb86]

I saw the same thing done with the wii motes a few years back. Can't wait for them to start incorporating this stuff into games and movies. Good job!!!

[roidroid]

@gleb86 Yep that was Johnny Lee.

Johnny Lee then went on to work for Microsoft on the Kinect project.

I'm not kidding.

[gleb86]

@roidroid that would make sense. He's a genious!

[Vaesyr]

Imagine an RTS with this. It would be so cool to command my troops on a coffee table. Couple this with motion control and you might have something spectacular.

[Sleeky20x]

this video is on xbox.com seriously

[Venerabela]

Highly impressive!

[ZayLong]

why do you say "pesudo" holographic??

[G4Br1ELCLM]

@ZayLong Because the hologram can only be visualized by one person at time, not everyone in the room.

[ZayLong]

@G4Br1ELCLM why is that? do you have to wear special glasses or something to see it?

[G4Br1ELCLM]

@ZayLong I think it is related to the ability of the monitor to project the image but only relative to one viewer, for it to work for more than one person you'd need either a set of projectors or very specialized 3D glasses.

But that is my polite guess, the author is much more capable to address those questions than me.

[amirashrafzade]

i wonder if it could do the same for more than one audience ...is it possible?

[programming4fun]

@amirashrafzade With LCD shutterglasses in theory it could work for 2. But for it to work from all angles simultaneously, a real holographic display would need to be invented :).

[pfrabott]

@amirashrafzade Probably not for the first version. However, I do see some later technology causing it to be possible. The real issue here is getting 1 person to see one set of images and a second to see a second set of images. Each set is hidden from it's other set. Currently, shutterglasses are the only way to do this. But there are other technologies in R&D that will cause you to see only 1 set of images depending on the person. It uses "gating" on the surface to "trap" the angle of the view.

[MrKfadrat]

amazing possibilities... if i only know how to program...

[ninetailedhollow5]

So, the kinect would track your position and adjust the image accordingly?

WHY IS THIS NOT IMPLEMENTED IN EVERYTHING EVER YET?

[OneCrazyDavis]

Lol

[Toasty3D]

So Microsoft basically never found something that would cause the world to be one step closer to Star Wars, and instead decided to make crappy exercise games.

[roidroid]

@Toasty3D developers developers developers developers

;)

[pyrix]

Now if only we can get it to actually be visible in real space!

[Faybro]

Cracked is wrong, though, because holograms do fucking exist.

[weswii]

Can i have the source code?

[soufang]

I like how the tank aims at you

[prototypepimpin]

@L337v1n337

pretty soon. the world will be turning to cracked.com for news. no wonder we have so many smart asses.:P

[ricool06]

Hallowe'en is coming up. Maybe you could scare the shit out of someone with a ghost instead of a helicopter. :D

[Simbobsilus]

Cracked also sent me to this awesomeness!! Make a game from this!

[buffer545]

Cracked sent me here to witness the future.

[awaws]

will this work on more than one people.

[TheBakachan]

Is there a version of this available for people to mess around with?

You know, if you put together a quick framework that'd let people plug in their own 3D models, it'd be a pretty big hit with us creative types who are maybe a little more than half-dumb in the programming department?

[snuurtje]

very cool, can you tell what software you are using?

[programming4fun]

@snuurtje My own :-). Written in C# and using (managed) DirectX 9 and the official MS Kinect SDK.

[janetgalore]

@programming4fun: I work for Microsoft and would like to get permission to use a short clip of this video in a compilation video. I sent you a msg here on youtube... can you contact me?

[programming4fun]

@janetgalore  I replied by every means possible. I hope at least one got through :)

[roidroid]

@janetgalore Director of "Microsoft Advanced Strategies & Research".

woa!

[DrBassdrop]

@programming4fun

Hello, I am a fellow C# programmer and I would like to know, is this coded/developed on the official SDK that Microsoft released? Or was the developed under the hacked drivers?

[programming4fun]

@DrBassdrop The official SDK.

[MouRG]

nice! great job, congrats

[SwiftBuffaloEater]

next a Holographic Striper just kidding

[KuwaitySoldier]

super fucking sweet!

[thegreengiant83]

Once you have the heads position relative to the kinect how do you translate that into the 3d camera 's coordinates

[programming4fun]

@thegreengiant83 The 3D camera doesn't move, it's the object itself that is deformed.

[thegreengiant83]

@programming4fun How does the deformation work?

[thegreengiant83]

@programming4fun How does the deformation work?

[programming4fun]

@thegreengiant83 Pretty simple equations, imagine a cube or a vertical line standing on the screen and how they would project onto the screen from your eyes. You'll figure it out ;-)

[thedorantor]

this is very cool... but what do i need to do this and what are the costs... in other words: is it payable?

[programming4fun]

@thedorantor All that's need is a regular monitor or projector and a Kinect (+/- 100 euros). The rest is software!

[thedorantor]

@programming4fun wow! can't wait to try it out!

[Matt23488]

Wow! It's really great to see so many people working on amazing software. I believe the Kinect is the first step into a world where using a computer requires no peripherals other than the body.

[mc71er]

Another super super cool job!

[MrFrontespizio]

great idea

[SeachMall]

Wow, now that's impressive. Simple idea but very well executed. Any plans to further develop it? Something like a remote control the tank or a chess game? It's very cool all the same, keep up the good work

[programming4fun]

@SeachMall Thx. Actually the chess game thing has crossed my mind...

[Lukeidea]

OMG O 0

How are you doing this?

Freaking awesome!!

[kakureru]

this is by far the best kinect hack I have seen to date.

Thanks allot!

[programming4fun]

@kakureru Glad you like it.

[oldmanKraven]

I would love to see some "radio controlled" aircraft that you could pilot around your living room wall while using head tracking to keep the observers perspective accurate. Plus crashes wouldn't cause damage to the aircraft or the spouses nick knacks.

[programming4fun]

@oldmanKraven That would be cool, but will you donate the 5 HD projectors needed to cover the walls and ceiling? :-)

[grimecube]

@programming4fun As long as you promise to one day deliver me 3D holo-porn, I'll donate you the walls and ceiling themselves.

[Croutonlol]

Star Wars here we come.

[programming4fun]

@Croutonlol Help me Obi Wan Kenobi!

[tzisorey]

Now THIS has potential for use in a halloween Haunted House

[springbat]

I'm really impressed!

what about a "making of" and/or an installer?

[programming4fun]

@springbat I'll try to write up a blogpost with code fragments this week.