3D Video Capture with Kinect

By combining the color and the depth image captured by the Microsoft Kinect, one can project the color image back out into space and create a "holographic" representation of the persons or objects that were captured.

No project page yet, but it will go up on my regular web site, http://idav.ucdavis.edu/~okreylos/ResDev

Based on the reverse engineering efforts of user marcan42.

Category:

Science & Technology

Tags:

• Kinect
• xbox
• 360
• camera
• hack
• 3D
• video
• capture
• holographic

[TheDeepsal]

can the 3d video be recorded and somehow be played on a 3d tv?

[okreylos]

@TheDeepsal Yes; the video is recorded into a 3D geometry stream, and can be played back from any point of view, and on any type of display (including stereoscopic). My videos "Picnic Day Exhibit Test - 3D TV" (watch?v=wM65Gx08A0M) and "Exploring the El Mayor-Cucapah Fault Rupture Using LiDAR Viewer" (watch?v=_e2DsZ40sqg) are already in 3D, and should work on your 3D TV depending on your YouTube viewer settings.

[gonewiththewind152]

@okreylos: I read through your code, I did not understand it clearly so please correct me if I am wrong. I am only concentrating on your drawing function which is the "draw" method in KinectProjector. As far as I understand, you are using opengl VBO and vertex array to draw surface and texture mapping for colors, is it correct? I would like to ask instead of using texture, can I use glColorPointer instead? Which method is more efficient in the execution time?

Thank you very much :)

[okreylos]

@gonewiththewind152 Textures will be more efficient, because the color data naturally comes as a (projective) texture. To use vertex colors, you'd first have to perform texture lookups on the CPU side to find colors for each vertex, and then pass those to GL. The GPU is much better at texture lookups.

Additionally, there is no 1:1 correspondence between color pixels and 3D vertices. Texture mapping will automatically adapt to that.

Bottom line: You can generate vertex colors, but you shouldn't

[gonewiththewind152]

@okreylos: is it possible to build the Vrui and Kinect on Window instead of Linux?

Thanks

[okreylos]

@gonewiththewind152 The Kinect package is somewhat OS-independent (you'll need a libusb-1.0-compatible USB library), but the Vrui toolkit itself does not port easily to Windows.

[CiiTrusHD]

CollegeHumor made a skit/copied you.

Thumbs up if you agree.

[okreylos]

@CiiTrusHD That's funny, and I do recognize myself in it. Especially the beginning, which is directly lifted from this video, and the general delivery. But they got the accent and body type completely wrong. ;)

Still, cool thing. I guess that means I'm famous now.

[rickywagner1229]

Good program and virus free. Surprised me when it picked up a 4000 in one day. Mad props Grab it here: tiny.cc/working-hack

[HrishiKod]

@philip1201 Holy **** man that was so cool thanks for bringing it to my attention

[philip1201]

@HrishiKod Indeed - watch?v=m5rlTrdF5Cs (transparent window-tablet thingy).

[HrishiKod]

anyone else think: MINORITY REPORT

[oPlaZiiMx]

Remember when it was called project natal

[cca0jj]

So what would a 5 camera array cost?

[ernst1wehrle]

Very great stuff,thumbs up

[LeNZian]

@krisreckner Why? So the can sit down and watch you while you play with the kinect?

[krisreckner]

YOU PEOPLE ARE CRAZY FOR LEAVING THIS PLUGGED IN ALL THE TIME. THINK ABOUT IF YOU HAD THE ABILITY TO 'HACK' INTO YOUR FRIENDS KINECT FROM YOUR COMPUTER WITH HIS IP ADDRESS ETC.--AND THINK ABOUT THE FACT THAT A WHOLE CORPORATION HAS THAT ABILITY. THINK THEY ARENT DOING IT>>???