3D Video Capture with Kinect

[rickywagner1229]

Good program and virus free. Surprised me when it picked up a 4000 in one day. Mad props Grab it here: tiny.cc/working-hack

[HrishiKod]

anyone else think: MINORITY REPORT

[philip1201]

@HrishiKod Indeed - watch?v=m5rlTrdF5Cs (transparent window-tablet thingy).

[HrishiKod]

@philip1201 Holy **** man that was so cool thanks for bringing it to my attention

[oPlaZiiMx]

Remember when it was called project natal

[cca0jj]

So what would a 5 camera array cost?

[LeNZian]

@krisreckner Why? So the can sit down and watch you while you play with the kinect?

[krisreckner]

YOU PEOPLE ARE CRAZY FOR LEAVING THIS PLUGGED IN ALL THE TIME. THINK ABOUT IF YOU HAD THE ABILITY TO 'HACK' INTO YOUR FRIENDS KINECT FROM YOUR COMPUTER WITH HIS IP ADDRESS ETC.--AND THINK ABOUT THE FACT THAT A WHOLE CORPORATION HAS THAT ABILITY. THINK THEY ARENT DOING IT>>???

[DefinitLeiMe]

can you use another kinect to fill in that black space?

[cezararmeanu55]

Ce căcat e asta?(laguage:romana)

[killaperson97]

i dont understand him

[me1ization]

This reminds me of the sims, only real life .D

[ramjetross]

you should add as many as possible. show results please

[xsjad0man]

could u have lots of kinects around in a circul and remake the famous Matrixs scene lol

[midierror]

nice !

[WaSHITinDITinekran]

HOW INSTALL THIS FOR WINDOWS 7 64BIT ! NEED HELP!! NEED TUTORIAL!!!

[dxmkrew]

I kind of love how the image distorts and looks like an IRL video game glitch. This is awesome.

[TheDeepsal]

can the 3d video be recorded and somehow be played on a 3d tv?

[okreylos]

@TheDeepsal Yes; the video is recorded into a 3D geometry stream, and can be played back from any point of view, and on any type of display (including stereoscopic). My videos "Picnic Day Exhibit Test - 3D TV" (watch?v=wM65Gx08A0M) and "Exploring the El Mayor-Cucapah Fault Rupture Using LiDAR Viewer" (watch?v=_e2DsZ40sqg) are already in 3D, and should work on your 3D TV depending on your YouTube viewer settings.

[Cowboy77]

Completely awesome

[raystinks1]

@okreylos:

if you had multiple kinects could you see the rest of your body and get rid of the shadow?

[Miboification]

@raystinks1 Hi, I am not okreylos but this would be possible. There would be two possibilities I think:

1.) calibrate the positions of the cameras and just merge the resulting textured models

2.) have "free moving" cameras and use a matching-algorithm

But I could imagine that the low resolution of the 3D-sensor could make good matching/merging very difficult.

[raystinks1]

@Miboification

i thunk your confusing me with a smart person, don't worry, it happends all the time

[ryaninja0]

OMG IT'S BLADE RUNNER!!

[RDIGlobal]

Make new friends and catch up with old ones

Sexy Starbucks Paddock Girl

youtube.com/watch?v=rJF2LpkRUu­c

[rodsk8dude]

2 or 3 Kinects + right software = Great independent games with motion-capture and maybe even low-res scanned objects (great advance considering all the crappy 2d games found on the web).

[LegendaryAdrenaline]

So if you had 2 (or 3) kinects hooked up could you theoretically operate a camera angle from any perspective?

[thatsagoodboat]

Minority Report!!!!!!

[Tylerfeague]

@brad1445 It's a 3d reconstruction of an image. He can move around the room in 3d space. It is not the same 3d as Avatar or anything you see in the movies.

[aaronklapheck]

Cool!

[MRIHATEHIPSTERS]

DUDE !! THE FUTURE IS HERE ! just imagine what they'll do with the next gen xbox and konnect ?????

[RayK47utizube]

Seeeeee......:) nice wk!-

[JonBradinVic]

This shit is so freaking cool.

I don't have the intelligence or knowledge to actually do what you hackers are doing but I've got enough enough to fully appreciate it.

[coolliam1450]

thats cool... AND VERY TRIPPY

[AnklaX]

The combination of kinect and 3D could give birth to a computer interface similar to that in Tony Stark's lab. That would be so cool

[ezekielnin]

Hi Oliver,

After calibrating yesterday and running the kinectviewer without errors, I try today to run it and I get this error : Caught exception Misc::File: Error opening file CameraCalibrationMatrices.dat in mode rb

I tried to find this error on the net, but I got no results... If you have any idea I will wait for your answer!

thanks a lot !

[ezekielnin]

@ezekielnin : Actually the error is Caught exception Misc::File: Error opening file CameraCalibrationMatrices-A003­63A04098048A.dat in mode rb

[into3d]

@ezekielnin same problem here. Could you figure out what causes the problem?

[bengalisinnerblad]

question, would it be possible to get multiple kinects eg 3+ point them at an object from different angles, combine the inputs and have a 3d out put?

[gonewiththewind152]

@okreylos: I read through your code, I did not understand it clearly so please correct me if I am wrong. I am only concentrating on your drawing function which is the "draw" method in KinectProjector. As far as I understand, you are using opengl VBO and vertex array to draw surface and texture mapping for colors, is it correct? I would like to ask instead of using texture, can I use glColorPointer instead? Which method is more efficient in the execution time?

Thank you very much :)

[okreylos]

@gonewiththewind152 Textures will be more efficient, because the color data naturally comes as a (projective) texture. To use vertex colors, you'd first have to perform texture lookups on the CPU side to find colors for each vertex, and then pass those to GL. The GPU is much better at texture lookups.

Additionally, there is no 1:1 correspondence between color pixels and 3D vertices. Texture mapping will automatically adapt to that.

Bottom line: You can generate vertex colors, but you shouldn't

[gonewiththewind152]

@okreylos: is it possible to build the Vrui and Kinect on Window instead of Linux?

Thanks

[okreylos]

@gonewiththewind152 The Kinect package is somewhat OS-independent (you'll need a libusb-1.0-compatible USB library), but the Vrui toolkit itself does not port easily to Windows.

[DevinGaughan]

@okreylos If you used more than one Kinect camera, could you get a full 360 degree 3D image of an environment? That would be very interesting if so. :D

[KazCrazy1]

Is it possible to use a kinect as webcam for the windows 7? If it is,HOW DO YOU DO IT???

[przesterna]

XBox 360 Kinect Console giveaway contest. Infos in my profile.

[ballinpimp87]

if u moved around would it render fast enough?

[rsftwhehe]

can't you do that WITHOUT a shadow?

[InfiniteEntirety]

Awesome. This could give birth to a multitude of possibilities in gaming, movies, and other things. Is there any possible way that you can use multiple Kinects to capture you at different angles and allow everything to be shown?

[AnRTPgA]

Ein deutscher höh? ;D

[coyleo1111]

hi this is great stuff. i play a lot of pool and wood love to capture it with the kinect can you help me out on how to capture and record useing my laptop via kinect

[coyleo1111]

hi this is great stuff. i play a lot of pool and wood love to capture it with the kinect can you help me out on how to capture and record useing my laptop

[animatigital]

Amazing! Please keep up the good work!

[CiiTrusHD]

CollegeHumor made a skit/copied you.

Thumbs up if you agree.

[okreylos]

@CiiTrusHD That's funny, and I do recognize myself in it. Especially the beginning, which is directly lifted from this video, and the general delivery. But they got the accent and body type completely wrong. ;)

Still, cool thing. I guess that means I'm famous now.

[CiiTrusHD]

@okreylos Yeah haha, well done though on your half appearance and technology skills.

[buhochileno]

awesome, can you share the code?

[shabadoojr79]

I thought the Wiimote head tracking was cool... This guy is friggin incredible...

[shabadoojr79]

I thought the Wiimote head tracking was cool... This guy is friggin incredible...

[easter360eggs]

good job 10/10

[EUGENE884]

Verry verry cool well done bro!

[gaAry1]

omg,,, keep trying... and you'll be rich someday.

[spystealth]

How about doing this with 4 Kinect cameras surrounding the room. Complete Augmented reality much?

[Thenewgenerationxx]

Can you record whats happening on the tv screen with the kinect camera? Or perhaps just with a normal webcam?

[BufteaGangsters]

I... SEE... FUTURE...

[CrimeOnWings]

You should link two Kinect units

[AlmightyJesus]

You sound German

[chamelf0xx]

wow 0:45 i saw teh 3D

[PoxHaunted]

1:13 lol

[Huggabizzle]

Have you considered using an array of Kinect cameras in known locations to render a more complete mesh, i.e. one either side of you with data merged to map all of you?

[JustinnFredotu5411]

I think it would be cool if the the next evolution with this type of technology would be to have a free camera in the movies so you could control what you see. That would be hella awesome.

Also, if anyone wants kinect free, see my vid. I found a hacked promo for it, and got myself one. Very easy to do. Try the hack, while it works.

[TonyTurch]

@JustinnFredotu5411 How to get FREE 3D Glasses for YouTube watch?v=XdnfmKTBtiE

[DrOwsum]

@JustinnFredotu5411 (referring to your first paragraph) Well, it already exists. Video gaming!

[defiantBlaze]

@JustinnFredotu5411

I can already imagine myself zooming into Megan Fox's boobs.

[ktinho2]

hologram? 3d is not no?

there is a difference between 3d hologram and knew

[vreaulamatah]

LOL

[cia212]

Impressive start!!

[bardistass]

if you dont get a job offer off the back of this, ill be surprised....

impressive stuff....

[marsL001]

thats freakinn awe-mazing

[AcidSh33tz]

transhumanism here we come

[aceboogie999777]

USE ANOTHER KONNECT ON THE OTHER SIDE

[kazu00003955]

アホ。 立体に依存したな 確かにコンピュータの中は自由に立体で影もおもろいよ 単純に2Dの世界に貴方は、迷い込んでいるよ。誰か通訳を

[bennybobz9]

would this be possible by comining 2 webcams insted of a kinect camrea?

[okreylos]

@bennybobz9 In principle yes, but reconstructing 3D models from two 2D cameras ("depth from stereo") is much harder, and less reliable, than doing it from a color camera and an actual depth camera.

[xxslayer66xx]

@okreylos Seems a kinect could be used to make extremely good 3d movies obviously not recording the actual movie with a kinect just simply using it to record far more accurate depth information. I mean look at the quality of video games vs movies when it comes to stereoscopic 3d. Games will always win because they are actually designed in 3d space and this seems pretty damn close to that considering you can actually pan the camera not just create two alternative frames per eye to make an illusio

[xboxkinecthub]

Go Go Go Kinect - we trust in you!

[181jose]

If this is 3D image i can tell that it SUCKS!

[greciasoleble]

i have an idea, can you okreylos, make a full 3d image using 4 kinects? i mean puting one in each side of an object or a person, or more simple put 4 kinects in a plastic ring and separate them in the exact same distance. and then put the head in the center of the device and get a full 3D image of the user head in real time. please okreylos hear my request.

[Justinlmcginnis]

I heard if you use more than one kinect, you know one on each side of you it makes it look alot better

[scy567]

Thats really awesome.

[DonZaloog88]

Sexmenaoplz? :3

[SinisterHitmen89]

Can you use the kinect as a webcam for skype?

[okreylos]

@SinisterHitmen89 Yes, but Skype talks to webcams via the OS's webcam API, which Kinect doesn't support natively. Someone would have to develop a webcam driver, which should be straightforward.

[CutThroat192]

@okreylos Wouldn't the OpenKinect driver be enough for that?

[okreylos]

@CutThroat192 It could very well have a web cam driver module, but I don't know for sure. Don't all kernel-level drivers for Windows Vista and up have to be signed by Microsoft? That could lead to an awkward situation. :)

[CutThroat192]

@okreylos I'm sure someone would find a workaround if they couldn't get MS's cooperation. I don't think it would be an issue for Macs and Linux users.

[yanivcogan1]

now try it with 3 kinect

[lustigatoYAK]

galileo

[ngockhanh0302]

Hello. I successfuly install VRUI2.0-003. please tell me how to install libusb-1.0. Should I just downloadlibusb-1.0 and extract it to Kinect-1.2 folder? I am novice to Ubuntu Linux. Thank you very much.

[okreylos]

@ngockhanh0302 libusb-1 is available as an Ubuntu package. Something like apt-get install libusb1-dev. After that, Kinect-1.2 should build just fine.

[ngockhanh0302]

@okreylos Thanks Okreylos. Have you figured out the "GL error: Invalid enum" on VRUI by the way?

[motioncapturedude]

nice work, thats amazing

[SaturnV21]

Try getting six Kinects-Front, Back, Left, Right, and an extra one to capture any angles the others don't-and somehow combining all of it.

[skrewhed]

@SaturnV21

You cannot run multiple Kinects at one time, because the way they track objects would make them conflict with one another.

[djfrancox]

would be great with two Kinect try to fill those spaces in black, each in different angles ..

[djfrancox]

seria genial probar con dos kinect, para llenar esos espacios en negro, cada uno en angulos diferentes...

[infera1]

what about 2 kinect's? from bouth sides,it would be awesome :D

[nak1adw2]

WoW that was Freeekin Awesome

[Michaelp715]

I can see the future of video conferencing right here. Network like 4 Kinects together and you can scan the whole room!

[Crimson4242]

Soon to revolutionize the porn industry!

[Mrlowgoal]

@Crimson4242 Exactly what I was thinking

[eskercurve]

What would be really cool is if you could reconstruct multiple Kinect videos and fill in those 3D holes, so to speak.

Now if only we had reliable holographic projectors, we'd be in business!

[sclogse1]

I remember some second of third generation star trek using 3D analysis in figuring out a crime scene...not just in 3D space, but in time also. Very intelligent script on that particular show.

[Guessagainkk]

I'm not a software person, but a product designer.

Instead of viewing 3D on the screen like a CAD system, is it possible to create a software to overlay double images effect used in the "3D TV" industry (with glasses)?

Reason is doubling image effect really "dependent" on depth of field (via IR sensor) where further away the object is the "more offset" of those double image it need to be (or the other way round).

So everyone can capture 3D contents without buying dual lens 3D camera

[Guessagainkk]

@Guessagainkk

watch iplayer: "Click 15/01/2011" shot in CES vegas.

Someone tried to use software to create 3D content in realtime with a normal single lens camera, but with a visual problem because it haven't got the IR sensor to give it realism (3D illusion that is).

[Instinct101B]

Dude, take a picture of your room without you there to set as the back drop to get rid of the shadows, and if you really want to clean the image up, you can get a second kinect and put it on your other side. Do a four way scan with your kinect and you can get a complete 3d rendering in real time of your room.

Just some thoughts...

[nabin666]

Why dont you use a bunch of kinects from different angles to all the room in 3D!!!

[Mekose]

Holy shit. Hold on, let me get my jaw off the floor.

[Waldo120]

I wonder if you could get a second kinect and put them both within view of eachother, and use the data to construct a 3D video with more fill.

[warplayer]

@Waldo120 Check out his other video "2 Kinects 1 Box"

[ShitbagsGroup]

has xbox hired you yet?

[CMinn]

Kinect is a step backwards technologically... 80's music videos already look like this

[Morad96]

can you answer my Q

how to capture HD videos by kinect ?

how to usekinect with windows 7 and to control

PC

[JakoCse]

sta bakan la cosas q se inventan ...

[JakoCse]

sta bakan ...

[stonethrowjuksayer]

yeah but, does it blend?

[choochoopadoo]

Couldn't you get multiple kinect sensors and set them up around the room to create a complete 3D image?

[1brotherAC]

@choochoopadoo He already did that. watch?v=5-w7UXCAUJE&feature=re­lated

[nlicky]

Whoever reverse engineered this is a genius, so many projects for Kinect with computers have come up with smart ways to use the 3d video capture. Great start, the other stuff I've see already is impressive.

[Wnunyuie]

You Sir, are a Hero. 

[AbedeuS]

nerdgasm.

[sancemance]

Emezinhg

[kevcarspray]

it's all black and wierd, you've got a long way to go before you get some "matrix" thing going on.... although you'r making good headway

[rritss]

soo this combined with augmented reality and some TV glasses things= awesomeness right?

[Aspire198]

OMG MUst get, right now!!!!!

[Baboonaiih]

Now take a second camera and put it on the other side of you and you could build a 3D video that you can look from diffrent angles without stoping and moving your camera to a new position! YOUR FRIKIN BRILLIANT THANK YOU FOR THIS! no i am serious can you hurry up and post the program some weres?

[maximumrfan]

At first I was like "that looks like shit".

Then when I saw it move around in 3D space I said "HOLY SHIT!" and I had a nerdgasm. :D

[Qw3rtypop]

Has anyone mentioned that he should try it with a few more camera's (like 3 or 4) and then superpose them onto the same reconstruction?

[jbbauer0]

@Qw3rtypop yes and he has done some tests. not as simple as it sounds unfortunately.

[gabrielgoma]

programs you used?

[myideas]

Amazing. Hopefully in the future the quality gets improved but still this is really cool. :)

[CodyRicheson]

With any video with a large number of views, you can expect at least a few dislikes. But seriously, this is cool shit! How could you not be into this? I would like to see multiple cameras set up to provide a full volumetric image. Imagine sports, hollywood movies, cartoons being shown this way.

[matboester]

can this kinect also to be used for recognition an udder and the 4 tits of a cow ,and then to connect a milking system by a robot (milking system)

Or another purpose mowing a lawn with a robot mower while the camera "sees" the difference in mowed grass and the longer notmwed grass

by the way, I am a farmer looking for useful applications in technology/ farming

[HOURGLASSdm09]

hacker!! jaja

[weenershnitzel336]

this shit is cool!

[sinusshaphard123]

Thats amazing!i had the same thought as others,what if you could use 4 of them to get 3d images

[dddddddddagwood]

1:12

[mickeymouse14]

why isent Microsoft investing in this? all we have is a crappy racing game,dancing games and exersize games....wheres the kinect piano? id buy it..dam it Microsoft have vision for once!

[SkyFlash21]

Awesome, well done.

[ionixuk]

Awesome - well done :) Now I want it...!

[camellaird15]

do you lose you warranty if you do this to your kinect?

[okreylos]

@camellaird15 No.

[xilefian]

@camellaird15 Why would you?

Does plugging a DVD player into your TV void it's warrenty?

[camellaird15]

@xilefian 'With reference to your Kinect enquiry, what I will advise you is that you would be excluded from the warranty if your Kinect was damaged by use with products not sold or licensed by Microsoft. ' <--- this is what Microsoft Said.

[xilefian]

@camellaird15 That clears the air.

So using kinect with microsoft windows will not void the warranty. NICE.

[700gsteak]

@camellaird15 its software only. no mods.

[sivadfa]

@camellaird15 How would it lose your warranty? All you're doing is plugging the Kinect into a PC instead of a xBox. There is no way it can effect the operation of the Kinect.

[av3nger3]

I have a question. Can you use the motion capture data to animate 3D models?

[Vehement00]

@av3nger3 That is entirely possible. For your reference: watch?v=MZHEzDmXO2w&feature=pl­ayer_embedded

As technology catches up, perhaps we'll not only be able to motion capture, we may be able to adjust/exaggerate the animation as well