Added: 1 year ago
From: okreylos
Views: 1,082,898
Sort by time | Sort by thread (beta)

Link to this comment:

Share to:

All Comments (1,381)

Sign In or Sign Up now to post a comment!
  • Keep up the good work, amazing

  • So uh, is it posible for a 90-110degree ish wall of kinects all lined up to get perfect 3D mo-cap?

  • So is the main issue with the infrared sensors on teh kinect? It seems like those sensors which throw out those little dots all over everything are not high enough resolution. the noise in the result makes it look like its not getting enough depth data. i wonder if or when the sensors can be upgraded to allow for a finer resolution. similar to the way normal cameras work. is it hard to get multiple kinects to work together?

  • Dude, you are the man, keep it going & bring us the future!

  • could this work with motion tracking? I know that you can use one kinect, but would to be any better?

  • this is the video im talking about: /watch?NR=1&v=1Qx8NzuSSJ4

  • okreylos, i could see in one video by another author that the kinect can "recognize" mirrors, so i wonder if it could help you on this or another experience.

    good luck (and sorry for my poor english)!

  • BUT WILL IT BLEND ?

  • very nice!!

    I wonder if you could get the measurement of that box, for instance, get the dimensions, like height, thickness and depth of the box, using that camera. Would this be possible?

    cheers,

    Telma

  • Nice work. Are you still using manual measurement for your external calibration or have you found/made some software?

  • @DrKaito10 My development branch has a new calibration method (intrinsic and extrinsic), but it's still semi-manual. You have to manually fit homographies to a sequence of images of a semi-clear rectangular grid in the 2D depth and color images. This is because the depth image is so fuzzy that automatic grid detection methods, at least the ones I've tried, don't work well enough. But the process is quick, and the results are very good.

  • What you are doing here is amazing to me (from a film technology standpoint). If you had 3, you could theoretically shoot a scene in a room, and operate the camera without getting in the way of your actors, no?

  • @LegendaryAdrenaline You would need a larger number of cameras to avoid occlusions, i.e., object shadowing; but otherwise, that's exactly the idea.

  • @okreylos I look forward to seeing that idea implimented. Keep up the good work!

  • The Kinect is a simplified toy version of this: /watch?v=DiY45jALWjE&feature=c­hannel_video_title Higher Quality camera won't fix the Noise problem, since the Kinect uses a IR dot projector.. you can expect the 3D mesh to be extremely noisy. Maybe if you mod a projector to make a custom IR projector with higher resolution and perhaps different patterns... Humm.. Maybe just maybe...

  • The problem with multiple Kinects is that you must have multiple USB Controllers. Does your computer have this configuration or did you find a way around it? I'd be very keen to hear how you did this!

  • @demonicowl Most desktop PCs have two USB busses to the outside; typically one to the front panel, and one to the back panel. That's what I'm using. Alternatively, you can buy additional PCI/PCIe USB cards, OR you can buy a USB 3 card and hope that the drivers work. A single USB 3 bus can theoretically support around 15 Kinects.

  • I know how you could do this without interference between the kinects. you can see the infrared projection field through a digital camera. just adjust both kinects so that the projections don't overlap each other and it should work!

  • al lest now we know why kinect sold 10 million units

  • kinect is the best thinq Microsoft done we are waiting for kinect 2 Hi resolution and open Code Please

  • some one make a vid called to kittys one boxand send it to me though thats aht ths was

  • Great work!

  • Amazing technology! Would it then be possible to have 3-D video chats with people around the world and in different environments?

  • how about using digital cameras for the images and the kinects just for the depth?

    I mean, it's awesome already, that's for sure, but with high res images overlaid, this could be really great ;)

  • @DerUnbekannte Yes, it's possible. There isn't anything special about the built-in color camera; the software already has to align the two images (color+depth) explicitly, and aligning an external (higher-resolution) color camera wouldn't be any different.

    Soon.

  • I was expecting an unboxing where there were 2 kinects in the box.

    A 2-fer.

  • @bengui122 So you started with a flawed premise (who said anything about xbox?) and jumped to a counter-factual conclusion (you're seeing it here, and I'm not faking it, ergo it must be possible). In other words, stating that you work for Microsoft was redundant.

    Sorry, I kid. No offense. This was the perfect setup. :)

  • @mathewcohen1 It's theoretically possible, but requires a level of fine control over the devices that I don't think is supported by the USB protocol as I know it.

    Meaning, this would require some help from the device manufacturer, but I don't think Microsoft anticipated that people would be using more than one Kinect.

  • thats fucking weird

  • 2 girls 1 cupp... ? whatt ?

  • if you had 4-6 kinects, you could do a 360 view

  • you speak german, ye?

  • @bachrock2000 also think so

  • this is seriously impressive, i wonder how many kinects you would need to link up to remove the occlusion

  • @BurningdiverUK I'd think 4 would provide a pretty impressive picture, but I don't think it would be completely removed with the Kinect's specs no matter how many you linked together.

  • @arethemad i would imagine it would be 4 and above depending on the rooms dimensions, the potential is amazing, with this use of multiple Kinect's you could do all sort of crazy stuff

  • 1:14 thats he said

  • =O

    Holy shit!

  • The title of this vid sounds like a porno

  • 3:46 it is in a video game and one shitty camera

  • try using 4 kinects posistioned at the 4 corners of the room

  • @somalisalami agreed lol

  • @SomaliSalami I find it perfect ;)

  • the fps rate isn't important if it for product inspection, one of it potential app is an inexpensive IR 3D scanner or IR realtime geometric inspection.

    do have you plans in exporting it into STL or iges or step file for cad system?

  • so if you put another kinect behind tat, that'll create a map for a video game! Put 4 kinects surrounding NYC and bam GTA!!!!! ZOMG why am I so stupid? lol kinect wont take pics tat far GIANT KINECTS!!!!!!! that'll work

  • If you placed the three kinect cameras (I'll call them A, B and C) like this:

    A) infront of object

    B) at a bearing of 120 degrees clockwise from A

    C) at a bearing of 120 degrees counterclockwise from A

    Would that work?

  • @6johansenad 120+120+120= 360 degrees :) Yes

  • you could use the kinect for a homebrew motion capture software, who needs a blue screen and ping pong suit?

  • 3 Kinects?

  • The Kinect Wizard

  • is it possible to use a mirror specially positioned to achieve images of the rear part of objects?

  • Have you thought of working with Microsoft now that you have found something amazing? Also, I agree with HatsuneMiku18 ^^

  • Pretty damn cool

  • MICROSOFT. YOU SHOULD MAKE KINECT FOR HACKERS ONLY. Because hackers do more funny things than microsoft ._. with kinect :]

  • @gravyerd they already have released a limited sdk to help hackers. they have already said awhile ago they are going to make a improved kinect specifically for making professional grade tools and whatnot. There's a couple medical labs, for example, that want to take the basic kinect technology and make it higher resolution to help remote surgery.

  • o.o and if you get 5, then just like surround sound, YOU GET SURROUND IMAGE!!!!!! if not then do 7 :D

  • Move fails

  • its not 3d?

  • if films started using this technology, you'd see the other cameras and crew

  • so if u had alot of kinects could u like put like 1 in each corner then 1 in the middle of each wall could u like have the whole room 3d and see it all

  • would this work with 4 kinects for example mocap or something like that or could you use it for gaming?

  • i want a 3d glasses

  • one of these days u should some how take the kinect outside and do this

  • would be awesome to see this with a higher quality camera...

  • @harrisonk3 Turns out the Kinect's color camera is higher resolution than I thought; 1280x1024 instead of 640x480 (the latter is the default). However, at the higher resolution the frame rate drops from 30 fps to 10 fps, which makes it a lot less usable.

  • @okreylos Is the framerate drop an issue with the kinect hardware, Or with the PC processing?

  • @0m3n1337 It's primarily the internal processing in the Kinect, and the limited bandwidth on a USB bus. 1280x1024 has more than four times the number of pixels as 640x480.

  • @okreylos Could this be fixed using a higher bandwidth bus like FireWire or HDMI on different cams?

  • @kasm279 Firewire has about the same bandwidth as USB2, but more efficient allocation for multiple streamers. But a "professional" version of the Kinect could use 1G or 10G Ethernet, Myrinet, or other high-bandwidth interconnects. Not at $150 a pop, though.

  • @okreylos any thoughts on using GPU's in reverse? Tessellating more geometric data by matching many frames and creating patches..

    or raising video resolution by creating textures averaging many samples at the same location using the 3d location? Then expand the video resolution with the textures. No more black areas

    I mean humans don't see what we see.. we imagine what we see from a small data set. That's why optical illusions work.

  • @harrisonk3 the camera isn't the prob

  • I see how the 3DS camera works with 2 camera lens on the front, as shown in this video with 2 cams

  • USE FIVE KINECTS!

  • @okreylos Hätte nicht gedacht das ein deutscher die besten Kinect-videos auf Youtube macht!

  • Do you think that this could lead to ultimately usable technology for cinematic application? (watching a movie from whichever angle you wish)

  • @pseudoexistentialist Yes, I believe free-viewpoint video will be the killer application for real 3D cameras such as this. It will redefine how we think of television or movies.

  • @okreylos As a cinematographer, let me keep my job please?

  • Awesome video. You should try 3 kinects with the 3rd getting a top down view

  • @power13413 I gave you a thumbs up but consider this: One Kinect facing North, and another facing East. Positioning a 3rd Kinect top-down 90 degrees from the N facing Kinect isn't the same thing as positioning it 90 degrees from the E facing Kinect. Either way you do it, the 3rd Kinect will be in the same location, and facing the same direction, but the images captured differ by 90 degrees.

  • i was expecting some technology porn like 2 girls 1 cup..oh well, i still jizzed..

  • Future of porn right here man... we will watch porn at any angle we want hahahahha

  • holy crap... sumone with money buy this guy another kinnect or 4!!!

  • So, if I want to use 3D video from 4 Kinect for motion capture and recognition, is it OK? Did Kinect SDK support it?

  • got a third, put 'em in a equilateral triangle an that's full 3d

  • Someone's missing a kinect

  • Excuse me, correct me if im wrong but did i get it right? Are you able to record a 3D video with these 2 kinects, so if someone wants to watch the video later on from a different angle he can simply "move" his perspective?

    Or am i wrong and i didnt get the point of the whole video...

  • @TacTiCOrc Yep, you got it exactly right.

  • @TacTiCOrc... That is exactly what he is doing, but he's more focused on real time augmented reality.

    With at least 4 for a full 360 deg... but that may require polarized filters to prevent the cameras that face each other from blinding each other... we will see. Polarizing filters would add to the cost, but strobing the IR and offsetting them wouldn't.

    This video shows that right angles are better then expected.

    So yes 4D movies are possible.. The 4th D being you. RGBXYZ formats

  • Comment removed

  • @abram730 -- You would only need three cameras for a 360 degree rotation; each camera at 120 degrees from each other.

  • I cant my pc to install the kinect how do i install it

  • Sir, you had better be working for the military. they have tried the same project and didnt manage half as well as yours did.

  • Could you please tell us, how to open a .dat file.

  • thimb this up if you thought he ment he bought 1 kinect and their was 2 in it lol

  • @tplke2 ya i did

  • next come out whith some thing i can fucking install!

  • Holy shit... you just turned reality into a video game. So meta.

  • Me and my team are working on a project like this, we have 4 kinects one in each corner of the room, were in the process of getting them at the right angle, would you mind telling us what program you use?

  • @xUltimateOfficial It's my own software; the multi-Kinect version is available from my web page. It's still experimental, but it supports more than two Kinects if your PC has enough USB buses.

  • @okreylos alright thanks man.

  • nice! i cant wait for 3 kinect 3-D viewing and 3-D projectors, and a lil skype action.

  • You could get a nice matrix bullet effect thingy witht this kinda set up?

  • What if you added 2 more, would it be better?

  • Stereoscopic imagery with kinect = AWESOME. This would be a great inexpensive 3D presentation tool for manufacturing companies.

  • what if you put 2 kinects diagonaly, not on 2 sides? 

  • Just wondering, you said in your other video that you cant use 2 kinects because then you will have 2 IR projections going on, could you disable one of the projections so both use only one of them?

  • Combine 6 Kinects and try to handle an Xbox 360, with a 360 image.. :D

  • totally fucking cool!!!

  • Nice... I'm assuming this is similar to ESPN's software that moves around the field in 3d by combining images from their cameras. Great work!

  • interesting

  • pretty good result !?

    i think it is pretty awesome result !

  • My next move would be to develop a object permanence/persistence algorithm to reduce interference.

  • If it is an IR laser, it should be possible to use more than 2 kinects since the response time is very very low, just might need some more direct hardware access than the OK SDK currently allows. 10ms should be more than enough for up, capture and down and that would allow 3 kinects at 30 fps

  • everything sounds sexier in a german accent

  • the title of this video reminded me of 2 girls one cup...

  • i think if you use three or four its will be better 3D view

  • It would be great if one could quickly produce high-quality 3D models by rotating an object in-front of a kinect.

    Voxels come to mind.

  • i smell Google maps 2.0!

  • @icraigslist oo sorry, that was me.

  • @icraigslist been done. Look at yell.com, weirdly!

  • It's just a matter of time till a major company hires you. You do realize this is big? THE FUTURE!

  • Man, you got too much time on your hands!

  • You just need 4 kinects. And put them in a square.

  • I just posted this on OpenKinect Wiki. Interested to hear your take:

    Sequenced 3D Environment Mapper - Leal Vona * 3-4 Kinects in triangular/circular array * Taking pictures (depth camera on/off) in sequence at rate < 30 FPS o Kinect 1 - Frames 1,4,7,10, etc. o Kinect 2 - Frames 2,5,8,11, etc. o Kinect 3 - Frames 3,6,9,12, etc. * Depth camera IR arrays theoretically would not interfere with each other.

  • Now that is pretty Blade Runner. Sweet.

  • I thought this was a reenactement of 2 girls 1 cup

  • LOL... they fill in eachothers holes... that made me LOL

  • Thats SEXY

  • so this+ augmented reality= pure awesomeness right?

  • Ok im an idiot on your other video i posted this idea and i should have checked if you had done this yet :( but now you need 4 cameras from the four corners of the room

  • It seems that on one plane you could almost have free reign ...while with the other they may really buckle you in with no in flight movie.

    The last time I danced in the aisle I was not suprised that I still had it however the obese woman that needed to pass (internal distress -restroom relief ) obviously didn't agree with my assesment when she said "stop twirling your penis like a helicopter, I'm just about to piss myself...oh sheeet!!"

    -when she slipped in it I was like "Woah!"

  • @MightySaturn5 Im confused...

  • @Baboonaiih Lidsville was a 1971/72 tv series that used that eras cutting edge analog editing and effects, this remarkable video is distantly reminencent of that show.

  • @MightySaturn5 i was commenting on your comment of the plane...

  • @Baboonaiih Oh!...I was talking about the plaine from Gilbertatha (the same one from that older vershintaqua)

  • NASA

  • amazing work [and best on YT] so keep these experiments and videos coming.

  • "interference" is probably comming from the quality (speed) of lazer's panning. I'm sure if Microsoft had a faster scatter.. the interference could be minimized but for their intentions it worked.. maybe they'll look at what we're trying to do with it and come out with a better on for pc use.. thus they make money and we are happy

  • wtf is wrong with u, u play with a box

  • I would believe that the heat-waves are basically same as normal light, so it doesnt matter how much of that comes from different places, because heat-lenses only take the light what they can take, from the directions what the lenses can see... It doesnt matter does the heat wave come from another kinect-device, because, it is only about making things visible for heat-lenses...

    This is very interesting. Thank you for your fascinating work!

  • I would believe that the heat-waves are basically same as normal light, so it doesnt matter how much of that comes from different places, because heat-lenses only take the light what they can take, from the directions what the lenses can see... It doesnt matter does the heat wave come from another kinect-device, because, it is only about making things visible for heat-lenses...

    This is very interesting. Thank you for your fascinating work!

  • Wow that was trippy it reminded me of a TV show i watched with that therapist in a room and every outline is tingling any one els thought that? o-o

  • @Bronx1875 Yes, kind of like viewing the 1971 tv show "Lidsville"

    ...I kid you not

  • wow dude like a ULB :P

  • This is a lot better then 2 girls 1 cup

  • he sounds smart

  • U can 3D scan of objects by rotation of them. And you must antialias data for hide ripple.

  • I thought this was a remake of 2 girls 1cup

  • I saw something like this on a movie: "Enemy of the state" look in here at 02:53:

    watch?v=gZPBUl-y6rI

  • everyone is talking about adding 2, or 3 more kinects. if you notice this progression you will realise that eventually a person will reach a 'sweet spot' whereas they will have added enough cameras to completely eliminate all the shadows. that will result in a perfect 3d image.

    the question then will be... what do we do with this image? instead of it being shown internally on a flat screen, can this now complete 3d image be projected? i would think that would be the logical next step.

  • LiDAR, LaserScanners, use an oscillating mirror to send out AND recieve the light, hence two kinects should only interfere if they measure a point at the same time. The possibility of interference thus should be reduced by implementing a third kinect. I see endless possibilities within the field of surveying for the kinect. :)

  • @torbjgri

    Kinect does not use LiDAR or any sort of time-of-flight ranging.

  • If you can do 2, why not 3!?

  • @okreylos, what I meant was can you play the videos from different angles after you've captured them by using 2 kinects? Or is it only possible to "rotate" the views in real time?

  • @okreylos, is it possible to play back in 3D mode?

  • @MrShebaw You mean, as a YouTube 3D video? Yes, but the last time I did that ("Follow-up on Multiple Kinects") the results were less than satisfactory.

  • @MrShebaw It can be possible to generat 3d from kinect.Kinect can detect direct or depth for object

  • Are the kinects reconciling with each other automatically or is that something you did?

  • @MeetmeatNavarre No, there isn't really anything feasible that I could do. It just happened that they interfered less than I had feared. I still don't exactly know why that is.

  • after seeing this i have to subscribe! i want to see where youre going with this.

  • So what ur saying is.... full 3-D porn is plausible in the near future.

  • @Syko7s there already is dude