Realtime 3D geometry video scanner

[dsalpha18]

can you make it not so creepy?

[mrchaoslama]

you sound like sam from corridor digital.

[ableite]

would be a nice xbox kinect :p

[Unbeginner]

Does that mean actors haven't lost their jobs to computer graphics, but rather got new kinds of jobs?

Except they'll only be paid to do a face once, I guess.

[darwin9388]

WOW is cool

[Emeengor]

why is it not able to scan the entire room (like an eye does) ? just because of hardware limitations such as (resolution,refresh rate,framerate,focus of the camera etc) or are there any other obstacles?

[grubzup]

2:07

Does anyone want diarrhea more like..

[uyenst]

If a convenient store is open 24/ day 7 days/week 365 days/year, why do they put lock on the door =))

you kinda scared me, though :(

[nikolaipavlovi4]

нуда нуда_! видал я такой сканер лет этак 25 назад, до развала СССР...

АМЕРИКОСЫ ТУПЫЕ))) ТОЛЬКО СООБРАЗИЛИ...

[PhantomGamer100]

@nikolaipavlovi4 Перейти есть еще водки, Николай. LOL. О, еще одна вещь. Говорят по-английски!

[themostkoolest15]

That's a fucking film who make me to get very very crazyy!!! YOU ARE A FUCKING BASTARD

!!!

[Mariovskiiiiiiii]

Congratz!! its not just a great idea but also very well executed. Probably you had changed the colour subpixels (RGB) in the projector in order to enocde a grayscale image at a 3 times greater.resolution.

[roidroid]

over 300,000 points per frame, at over 180 fps.

So that's basically a 640x480 video recorded at over 180 fps.

Or the equivalent of HD 1920x1080 video recorded at 30 fps.

It's probably take up less data though - since it's probably replacing the colour data with depth data instead (with probably only 640 or so "colours" or depths).

[DoggieDoubles]

I love structured-light 3D scanners : ) *****

[stupidgenius107]

BAD ASS

[FilmCryptic]

This is very impressive! One thing I've always noticed that bothered me about most MoCap systems and 3D scanners, has been the lack of the 'wobble' in the face. The almost indistinguishable twitching in facial movements. It all seems too smooth!

[ALIVEWORKS]

What kind of GigE camera's did you guys use for the realtime liquid 3d scan system? They look like Dalsa's. AVT GE680 was used for this system, correct? It looks expensive. The Dalsa's look cheaper. I'm not so much interested in animated 3d live capture. I'm hoping for still & spinning 3d object capture. I'm hunting like mad to find as much information on these systems, see if there's a consumer build alternative. A HitachiCP-X275 XGA LCD was used for the liq sys. So it's good enough right?

[szhang77]

@ALIVEWORKS The camera + frame grabber I used cost more than $7,000. If you only capture still object, my technology should not be the best choice.

It depends on the spinning speed of an object, if it spins at more than a few hundred rpm, even my system won't to able to capture it.

LCD projector won't be cable to do it. It must be a special DLP projector, and modify it in an unique way. Otherwise, it won't work at all.

Hope these give you enough information to start with.

[szhang77]

Does anyone know a projector company who would like make a special DLP projector for all of us at reasonable low price? If you, by chance knew one, please let them contact with me. Everyone can then enjoy playing with this technology once they provide all of us low cost special projectors.

[szhang77]

This requires a lot of expertise on both hardware and software. It was not easy for non-experts to reproduce: even my students couldn't. That's why it is so expensive and unique. Another problem is that the new projector has different operation mechanism, which makes it impossible to implement the same technique. The good news is that we are working on something that will simplify the system development. Once we are successful, we'll open, and the hobbists should be able to reproduce by then.

[MrCaduru]

This "complicated modification" sounds a lot like the removal of the color wheel...

[ALIVEWORKS]

Animation of lines constructed into a video file. Consumer grade DLP projector is used to project this animation of lines over the subject. Camera records this line play on the surface of the object. Program calculated the deformations made to the lines by the object it's projected over. Program detects and calculates the shape by examining the live stream or video of the deformed lines. Converts them to a point cloud which is converted to mesh. Please teach the hobbyist how to make this. Please

[ALIVEWORKS]

So depressing to see these exciting ir 3d camera capture system, and still no Average Joe "Cost friendly" versions exist for the Hobbyist. David Laser is ok, but the resulting mesh's are very poor in quality, and it's a P.I.T.A to retopo and clean them up. I really wish you guys would make a "How To" build your own forum/ with some open source software to show enthusiasts like myself how to make and program them. It's criminal that systems like these sell for 4 figures or more. :(

[telmacblack]

Are you able to set up multiple camera to be able to capture a whole person?

[liiton]

To me, It is a very simple stereo matching system......

[szhang77]

@liiton stero matching cannot do this resolution and speed for sure

[windson7]

i like the strange teeth

[mafelkins]

Nice

[TheFXGuy]

all I heard was "blah blah blah pie blah blah blah".

lol

[DanFrederiksen]

looks nice although it seems to trip at times.

[leviterande]

"what a beautiful smile" yeah i almost got a heart attck by that face 1:43-145

[roidroid]

There is very little info on his it actually works in this video.

So i googled for "3d fringe map" and found some explanations of how the technique works. It seems to be quite common.

The "Kolibri Cordless Sensor" is one such device. But i doubt it's the only one.

So... what exactly is unique about this video? It seems to be old technology.

[roidroid]

update:  you'll learn more about the technique by googling: "fringe projection"

[blockh34d]

people have mentioned the high poly count these sort of applications produce as a reason they couldn't be used in games, when actually the program Meshlab will (for free) do a texture accurate edge decimation to produce a high quality model at whatever poly count you'd like. It intelligently allocates whatever poly budget you give it to encode the most data possible. Meshlab does amazing things top shelf 3d software doesn't even attempt.

[SpaceCaptainDaddy]

This is quite possibly the coolest thing I have ever seen.

[lewisvz]

AWESOME THIS WILL HELP A TON! for movie games and what ever!

[ivillacortaav2009]

If a convenience store is open 24 hrs a day, 7 days a week, 375 days a year why do they put locks on the doors? lmao!!!!!

[koreyba]

funny )

[mateuszskibicki1]

Niezłe

[xxjohnhoukxx]

Max Headroom

Eat your heart out

[7rooper]

It show artifacts. lol!. If video game developers use to get 3D hi-resolution models we're certainly gonna need a seriously beefy computer to run a game or application this demanding. The time the game devs save scanning models with this they will spend it optimizing and lowering the detail in the models. This is more suitable for ... movie 3D rendering.

[walter0bz]

we be just like photoshop cleanup of photo textures. photo bump-maps

[mrchekky]

What is the cost of this scanner

[BLeacHpwnzjoo]

video game developers need this!

[befrey]

cant to much poli

[sjoerdkoala12]

yeah, but you can make a low poly object and render the normal/bump map from the high poly and apply that one on the low poly

[befrey]

yes you can but you cant scan the low poly you have to make the low poly by yourself.....

yes there is a program that crunsch your poligon amount down but that works whit cars and objects not human or animals

[WOLVERINE2070]

muy bueno

[circutracer150]

BUTT SEX!!!!!!

JK!

Utterly amazing... a long way from my Atari 2600!

[44shadows]

Really impressive !

[Mustafa4u]

Does it scan full 360 degree or only from one side?

[SirSeal]

because that's how the doors are made - why spend extra for a door w/o a lock?

[masterofuall]

"If a convenient store is open 24 hours a day, 7 days a week, 365 days a year, why do they put locks on door?" haha good point

[Udah0]

@Funtaman:

I make music, but, if I put a frame around my Big Toe, then it would be art as well. Just a different form. Bottomline: If you call it art, it's art.

[nthnlsmmrs]

Could such technology be used in robotic applications to build accurate and real-time 3D representations of their environment? It might need to capture at lower resolution to perform such a task fast enough. It would be interesting though. This kind of stuff as a lot of potential.

[Funtaman]

hmm looks like someone tryes to change how we look at fine art in games an 3d movies - I dont think meny artist would like to be replaced and do the cleaning of these captures lol Its simply too eazy to use real life actors - this is not for 3d movies - its for "3d scanned movies" ;) its nok art to scan things its replication, end of story

[NexiiM]

What you call professional photography then? Just replicated images, not art?

[Funtaman]

If we took Leonardos brush and said: now we only wanna buy art from a machine you know - that would be sad. I can see many advanteges with this technilogy - as long people can define what to use of it. My point is, we sould think about these thongs before we get to excited of the technology - yes, its truly is amazing, no doubt of that - but are we willing to supstitute and stop the "human progress" over the technology no matter the cost?

[johnstarr2001]

This is human progress. Your worried about art being replaced lol. You must get excited of this technology, it leads to better technology. Everything is just a step. All you need to do is worry if its for bad reasons or good. Such every thing is a tool, its how we use it. What the hell. What human progress are you talking about?

[johnstarr2001]

This guy is worried that Leonardo will use this machine instead a bush. One hes dead. There will be no other Leonardo. I see a true artist must only use ash from a fire to create all great art. An artist can't even use color, Right! A great artist will be seen though what ever they do or use.

[larswillen]

Mr. Song Zhang

Harvard University

its a fake ,isnt it

i have a 3d scanner that is just decoration and cost 3times more 150$,how it work you can see in my clip "3d face scanner"

this is just a "maybe sometime in the future it will work" clip,isnt it?

[szhang77]

Why? If you get chance visit cambridge, I can show you our system right away. We demonstrated our system in SIGGRAPH 2006 Emerging TEchnologies. If you knew somebody atttended that conference, he/she should saw our system.

[madanimal101]

@szhang77 This is pretty incredible stuff, when you say Cambridge do you mean in the UK?

[nukedbrain]

Comeon,

Start selling this gadget already! This is a much needed gadget by a lot of artists. But it needs to be precise, able to scan large objects whole (at least small car size), and be uncomplicated to use and easy to transport. So get on with the manufactoring of it!!!!

I'm waiting for it so snap to it!

JRR

[szhang77]

What accuracy are you talking about? For static objects, it is much easier and and the system can be much cheaper. For large object, I guess it is difficult to finish in a single scan. But you can certainly use a mature merging software to put together once you scanned all area of the object. The weight for the stationery simple is only few pounds. It should be easy to use and transport. Our software allows "button clicking" measurement, should be simple enough.

[punkinhaidmartin]

So are you selling this thing or just bragging about it?

How much?

[szhang77]

We are selling it. The current price is around US$50K.

[JOHNNYWADTON]

damn robber!!! 50K? thats why people use pirated software in the first place, it looks just a like a videocam inside a shoe box

[ArnoldVeeman]

@szhang77

pfew... way too expensive!

Imagine putting this on the market for 150 bucks. Because everyone want to have it, you could live like a king. Pure math...

What's wrong with you software developers..?

[AtomeScanner]

huh ?..........

[CSKernel]

awesome

[asavaris]

very cool!