Motion-capture without the markers

[ClickyStudios]

We need to know how well this works on big bouncing boobs.

[CrazyStoners]

is this possible with just 1 or 2 cameras and would you be able to simplify the process to just capture first person movements and compute it as Sign Language

[montotosk]

that's amazing! but i like to see how it looks when te camera moves around the 3d scanned character.

[TylerSierp]

/watch?v=eyyUXZzKYr4

IpI MOCAP with Kinect

[lightstudiosLSA]

i do capoeira. it´s awesome to do.

[blotsafun]

thumbs up if the guy sounds like Jesse Eisenburg.

[JVBKing]

All i see are peoples feet sinking into wood and Bouncing Tits

[lagas5]

Is it just me or are the Virtual Representations fucking creepy?

[musician1971a]

@lagas5 No, that's not just you... But the point of this video is to show how the movements are captured. Animation artists will then apply the right textures and other stuff to make it real again. At certain stages of compositing and rigging even mr potato head in toy story looks scary, that's just part of the process.

From what I know this is quite an amazing technique.

[m1k3ystar]

it looks pretty good, although they need to rig the feet, or fix them somehow, because i dont think you can bend your foot like that in real life :/

[lordnipple]

Hi, could I get a copy of that software please? ;)

[affllatoon]

What software is this? please reply.

[conkerzzz]

Is this the same tech that is used in Rockstar's LA Noire game?

[banebreaker3]

they look like a bunch of zombies...

nahh just kidding good job!

[vTHExUNKNOWENv]

WOW i like

[reno911unlocred]

same as the actual kinect... this thing excists like 3 years ago so why is kinect so woooooo?

[KelseaRoxOutLoud]

@reno911unlocred because its a video game. :)

[naavie]

@reno911unlocred: Kinect doesn't require you to install and calibrate eight cameras around your room.

[TheGoodtimeTv]

what software do we have to use to do this??

[DiGiTALFR3D]

That's sick! :O

[Trilink2]

something tells me this isint gonna have a free trial lol

[abigailb1234]

chyanne samuels singing listen xx please lve ur feed back

[Crowe2Extreme]

This technology is able to campure animal motions, isn't it?

[QuipyGirbo]

lol, why did anyone make kinematic skeletons anyway? This seems so much more straightforward.

[gauravlab]

this is not fully functional .... check the captured image of girl dancing ... her fingers are open while in the 3d reconstruction hands are closed. Theres a lot of manipulation in the vedio

[Henbot]

@gauravlab

thats how it is with mocap with markers so its not manipluation. In lord of the rings andy serkis performance was captured but his hands where key frame animated , you would probably need cameras like 4-8 around the hands and then combine both capturings together to get the hands accurate, because the cameras wont be able to seperate due to the sillouete the individual hands thus the hands are closed. In marker style only one marker on the hand you need like 20 more markers for hands

[QuipyGirbo]

@gauravlab

Look at 0:33, the spaces between her fingers aren't captured in the silhouet. Its not the program that puts the videos together (the important one) its the one that gets the silhouet.

[snower5554]

I think you should motion capture two people fucking. That would be cool.

[syszhpe]

@snower5554 funny!

[ArnoldVeeman]

OK, awesome!

I always see cool stuff here, but OR it's way too expensive OR it doesn't work, OR it is only available for geeks who like to compile c++ stuff, OR it's only being implemented somewhere far away @ the Pixar studio's, OR (in your case) the web page is unavailable, OR it's not for Mac and Blender etc! We just want this stuff being made available. Posting this kind of stuff here is like (as dutch ppl say) holding up a sausage in front of a hungry nose, but you're not allowed to eat it

[NadjaVanStiphout]

With a technique like that we soon won't need any character animators anymore.

[goku21youtub]

@NadjaVanStiphout

lol wtf , ever imganed that a 3d character´s moves are much much much more interesting than real life movements? no human could ever move as cool as a disney character + how would you animate cartoon-animals ?

i hate the perception by people that mocap is superiour to handmade animation, because its reversed ! but blending mocap with trad. animation for easy fast and efficient pipelines is the best imho !

[CriticalFailiour]

1:24 He's dancing like a troll. lololool.

[humanwarnings]

COMING SOON

A feature length film made for under $5000

The Greatest Movie Of All Time!

Check out my youtube channel, for several trailers :)

[bukie89fella]

cool .. i dont understand why THQ doesnt use this to make smackdown vs raw games :O they use havok,but this looks awesome

[MagnaGarurumonSE]

Because xD that would be to easy and work too well, THQ has to complicate things

[Kamer20101]

wow thats awsome.. How?? where did you get it? body matchmove ? motion capture or what? My maya can make it ? Please help me.. Thanks

[junoreactor05]

ILM did it on pirates

[daveandgoliathstudio]

ILM used markers on Pirates and great deal of VICON cameras to do the performance capture.

[CRonaldo3124]

great job

[chirix88]

what is the diference with APAS?

[aravindkalyan007]

its good

[Kavster92]

this guy needs to tell new scientist to GTFO!! seriously this stuff would be fuking revolutionary in games...screw all that crap about little balls on all youre joints and shit, this could practically create a virtual skelton for game characters...the physics of games would be so ownage if they used this...iDitto about the feet , they need to make the floor an object on camera so it appears they interact with eachother rather than create

"hover" people!!

[cannoir]

at the same time you'll need a machine that's 10 time expensive to render this shit. they are not adding water for the same reasons. real life animation is CPU intensive.

[gloryfighter1000]

dawm that is fuckin tight looks like blubber real flesh and stuff imagine if cod had the guys move like this when you shoot them right now its still lame how they do things

[pudkiller2]

uhh,, does project Natal Ring a bell?

[dariusfol]

Xbox natal

[XSI5]

feet crashes aganist floor. It has to be curve-cleaned like the usual motion capture process

[MeFlerg]

Although I love the texture this appears to capture... the feet seem to be "skating" all over the place. This will not do in the professional mocap world. Not that you can't fix it, but what a horrendous waste of time that would be.

[3yE]

Basically all motion capture systems up until recently have had sliding feet problem on their raw data. And don't forget that hands and toebone have always had to be animated per hand afterwards anyway, and all body contact animations have to be hand-corrected so that they don't go right through or hang in the air.

[MeFlerg]

@3yE I can't speak to anyone else's experience... in my world, I do this all day, everyday and we have virtually no sliding foot issues. Not that there is never any occlusion or poorer data that has to be cleaned up but we NEVER experience anything like 2:16 on.

[mutehero7]

The dynamic model capture alone is freaking awesome.

[o0DeathStrike0o]

@alincrys what?

[ActsChurchFire]

@alincrys huh?

[Arthurein]

LOL, I always have to do this by hand...XD

[Katman1245]

Do you have to use 8 cameras? or can you still use 2? I assume this is realviz movimento

[Pwner57]

is there anyway i can get the software? ill pay....

[puremage000]

lol do you know how hard this is lol

[Pwner57]

it must be super mega hard!

[jasonguyperson]

lol

[jiaoyinyang]

dang, i like this...

what software is being use?

[Samisun11]

What kind of program is this in ?

[3mendo3]

that guy that does capoeira is an amature doesnt know whats he's doing

[LewQaT]

alright then just use it in videogame cinematics

[makosharkesq]

Have you tried using this technique solely on the head to record facial expressions?  That might be a more useful application than a full body one. That way, actors who are reading the voice parts to an animation feature can be recorded in this way.

[makosharkesq]

for relatively stationary subjects.  However, if we can figure out a way to dolly the 8 cameras at the same pace that the subject walks. Then she should be able to walk indefinitely in any combination of directions and we'd be able to capture her.

[makosharkesq]

Also, as the subject moves away from the center point [where all the cameras are calibrated, I presume that the subject will enter blindspots on one or more cameras, right? Is there a way to move the 8 cameras with the subject?

For example, if the subject is constantly walking forward, then eventually she will walk out of the view of the 8 cameras [since this algorithm presumably requires that the 8 cameras all face the origin at bearing 45 mark 45]. So this algorithm would only be useful

[makosharkesq]

Is the reason why 8 camera angles is sufficient is because you have 1 camera for each quadrant of 3D space? If you move the cameras closer to the subject or if you use a higher-res camera, can you get details like toes and fingers?

[GRmindfreak]

It will all depends on the price. I just checked REALVIZ Movimento and the product is sold at 13000 Euros. If this technology will be at the same range, then it is dead already!!!!!!

[Xiaopang3333]

13.000 euro is nothing for a game or movie company who constantly relies on motion capturing

[Mustafa4u]

how do you scan cloths?

[popplopdop]

All that technology and they can't stop the feet going through the floor!

[motakay]

that's not the point here idiot!

[DarkProject]

You cyant use it to alter the cgi, f.e., you cant recreate the hulk beceause this methed is a direct change to cgi, while using the old fashion method, you can add a "skin" the the captured motion.

[popplopdop]

I don't think you watched to the end. Didn't you see the bit with the auto-generated skeletal rig? Guess what you can do with one of those!!

[jmumford05]

Mocap is used for a lot more than just animation. In some such cases, a kinesthetic understanding of the person's natural movement is what is needed, not a perfect image. How a person moves, not what it looks like. Sensorless motion capture data is ideal in these cases because mocap sensors can be cumbersome, distracting, and can inhibit natural movements - take dancing for example. If one wanted to get data for natural dance movements, no sensors is far superior to sensors (believe me, I know.)

[tardesnegras]

imagine making a full movie in this technoogly? becuase it is in 3-d in captured in all angles you can "play" director...or a porno???

[konikula]

pretty nice work, but anyway, I thought for years that such animation exists already. It is interesting that knowledge of such static model scanners existing, their cinematic clones believed to exist, and markers used in films doesn't lead mind to discrepany feel about cinematic technique.

[human8000]

Oo forgot to add your thing is nothing new, check REALVIZ Movimento ---- exists for 2 years already and tons more.

So go back where you came from

[human8000]

your technology will not make it to the big work. 24P only --- there is no usage of your thing nowhere.

NO RIGID, no texture ---- simply sucks, change your business

[bitcloud1]

you couldn't know less if you tried

[GoatShadow]

this can easily be the future of games and 32 animation

[MeowMix140]

they dont have fingers!

[NuclearStrike101]

lulz couldnt they make other moves? it looks so...retarded

[XSteelyzX]

Arent markers better?Is 3D animation filming humans or dragging markers into a shape and figure?

[ColorfulSundays]

Nice...nice...

[JakesOnline]

very cool. fyi your audio is overmodulated.

[ryanincro]

Can anyone say....Bio Shock? Scarry.

[Truthiness231]

OMFG... coolest proggy ever?

[britoca]

this is excellent! really, really good

[timidgothica]

that's amazing. I'm just enthralled by the clothing.

[s8820199z]

if u want better dancers don't whine when u find out that ur tax money were spent on crap

[kneeonboatsmusic]

Could you please turn down a little bit the volume of your mic?

[Anonymous00230]

Turn your own volume down lazyass.

[TMC27]

Your technology looks promising! I'm interested in seeing any multi person tests that you may have done. And, I'd really like to see a more in depth description of your auto rigging and weighting software. Speaking of weighting, there seems to be a little weirdness around the elbows. I also noticed some pops in the geometry. Are you going to create software to smooth this? It looks like you have a few hurdles to cross before this will be ready for video game production, but it's a great start.

[batukhan]

That's not the way to go, for video games anyway. For animated films, sure. But computer games need interactivity, which these REALLY strict animations don't have.

[tonkaaaaa]

So this means I won't be seeing anymore video game captured people with box heads & feet?

[boxa888]

awesome technology, but u should have gotten better dancers lol. i was kind of creeped out by the dancing lady lol. games will look so real, it will even be easier to fake your surroundings on green screen.

[hamsterhill]

...That is awsome... I want it

[unsound64]

Cool. Where did their hands go to?

[cars2024]

you can even see her titties jiggle :)

[iSlusho]

lol good eye

[mjcamz19]

the hads of the virtual char. is not the sema with the original

[kevin92620]

while this is great for high quality videos, i don't think they could incorporate this level of detail into games yet. in a few years we may be able to incorporated this and have super realistic games, but i don't think we are at that point yet.

[merrett]

This looks very useful! But having 8 cameras on one person doesn't exactly sound "low-budget"

[weeliano]

maybe they should come out with one budget version using 8 webcams instead. Or reduce it to 4 webcams using better software interpolation.

Still this is very very impressive indeed! Dead movie stars can come back and real actors don't have to wear spandex and IR reflecting ping pong balls anymore.

[merrett]

Suppose so...

To be honest I know little about 3D animation. I prefer 2D, and with 2D it only takes 1 camera to do motion capture.

[balderdash707]

Well compared to the current technology, that's very, very low budget.

[5DVz]

most impressive!

[mrjubjub521]

amazing

[teemuruskeepaa]

I want to congratulate Newscientist Youtube Channel for creating the concept of using your journal as an outlet to scientists rather than just making reports. That is a very valuable and unheard of innovation

[DamienZshadow]

oh wow, the detail is amazing...AND YEA! Capoeira!

[misterkami2]

Real impressive stuff... But they should really have gotten a less lousy capoerista.. pity..

[DamienZshadow]

agreed, he was a little slow...and didn't have many skills to show. An overall martial arts tricker (such as my self) would've been way more interesting lol

[020storm020]

that means good graphics games :D

[teemuruskeepaa]

Dude, yeah!

[MasterMuffinMan]

I'm very impressed. I gotta get me some of that.

[tullegutt991]

b o r i n g

[lippskids]

that is awsome

[Gnomusy]

Ab-so-lu-te-ly impressive!! man, I don't know where's the limit with CGI, but this is breathtaking. Congrats!

[Zefrem23]

Need a 0-day download and crack for this software ASAP ;)

[selsuru]

I love science.

[code2break]

wow, this would take 3D animation to the next level. smooth human movements.

[jokerwe]

this is a great program

[PerfectBlindness]

wow awesome. I was wondering if 3D video capture would be practical. I hope they automatically apply textures too. For that matter, record many things at once.

[Ch8ese]

That's impressive.

[tommasfoolery]

wow.

[neelradhakrishnan]

Incredible.

[AirVol2]

WOW

[Limited317]

That god damn complex jazz!

[kakarote2010]

wow.