Multi-Scale Capture of Facial Geometry and Motion

We present a novel multi-scale representation and acquisition method for the animation of high-resolution facial geometry and wrinkles. We first acquire a static scan of the face including reflectance data at the highest possible quality. We then augment a traditional marker-based facial motion-capture system by two synchronized video cameras to track expression wrinkles. The resulting model consists of high-resolution geometry, motion-capture data, and expression wrinkles in 2D parametric form. This combination represents the facial shape and its salient features at multiple scales. During motion synthesis the motion-capture data deforms the high-resolution geometry using a linear shell-based mesh-deformation method. The wrinkle geometry is added to the facial base mesh using nonlinear energy optimization. We present the results of our approach for performance replay as well as for wrinkle editing.
http://people.csail.mit.edu/wojciech/MultiScale/index.html

Category:

Science & Technology

Tags:

• mocap
• computer
• generated
• images
• faces
• 3D
• motion
• capture
• graphics
• CGI
• video
• games
• movie
• prodution
• sfx
• fx
• CG

[kailed]

thats cool

[dj02tc5]

whatw program is this can u please message me :)

[mestreSeba]

how program you use bro? a poniżej widzę, że Wojciech pisze więc jak coś, sprostuj po Poslku ;P zdróweczko

[rubylight]

Cool that wrinkles are captured this way as well!

The comment-text is a bit technically for me, but i take it the software determines how much wrinkles are needed due to how thick / narrow the colored stripes on his face are?

One small note though; during the smile the right part of the upper lip seems a bit over-deformed.

But other than that; great job!

[whitedevil19]

awsome!

[scotstapp]

scary