AAM OpenCV - Animating a 2d Caricature using AAM tracking of a face showing different expressions

This is a demonstration of how AAM Tracking could be used to animate a 2d sort-of-caricature of a face. (work in progress). Currently the shape co-ordinates are fitted using a Lagrangian curve. Final aim is to animate a 3d Head using the MPEG-4 FAP

code is available at http://code.google.com/p/aam-opencv/

Category:

Science & Technology

Tags:

• aam opencv
• project out
• inverse compositonal
• animation
• tracking
• computer vision
• Caricature
• facial expression
• graphics
• curves
• face
• mpeg fap
• face animation
• expression

[ssjtoma]

can you track multiple faces?

[darksid3hack0r]

@ssjtoma Yes, just add it to the dataset and create the model. Use Viola and Jones method for initial detection and start LK tracker on both :)

[darksid3hack0r]

Mostly frontal face - head pose variation upto less than ~30 degree works! AAM relies on the model data - better model - better the fitting

[IceInMySnowCone]

This is great! I was wondering if there was something like this out there just a few weeks ago as I was working in Pencil.

[RyanfaeScotland]

@Giovanni1983 OpenCV, it is in the title :P

[Giovanni1983]

what program? did you use please reply

[MrRobertBaker1]

Incredible man! I'm tempted to test out the PAM, but I don't wanna get locked out in the dark haha when I try to login.

[Wyemay]

Really awesome!

[taniafalmeida]

hey. nice job, really good man! i was trying to find a program that could actually do this but to a 3D person, are you working on something like this?

[PataoEngineer]

Your AAM tracking works on only the frontal face, doesn't it. Can you vary the head pose while retaining the expression tracking?