3D Facial Performance Capture using Kinect

[imegatrone]

I am very happy to see the vidoe after you give this This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[bundawartini]

I Love The Video It Can Increase My Knowledge This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[NganaJHone]

Steady I Really Like This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[Ondelendo]

Good, I like that you share this video, I wish success always This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[bebeheuy]

Nice Video That You Share , So Very Nice Thanks You This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camer

[AntoMelta]

I Really Like The Video From Your This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[willamricard]

Your Video Is Very Useful Sharing This video shows an example of how 3D facial motion performance can be captured without markers using a Microsoft Kinect camera

[xChrizmax]

The middle one at the bottom looks like Abe Lincoln :P

[bobdaugherty820]

Your video is a favorite on Colombo; Sri Jayewardenepura Kotte

[TheMarUlberg]

Scгεw motion contгolεd gαmεs, this is whαt wε should usε κinεct φoг!

[Jakash6890]

hi ,, i m just wondering how you attach pre modeled 3d face with kinect input data. and which software u use for that max for maya ??

regards.

[anon7096]

Wait a second. Are you the Joker?

[Danwolf15]

fuckin' creepy what consoles can do these times

[shwhjw]

Release Max & Maya plugins..? :D

[SnakePlisskenPMW]

well all this kentic mocaping talk. i hope to perhaps one day be able to animate a .MD3 model by useing some form of mocaping with the kentic. at the momment ican skeltialy animate a .MS3D and convert it into.md3 model format aswellas its animations into a frame based manner from skel.im opento useing any model thatcan be converted animations andall into a.MSD3 model.this isof top importence to me and if i can add such detail into head .md3 models then so be it. how can i get my hands on this?

[SnakePlisskenPMW]

i see it states result: animated model.... ok then. what form of animation is it.. is it like a frame based animation.. ?

[belgam123]

hey body can u devolope with maya

[LaughingPsycho]

@thejohnmalkovich Nothing selfish about wanting money for your hard work. iPi charge for their motion capture software which uses the Kinect and are very well known.

Too many folk expect everything for nothing.

[LeoTaxilFrance]

@LaughingPsycho

You mean people in China or Americans killing other folks to get their raw materials?

[LaughingPsycho]

Excellent work indeed.

[wazackenzie]

share this with the community. do you really think there is money to be made in facial motioncapture. its not good enough to sell, but would enable youbers the world over.

[MPIVideosProject]

Just a short note that I cannot properly monitor the youtube comments, so please get in touch via email if you want a reply. Thanks!

Martin

[MrPuffballboy]

not another ' look what we can do' show off video with no public/consumer benefit?! check.....

[ohmss006]

Hey man, I think this is really great what you have here! Can I ask, how did you do this exactly? because everywhere i looked regarding Kinect + Facial Capture, NO ONE has done exactly what you have! Is the facial capturing done through the Kinect???

Probably can you do another video but including the actual video reference for the motion capturing?

I hope you dont mind me asking, and hope to hear back! :D

[MPIVideosProject]

@ohmss006 - the video is included in the top right. That's the color video the Kinect sees, just for reference, not used by the system at the moment

[ohmss006]

@MPIVideosProject Hey, thanks for getting back to me :D But the video on the top right, was that the actual video that the Kinect was capturing for the facial capture? and does it capture the very subtle facial movements?

Also, sorry if I've said alot in the previous post, maybe I wasnt clear but I wanted to know, is the whole facial capturing done through the Kinect? as in all in real-time?

[dodiabsinthe]

we could use this to make movies

[acf2802]

Cool and all, but what is the point of sharing this video publicly if you are going to sit on both the code and the implementation details?

[xalener]

@acf2802

To rub it in your face. Duh.

[TheMrProGamer]

Please Make A public Realease ASAP.....

This is Amazing....I've Seen The technology Behind The Facial Animation in LA Noire Game....And It Uses 32 HI-DEF Cameras

But you only Use One Kinect Camera???!!! This is Awesome .....and I Repeat,Please Make a Public Release of It.

[twerdster]

Hi. What is the processing time per frame?

[funkboxing]

I have a lot of experience with the Blender 2.5 Python API and I would love to help get this implemented. Please contact me if you would be interested in collaborating. Thanks for this- amazing.

[shugames]

Amazing!

[MPIVideosProject]

Thanks for the friendly comments. Right now, the code is not publicly avaliable but we would be interested in suggestions for possible collaborations.

[ASLanimator]

@MPIVideosProject I would love to collaborate. I am working on American Sign Language media development. I'v researched using motion capture in the past. The main criticism was the lack of facial expression. Right now I'm considering using Haptek avatars with motion capture data. I've found some potential collaborators for hand data and for Kinect motion capture, the only thing missing is the facial expressions.

[shukfahid]

@MPIVideosProject I work for Imperial College London in simulations and virtual worlds development. i would have to run it past my supervisor. but this looks like something we might be interested in collaborating on.

[zlwilly]

Would absolutely love to see some code / a public release.

[delusion1982]

pretty cool, any publications? or code? or description?

[GrahamWiebe]

is the code going to be released to the public?

[goob2000]

Incredible!

Is the process of getting from the Raw Kinect data to the final animated model automated through software?

Would there be any plans to release this?