Automatic Reconstruction of Personalized Avatars from 3D Face Scans

[abram730]

You should use many frames from the RGB to create a higher detailed texture.

Similar to how you used many frames of depth data.

[roidroid]

@abram730 "super resolution" is the name of that term.

(A few weeks ago i found myself googling like mad trying to remember it, glad i wrote it down this time)

[abram730]

@roidroid Thank you. I just thought in my head how I would do it.. I couldn't find the actual terminology, so thank you. I'd imagine that this sort of thing started way back with FBI, CIA, Military... people entering in markers by hand to improve video on magnetic tapes.

[roidroid]

@abram730 it works really well with space photography. Giving you an apparently indefinite "virtual" shutter speed with no motion blur and increasingly less noise.

It would be interesting to experiment with an HD video camera's highest iso setting, highest fps, and lowest shutter speed. Then run hours and hours of the resulting blindly-dark, noisy, high-light-sensitivity, low-motion-blur footage through a super resolution algorithm. I wanna play with virtual shutter speeds :D !

[abram730]

@roidroid Sounds like fun..

I just had an idea.

you could do a kinect fusion like systrem with a plenoptic camera.. I don't know how much processing power it would take though. It would work outside in the day.

It's a light field camera.. works sort of like an insect eye.

[inkanus5jg]

Can't wait for this technology to be implemented in gaming. Imagine a game that uses your own face as a template for the staring role of a game.

[roidroid]

1:51 can't this non-rigid registration be used on it's own, straight away? Why do you bother with the temporal smoothing and gauss filters first at all? it looks like the non-rigid registration is all you'll ever need.

[smoke9206]

all the textures are 'not sharp', bad quality, don't know how to say that. Can it be fixed? You know, to make textures better quality. If yes, why you are present us version with bad quality textures? :P anyway, the idea is great.

[FurryEngine]

great project!

[bricemathieu]

they need to make it a standard. not just one game. we need to add our acquaintances inside every single game. its not so hard to do. i never liked the miis anyway. the morphable model is the key, in that it can make everyone look beautiful and still similar to the original :)

[orzecho1994]

I'm gamer , and if it will be in some game it would be awesome. I will buy something like this, no matter how much will it coast.

Sorry for bad English, I'm still learning.

[JohannNickler]

I think using a template model and adjusting it with the point map seems to be a very effective technique.

good job erlangen