Automatic 3d model creation from photos

[LDBStudios]

123D catch is much better- and its free!

[MrFPSCreator]

its a fucking sheet because why do we need a program that will do for us something that we can do perfectly or even better that¡n that

[hipe0]

@MrFPSCreator please be fair. Photosculpt is a tool. If you're into doing a lot of photoreal textures or 3D models then it can save you hours and hours of work. It removes the task of sculpting all this unsane HD detail entirely. Photosculpt does it for you. If you're into Zbrush or so Photosculpt can also be used to create the coolest alphas ever.

[ziongite]

@hipe0

This is stupid I mean how exactly is anyone meant to use this super high poly auto displaced mesh not to mention the sides are just flat plane. Rotate to the back and you will get a laugh. Seems a bit useless.

[3Deity]

@ziongite SoftImage has an excellent polygon decimation tool built in and don't forget this exports normal maps too. I did find that this program was great on busy surfaces but with skyscrapers or a fridge it is completely lost.

[MehthodMan]

@hipe0 agreed, this takes out the tedious task of nuances that don't need to be the main focus. This is totally awesome, I wish my computer was up to it.

[spidereichhoernchen1]

@MrFPSCreator my opinion !

[steveiouk]

Hmm, it has its uses but there is a lot of data on some of these examples that you really wouldn't want.

[Shakudance]

too expensive...

[algildea]

excellent

[NoFatGamer]

If you are the creator of the program, I will be looking to buy it, for games and the models that will be in it!

[TitanaMaster]

how many megabytes is it?

[PictureBandit]

look up "Free 3D Software!! Plus photos to 3D mesh using Project Photofly" click the one by picturebandit.. You're welcome.

[MusicToEatOfficial]

Amazing!!

[RatmanXX]

This is amazing!

Never heard about a software like this. The results are very good.

[masterxilo]

This is only useful for textures with bumpmaps, not entire buildings or mountains IMO.

[hipe0]

@masterxilo Photosculpt works best on textured objects. So buildings like old castles or mountains are just perfect subjects.

[anonymoususerindenve]

Someone should do this with the zapruder film.....

[l0oky1]

i would buy it even for 1000 EUR if it works 360deg perfectly!

[hipe0]

@l0oky1 ok I'll send you an invoice when it's done! :)

[KiNEXfilms]

@Lamboragon lol

[KiNEXfilms]

@Lamboragon No shit? Ofcourse its fake. Its a program for God's sake. Stop bitching around or I'll go full-on rambo on you, faggot.

[StudioGoldsmith]

So, how about importing these 3d objects into Maya, or using the program as a plug-in within? Is the resolution of the model possible to be lowered of raised? Does the texturing actually work based on the two images? To see results like those based on two images is almost overwhelming. I'm hopeful to try this out in future projects!

[xpez]

Nice take documentary photographs/animation to a whole new level!

[Leichimgfx]

That is a great software. Did you program it? Because I guess that involves a lot of difficult programming and algorithms!

[NoFaithNoPain]

How does it cope with a human head, and are there any plans to go 360 degree with three photos?

[hipe0]

@NoFaithNoPain yes it does work on heads once you get some technical aspects rights:

1. On camera flash prohibited

2. soft lighting is key

3. A single color backdrop is prefereable

4. your subject should not be moving between shots.

5. sufficient lighting but not directional (like from a single window) and not too strong either

6. skin should not shine

7. skin with wrinkles will work better than translucent baby skin

Check-out my samples on my web site?

Yes I'm working on the "360" now

[Digadogup]

@hipe0 where was the photo take at 0:37  , was it in Villeneuve, Switzerland

[hipe0]

@Digadogup I shot this photo in Preverenges, Switzerland, that's just the opposite side :-)

[Digadogup]

@hipe0 hehe small world we live in, out of the billions of videos i found this :D

i didn't remember quite where abouts i saw this church i just remembered Villeneuve as i lived there for a year

once i found a video of my house on accident aswell :D

[Digadogup]

@hipe0 hehe i might of got confused where i saw it as i just stopped to have lunch

[hipe0]

@Digadogup that's cool, we could have met back then. But now I'm in Toulouse. Thanks for writing! Are you searching some stereogrammetry software? This video was made with my prototype more than a year ago. You might want to check my other videos on my profile for more info on my final software Photosculpt.

[brandon9271]

I could see game developers going CRAZY with this! Photo realistic 2d textures with a matching normal / parallax map. Throw in some of that fancy DX11 tessellation.. yummy! Makes me wish I knew how to program ;)

[hipe0]

@brandon9271 PhotoSculpt is a new software and it's tessellation ready. I'm covering this in my blog. FYI: you can download 10 free High res texture samples on my web site for artists or developpers to play with.

[coolymichael]

perfect for glsl texturing

[hipe0]

@coolymichael yes they look good in real time. As I said earlier, give it a try with the 10 free glsl textures samples on my web site.

FYI: The free software Blender (2.49 or higher) can display beatiful glsl shaders,

[culturebloc]

Really love what you guys are doing. Have been keeping an eye on this kind of thing for a while. Although we only have two eyes we obviously have the ability to walk and attend a new perspective. Is the algorithm exact everytime? If there was overlapping would they amalgamate seamlessly? So could you do this three or four times for example from different sides and then stitch the polygons together in a 3D app? Would this cause a lot of distortions?

[hipe0]

@culturebloc thanks for asking this critical question. Photosculpt is not metric as of today. It uses uncalibrated photos witch makes it mathematicaly difficult to do a seamless match between 3-4 models. I'm working on this (and already have made 2 internal prototypes). Stay tuned for more info soon (hint you can subscribe to my blog RSS or my tweeter to keep updated)

[hipe0]

Yes it does.

Try it for yourself with our 30 days demo? (Front page in my web site)

[primarymusicusa]

will it work with cinema 4d?

[hipe0]

@primarymusicusa yes it works with C4D or any CG package as in generates obj models and "textures maps" witch are "universal" data for all softwares.

I'm currently "populating" my tutorial section with "how-to setup 3D textures in XYZ software". C4D is not yet covered with a tuto (We covered Modo, 3DS Max, Zbrush and Blender 2.5 so far) so I made a generic Tutorial7 for all softwares, I can be a good start for you?

[hunterwolf53]

The only thing this would really be useful for is for displacement maps.

[hipe0]

@hunterwolf53 Photosculpt is very usefull for displacement maps, for sure. It's really a key feature as Photosculpt displacement maps are much more detailed than any other software.

But besides that you can use Photosculpt for many other things, like modelling things around you with 2 photos, be it your friend's faces, CG textures or archeology. PhotoScupt makes really nice bump maps and normal maps too for games.

See the free samples on the web site and our new flash viewer on front page.

[WhitAngl]

I always thought that 2 uncalibrated photographs could only give a reconstruction up to a projective transform by definition, and that an affine reconstruction requires 3 photographs by definition! ;)

[hipe0]

@WhitAngl sorry I don't understand that. Human eyes can read perfect 3d with only 2 eyes. No animal in nature has 3 eyes (well I don't know any).

Photosculpt is designed to recognise depth from the offsets of patches of pixels between images. And as you'll see on samples on my web site, it somehow works well.

I'm thinking of using 3 photographs to improve the results. Maybe an option for the future?

[WhitAngl]

@hipe0 Note that I talked about uncalibrated photos. For humans, I guess the brain has some model of how the eyes are calibrated (intrinsic parameters, plus a translation between them). For only 2 photos for which you don't know anything about them, computing pairwise correspondances only allows a projective reconstruction: the scene could be projectively transformed, you would get the same 2 photographs (and thus correspondances) if the 2 cameras had their parameter adjusted (FOV, position...).

[hipe0]

@WhitAngl FYI Photosculpt also have "intrinsic parameters".

It works fine with focal lengths from 24 mm to infinite. This fits 100% of the range of consumer point and shoot cameras.

Photosculpt need an angle between shots. I've done many trials and what works best seems to be the 10°-30° range.

Too low angle: you have banding effect. only a few pixels make the depth difference = low quality

Too high angle: you don't have any match between pixels = artefacts

More info in my tutorial 6.

[Kiloku2]

Can I use more than 2 photos, to make a full 3d model of an object?

[hipe0]

Hi @Kiloku2 , I'm sorry that's not possible within the software right now.

[amilldevil107]

@Kiloku2 This is called photogrammetry and there are heaps of better programs that will allow for hundreds of photos and with heaps of photos you can create entire 3D environments from photos.

[hipe0]

@amilldevil107 you're entirely right about that.

Please note that building 3D environments like this (heap of photos) is a real pain. It takes weeks to do (computer time, manual rework) and the results are extremely poor in regard of mesh quality, unless you redo everything by hand, or unless you're happy with low poly.

Photosculpt is new and different: you build high poly models or HD textures easily (1 minute, automatic). Results are directly usable in any CG software.

[johneymute]

so what it actualy does it could recognize objects and then saperate and convert them to 3d.!!??

well then i was thinking howabout a software wich could recognize objects from anny type of b&w,nichtshot,sepia image/video and add the richt color to it like faces,skin,hair,lip, etc,,,

sotthat it will save painstriking time for studios to need to colorize every frame,object by hand!!!!!!!!!

[hipe0]

@johneymute oh no, it cannot do that, it cannot "recognise" what the object is.

It reads every pixel from 2 images, makes the match between the 2 images and compute the 3d position by triangulation. That's a kind of "lecture of pixels" that mimics what eyes do. (binocular vision)

[jubjub250]

say for example, i was to model a knife or something in real life, can i use this to make a 3d model that i could then rig to hands and use in something?

[hipe0]

@jubjub250 Knife are maybe just the wrong example. It shines and mirrors the objects around. Too complicated. But you can try with you hand, your face, and rig that.

[yryj100]

This is cool, but it can generate visible 3D surfaces from only one camera location. I accidentally discovered this company Visualsize that can construct all kinds of 3D models - partial or complete - using photographs collected from random locations around a 3D object. They can do faces too. The technology of Visualsize is really cool and I haven't seen anything like it

[TheFXGuy]

That is really simple (bet it was really frustrating to implement, but simple idea). Kinda the same idea as stereoscopic 3D. But still a beast tool to have.

[hipe0]

Thanks! I appreciate the compliment as I wanted it simple too!

@TheFXGuy you can download it today for a full featured 30 days trial, see web site

[mstrlekar]

this is crazy..

[tommy6410]

can you use more than just 2 images?

[TheFXGuy]

that is tight.

[QuaxeYojimbo]

nice stereo vision. we had to implement this for our introduction to image processing course. Do you automatically calculate distance and different angles of the photographs?

[hipe0]

@QuaxeYojimbo No. Camera distance and angle is unknown, and it's still working.

Have a look at the 30-day trial and samples on the web site ?

[RedLobster]

ROFLLLLLLLLL @ GreMcMahan... iphone app :D

[a1579]

Exact displacement/normal maps sounds interesting. But meshes? meh

What price range is this going to be?

[hipe0]

I think meshes is a simple way to export geometry from one app to the other. Let's say you need a base geometry to sculpt on with zbrush, 3dcoat or mudbox. Then exporting the mesh is best.

Price is not fixed at this time sorry.

[hipe0]

@a1579 also price is Eur 99.00 and there is a 30 day trial on the web site

[iSkyNets]

ahaha lol.... iphone app.... ahaha

[hipe0]

hi iskynet, that question comes much more often than you think. Please be fair. A lot of people want to know.

[GregMcMahan]

Is this an iphone app yet?

[hipe0]

I don't think so. Hardware is unlikely to be able to do it efficiently. Also the 2 mp camera is really poor (on a photographic standard) today for this application. Maybe one day?

[HD3DTV]

whats the poly count reconstruction on the exported objects

?

Peace

[hipe0]

about 120 000 quads

If I was worried about poly count I could as well have used a low poly (like 10x10) and a normal map with no apparent loss of quality. (well, unless you zoom in)

On the other extreme, the program can export up to maybe 12 million quad ultra-high model. But I never do that as the files are too big for any practical use.

[carm3d]

Too cool!

[hipe0]

thanks!

[Moratorium]

Don't need it but it's nice.

[jamestmather]

Very very impressive - are you selling this - if so let me know - cause I'm buying! Thx

[hipe0]

Hi Jamestmather, thanks for your support.

Well ... soon, promise!

I'm posting more videos now of the new version, hoping you'll like it.

What do you want to do with the program?

[ShaiS0]

Very interesting!

I am a commercial photographer and am very interested in this type of work.

is there a way to make 360 deg. object with more photos? lets say of an object placed on a turntable?

[hipe0]

Hi, 360 degree turntable is not possible as of today.

My program only accept 2 images, that's all.

Maybe in another release in the far future, but I have no plan to do this.

[Fu3r82]

the software when will be online ?

awesome!

[hipe0]

as soon as it's ready,

ideally early 2010.

[Fu3r82]

great!

and the price? :D

[hipe0]

Hi, sorry I cannot tell the price, that's a secret. What do you need the software for by the way?

[Fu3r82]

game CG industry.

[hipe0]

I would love see you guys use such technology for better games. Please watch my other videos, you'll see much more about tileable textures, hi and low polys, normal maps, depth maps and tesselation and stuff.

[javacomix]

Great examples. I've seen a number of instances of attempts to extract 3D geometry from photos. This looks very good, although it is obviously quite dependent on the photos to obtain good results. I also notice that the parallax between your two photos seems to always be very small. Interesting.

[hipe0]

Thanks.

I see you're very observative, the angle that works best for the program is roughly 10-20°, so not too much angle.

You're right, it requires somewhat decent 5Mp+ photos too, not blured, not under- or overexposed, stable subject and lighting of course... and that's it.

So you're interrested? May I ask what do you want to do with it?

[syrianX]

is it the same technique used to engrave 3D photos in Crystals ?

does the two cameras are attached to each other ?

[hipe0]

I don't know about 3D photos in Crystals, but maybe, that's a goo question.

2 cameras attached : I don't do that, I prefer shooting twice with one camera, this is much less cumbersome and it works too.

[javacomix]

@hipe0 Sorry I hadn't been logged on in awhile and didn't see your note. I'm interested in technology that permits easy creation of virtual sets and backgrounds. Indie film production rarely has much of a budget for visual effects and your approach is an intriguing possibility to give some depth to projects that would otherwise rely on matte paintings or static backgrounds.

[hipe0]

@javacomix sure, I agree. That's the exact purpose of the software.

[hipe0]

@javacomix No need to sculpt this mountain/rock/wall/castle/forr­est. You can now do complex models from photographs. There is a full featured 30-day trial to download on the web site

[vynum]

very good video representation!

[hipe0]

Thanks!

[787310]

Im looking into becoming a game designer

so you know, when i grow up this could be a very useful program, to make the rough models

(Since even though its very high tech, it wont always get the dimensions i want)

but i know nothing about modeling

i would get it though just to tinker with it.

[hipe0]

Hi, I'll be very happy if I can help you with my program. I hope you'll like it when it's done. Follow the link (click on 'more info') for more info.

[NionsChannel]

Is that a private project?

[hipe0]

yes it's a private project

[kokoilie]

nice!!... but just two questions...

the program's name is blender, right?

and how did that happened?

[hipe0]

No no

- Blender is only used for scene setup and rendering here. I like Blender but I think I could have used any other software (I'm thinking of similar programs like 3dsmax, maya or xsi) to display the 3d model.

-The modelling was done with my program in full automatic mode using 2 photographs each time.

Hoping I have answered to your question? Thanks!

[kokoilie]

ok... you answerd the questions but i'm still interested in automatic 3d programs and still need help

[hipe0]

There is not much on the internet now that does good automatic 3d model today.

Can you be more specific about your needs ? It can help. What types of subjects / What outputs formats do you think you need this program for?

[kokoilie]

i see there is not much of this kind of software so... i don't know what to look for to get the same result

[hipe0]

Agree / disagree. There have been some trials like that in the past, but who knows what happened to those now defunct software?

I can actually think of many uses for my software. Computer graphics, medicine, geology, reverse engineering ?

What do you need this program for?

[kokoilie]

medicine? if you mean it can create humanoid objects so that's exactly what i'm looking for

[hipe0]

Hi, sorry for not replying sooner.

indeed that's for humanoid objects too. bodies , faces, hands, heads, ears, ...

Note that with the program as it is today you only get one side of your subject at a time.

For best results the subject shouldn't be shiny or with harsh lighting like with a flash.

[kokoilie]

right... i... found a way to make my model by hand, already sorry if i disturved you, but i may be more interested soon

[hipe0]

No that's fine, you haven't disturbed. Send me your pictures if you want some trials.

[kokoilie]

how's that done?

[gio83dj]

Fantastic! 5 Star video! But which is the program??

[hipe0]

The program is not released I'm sorry. You will not find it on the internet nor in stores.

Thanks for your feedback about it, I appreciate!

[IoannesVermorel]

Very impressive, this piece of software is doing a very nice job.

[hipe0]

Thanks!