This is Yantram BPO Service Pvt.Ltd providing all types of 3D Modeling animation services like Animations studio,3d modeling animation,3D Panoramic view,3D Photomontage,Architectural Animation.3D Modeling animation software refers to programs used to make computer generated.
3d walkthrough, 3d Modeling, 3D Rendering, 3d Architectural presentation, 3D Product Design, Architectural 3d Visualization, architectural 3d rendering, 3D Floor Plan, architectural rendering.
Great work! This system is amazing and has many potential. I hope that this project will grow and will make its way into popular software repositories :)
Have you made this or do you plan on making this work open source?
@Graceeeeem It works out the structure from motion, as the desk isn't moving, it gets ignored by the programme. The hands don't conform to rigid body motion, so the programme can't track them effectively, hence they are also ignored.
What happend with this?? still in development?? i the webpage doesent apear any download link or nothing, and its been more than a year since y posted here, and was posted in the blendernation webpage.
Pitty if the proyect didnt go trought. I was really a great thing.
This is not a product demo. It is an academic demo. He will be releasing code (look at his website) but you are perfectly able to download the paper yourself, read it, and write the code yourself. Not sure why this is a "scam."
The video makes it look easy, thats the point of the software.. so how easy is it in code form? Its not. I want to download it and install it, with a GUI to play with it - I essentially want a release candidate/version build or beta software.
@caturn88 you want the moon on a stick from the sounds of it. Try doing some work yourself for once instead of letting everyone else carry your talentless ass
@IPUNCHEDALION oh a yank, thanks for that. Your the type of person who doesn't get things. That's right. I shouldn't be bothering but I have the time today. I don't need to counter your argument, because its crap, but I will say that a demo video must be of a product that is o be released in working order for people to use.
This very product is to make things easier for people, so where is it, try try.
You assume that its value lies in the product it produces instead of the furthered knowledge in the area. And demos are coming Real Soon Now according to the site.
@qwasdninja Thanks for your constructive reply, what you say is no doubt true but from a video like that the purported software is going to be lust after by many.
I just want to use it, releasing demo software is normally a natural part of something like this, but then this is a Uni project.
I checked the site and its still 2009 since it was last updated.
One more thing. It appears that there is no averaging of assumed polys from frame views. I watched the wrong assumption triangles from the steeple to the arch disappear and reappear even though new information from the video would provide averaging leverage to keep them gone.
The major poly groups also did not try to "eat bigger" the smaller, but in plane polys to reduce overall poly count (thusly allowing the model to become less accurate in some darker spots the longer it was modeled)
Since the object is a "Rigid Body" I have another suggestion.
Include a "Lighting variance option" too.
If a desk lamp's spot light is waved over the rigid modeled object and the program is aware (by entering another modeling stage) that lighting changes are happening, then some useful triangle refinement information can be in play.
For example, reflectivity info and bump maps could be added for improved texture. It would add in some false triangles with shadows, but that can be averaged out.
Since stray vertex triangles are a problem in the modeling, how about a "Squeeze down" factor?
For example, if the person holding the church model had moved a few sheets of different colored paper (white, black, yellow, blue, green, red) behind the model then the stray triangles could've been "squeezed to the nearest surface because it would be obvious that they are not part of the scene. At the moment the model is too triangle-stingy and resists removing early wrong assumption triangles.
This is really neat technology. Unfortunately it would be very impractical for doing real modeling, since the polygons are constructed very poorly and in a very haphazard manner. But as someone else said, this could be great for future robots that can learn and map out new environments in 3D.
@CapnDingo The key here is online. It might be impractical for use in a video game, but it is much faster than typical laser scanning and other more accurate techniques. I think that there are plenty of applications (like robots) for this sort of technology.
SO your telling me I could make it for myself? How come they have a mailing list for when (in a few months) they release software for Linux and Windows??!
I'm a bit puzzled as to what having a mailing list and a software release has to do with having (or not) access to the information and being able to implement it yourself.
(I'm not saying it would be trivial to implement, especially with the tweaking required to get it running in real time, but you could definitely get something up and running by yourself)
@ostrorawr its really simple, I want to use the program for myself (probably like a lot of people) but I'm not a developer so need it compiled and with a GUI... I just want a download link.
@caturn88 You can download the paper, read it, and make it for yourself... yes. The mailing list is for people who don't want to bother with writing it themselves, not because you couldn't do it. This is an academic work, so the technique is freely available in the paper on his site.
Forget games...this thing's true potential lies in robot vision. If computers could generate a 3D environment out of a simple camera input, one could, for example, write a program to drive a car in a city. That's the end of traffic jams and accidents.
If you just want a good 3D model, then this probably isn't for you, but imagine it's gaming potential? You could show it you mobile, and the use the tracking feature to use it like a Wii remote! Good work!
If this is the best demo they can come up with it has serious flaws. The joints where the tower meets the building has loads of remnant polygons across the hinge. Considering the simplicity of this shape would love to see how it copes with more complex shapes
Check Out Photobuilder from Autodesk. The fact its academic is irrelevant - some of the leading developments in this area are from the academic area wtf
Shame it would not be much use in gaming environment - or much else as the need for correction and tidying up would take longer or at least as long to model it correctly in the 1st place by a reasonally competent 3D artist... Good work tho...
Not much use in creating high poly models is what you probably mean. I think it has great gaming application potential. Imagine if a kid wanted one of his action figures in his game.
agreed on the freeware! looks great. i would love to use this for soo many things from game development and web design to even custom viualizations for music preformances.
there are still little bugs around the roof/tower area. perhaps from a bug in the delaunay-surface reduction? but good work so far! :) I look forward to seeing what this will result in.
That would be awesome! open source please perhaps as libperforma! I wonder if it could even be integrated into programs such as pidgin for improved low bandwith video conferencing?
The point it is if it isn't open source how can progress be made from it without developers spending loads of money? Maybe you could sell your ideas to nokia and have them integrated into the QT toolkit?
If the model was shot against a green screen or something similar and rotated using automated rigging could you avoid having to augment the video? Ie automate the whole process.
I think this is a fantastic idea! I've done modeling before, and this would greatly cut down the amount of time spent to build object models. And it's also an amazing use of a webcam. Well done!
As for the naysayers, the question shouldn't be "What's the point?". It should be "How can this be useful?". This type of 2D to 3D live modeling is not the end product; it demonstrates what's possible, and may one day become a vital part of something that many can not do without. (like mobile phones?)
i definitely agree about the possibilities for the future, and don't want to bring down your work, so keep at it!! The tech will certainly come about in its own time...just consider pushing the idea sooner than later and you will be very fruitful with the tech, especially if the intention is marketability. Perhaps coordinate with those you may view as end users (studios) so they will support the tech possibilites
3D scanning has been around for years and modelers continue to do things by hand, as the models that come from 3D scanners are usually too feature-bloated and too high polycount to be really useful expecially for animations.
This would be a really good way to do a "quick and dirty" 3D model that the artist can use to develop a cleaner model.
It's fun how a church model was used... were you citing the classic Paul Debevec's work? :P
PS: wish my PhD would have been so fun! Keep up the good work!
I would like to see a higher end 3d model...at this point, it's a novel idea but realistically, the polycount is silly considering the geometry, and any professional model/texture artist can create that in right about 30 minutes max. So, besides saying "neat"...whats the point?
This is amazing... next step, reduce the un-needed polygons. Dunno if this would be optionable live but a markup of the 3d object afterwards could do the trick.
Sure. The thing is if they make a commercial lite version of this tool even none 3d modelers may be able to create basic 3D models for stuff like home videos.
Just imagine the accuracy with a Natal style depth sensing camera. Apparently, one of the guys who used to work at 3DV systems is now at Microsoft and works in 3D environment reconstruction.
A demo should be released in a few months depending on my PhD research - the problem is what makes interesting research doesn't necessarily make the product more user friendly and vice versa.
Nice work. Interesting how the algorythm seems to ignore your hand. I suspect you manually selected the region in the video prior to passing it to the recognition algorythm.
The hand doesn't rotate on the y axis like the model does, so most of the recognised landmarks on it would probably be discarded. Also, if you look well at the beginning, part of the hand is recognised (on top of the roof) but then the algorithm removes [most of] the unneded polygons.
This is very useful and can have variety of applications. correct me if i'm wrong but augmented reality only scans flat pictogram which must already exist in database. This feature scans full 3D object, catches transformation in all axes. Try to do that with flat pictogram.
great stuff want to see it on a big scale camera moving and objects static this would make a great tool for the gaming industry imagine whole cities with realistic textures and you playing
This program would do wonders for archeology students in the world - imagine it used to catalogue objects in museums - you could rotate museum object from Cairo on your computer in Cambridge...
Imagine archeologists scanning dug out pieces of broken objects and then putting them together in computer.
This program will make archeologists and museums salivate. Go to Cambridge museum and show them what can you do just walking around a statue with your laptop in hands
dont get too excited, look at how many errors in geometry were made, and that model was basically 2 rectangles. Imagine trying to scan in a more complex model, you'd spend more time clearing up errors and fixing the needless verts.
Its impressive, but 3d-scanning has been around for years, and its just not viable for that line of work. It would be ideal for creating displays.
the point is 3D scanning need a particular 3D scanner and a fixed turntable. Base on the video, Qi's concepts is a software which can generate 3D object using webcam only. It is alone a brilliant idea.
The camera needs to be calibrated for this system, otherwise there would be an ambiguity during reconstruction. Higher res would mean higher quality, but might not be able to run in real-time, as higher res = more features = more computation.
Very interesting. How does the algorithm distinguish between the object you want to scan, and other objects such as your hand, the desk, etc? Does it look at other frames and take the difference as the object you want to scan?
The hand, like the background, is discarded from the reconstruction as it does not conform to the rigid body motion of the object. The only assumptions made are that the object is a rigid body and at least part of it is within the white circle you see at the start. No background subtraction is being done, which means that the camera does not have to remain completely still (e.g. can be worn on an AR headset)
excellent work, you should work a bit more in the hand, it still looks 3d. Maybe the textures are not accurate. The desk doesn't look realistic at all.
Very Impressive work. On what kind of computer did you run those tests? Was it normal "citizen class" hardware, or any members of the "supercomputing league" ?
Not quite yet - this technique only works for textured (detailed) objects for now, but we are trying to improve the algorithm soon to be less dependent on texture. This is only a proof of concept after all!
right, but people can take actually sculptures, or puppets and manipulate them in a computer. most of the time a physical replica is created before hand. you've just found an easy in between step.
now the question I have is, once the scan has finished can you break apart the 3d model into layers for separate manipulation? Also what kind of file does it save as? is it compatible with other 3d programs?
Generally speaking its quite hard to fake a live demo at an international conference (and then win best demo prize for it), especially when also reconstructing things from people's pockets such as packets of chewing gum, cans of beer and mobile phones. However, I am honoured that you think my results are good enough to be fake ;-)
This new process is amazing!!! As a computer science teacher in high school this type of thing will build students interest and fire them up to continue in the field.
Wow this is amazing, Im just wondering how you cancel your hand out of the model building process as your hand is part of the scene that is changing. And If someone with a different colour hand used it would it still work as well. I'm glad no one saw this video (or mentioned it) before my honours presentation last week, lol as I did something similar but no where near as good. Congrats with this amazing system.
The system doesn't actually need to take into account the colour of the hand to get rid of it. The hand, like the background, is discarded from the reconstruction as it does not conform to the rigid body motion of the object. The only assumptions made are that the object is a rigid body and at least part of it is within the white circle you see at the start. Hope that explains it a bit! Qi
COOL!!!!!!!
ALEXTOPDOG 5 months ago
please, some information of how you develop this software? do not give false hopes
JorgeTobiUchiha 5 months ago
Wouuuu!!!
hugoforever4 5 months ago
How do I get this? :) Could I e-mail you possibly? PLEASE! :(
wrm186 6 months ago
This has been flagged as spam show
This is Yantram BPO Service Pvt.Ltd providing all types of 3D Modeling animation services like Animations studio,3d modeling animation,3D Panoramic view,3D Photomontage,Architectural Animation.3D Modeling animation software refers to programs used to make computer generated.
3d walkthrough, 3d Modeling, 3D Rendering, 3d Architectural presentation, 3D Product Design, Architectural 3d Visualization, architectural 3d rendering, 3D Floor Plan, architectural rendering.
walkthroughyantram 7 months ago
Great work! This system is amazing and has many potential. I hope that this project will grow and will make its way into popular software repositories :)
Have you made this or do you plan on making this work open source?
arasbm 8 months ago
Way too cool. One PhD for you, served. :D
XupicorA 8 months ago 2
open source for 3d printing!!!
Align 9 months ago 6
Comment removed
jcoatz 9 months ago
Serious question: Why is the scanner not picking up the desktop or the hand?
Graceeeeem 10 months ago
@Graceeeeem It works out the structure from motion, as the desk isn't moving, it gets ignored by the programme. The hands don't conform to rigid body motion, so the programme can't track them effectively, hence they are also ignored.
jcoatz 9 months ago
how do i get this software
Twotribes21 10 months ago
12 people are gay.
Choice777 10 months ago
This has been flagged as spam show
Kind notice for you Latin women ** rockmycity.info **
ThdajEdajkk 1 year ago
This has been flagged as spam show
Jesus christ is king of all mankind
bass109 1 year ago
Yay! Now we can rip things from Real life: The game rather than Halo and COD!
weaver900 1 year ago
There are some glitches but this is kool.
Azarien 1 year ago
What happend with this?? still in development?? i the webpage doesent apear any download link or nothing, and its been more than a year since y posted here, and was posted in the blendernation webpage.
Pitty if the proyect didnt go trought. I was really a great thing.
SMMGOGO 1 year ago 6
GENIOUS!
sepulturra 1 year ago 2
This has been flagged as spam show
hey guys check this program name Vi3dim you can find link for download in Google
viktorgv 1 year ago
@viktorgv thx for your info! :)
fnoorp 1 year ago
ImageCV based?
tmedhurst 1 year ago
When can we get this software?
Blooper1980 1 year ago
This has been flagged as spam show
you can get better software named vi3dim
viktorgv 1 year ago
This has been flagged as spam show
hey check this out - vi3dim software
viktorgv 1 year ago
do u have software as a trial or beta ?
karandex 1 year ago
@karandex vi3dim
viktorgv 1 year ago
WOW.. This is brilliant! WOW!!!
Blooper1980 1 year ago
This is really great.
ahriman3d 1 year ago
Fuc*ing Cool
Gegsite 1 year ago
I have a invetion like this to tack it to the next level
jeffnicq 1 year ago
This has been flagged as spam show
JuSt
PuSh
ButtOnS
and
ClicK a MouSe
Danold31wa 1 year ago
@sakkurae
This is not a product demo. It is an academic demo. He will be releasing code (look at his website) but you are perfectly able to download the paper yourself, read it, and write the code yourself. Not sure why this is a "scam."
quadelirus 2 years ago
The video makes it look easy, thats the point of the software.. so how easy is it in code form? Its not. I want to download it and install it, with a GUI to play with it - I essentially want a release candidate/version build or beta software.
caturn88 2 years ago
@caturn88 you want the moon on a stick from the sounds of it. Try doing some work yourself for once instead of letting everyone else carry your talentless ass
IPUNCHEDALION 2 years ago
@IPUNCHEDALION oh a yank, thanks for that. Your the type of person who doesn't get things. That's right. I shouldn't be bothering but I have the time today. I don't need to counter your argument, because its crap, but I will say that a demo video must be of a product that is o be released in working order for people to use.
This very product is to make things easier for people, so where is it, try try.
Who ever doesn't get this is surely stupid.
caturn88 2 years ago
You assume that its value lies in the product it produces instead of the furthered knowledge in the area. And demos are coming Real Soon Now according to the site.
qwasdninja 1 year ago
@qwasdninja Thanks for your constructive reply, what you say is no doubt true but from a video like that the purported software is going to be lust after by many.
I just want to use it, releasing demo software is normally a natural part of something like this, but then this is a Uni project.
I checked the site and its still 2009 since it was last updated.
caturn88 1 year ago
i read about this in computer magazine and thought, thats a useful program........ make it availeble fast!11 people can even PAy For It!1111212
sakkurae 2 years ago
so where can i download this. if i cant download this, this is a scam.
sakkurae 2 years ago
hola me gustaria descargarme este programa , me puede decir donde descargar, si me pueden contestar el privado .gracias
salvatruli 2 years ago
One more thing. It appears that there is no averaging of assumed polys from frame views. I watched the wrong assumption triangles from the steeple to the arch disappear and reappear even though new information from the video would provide averaging leverage to keep them gone.
The major poly groups also did not try to "eat bigger" the smaller, but in plane polys to reduce overall poly count (thusly allowing the model to become less accurate in some darker spots the longer it was modeled)
Matrix29bear 2 years ago
Since the object is a "Rigid Body" I have another suggestion.
Include a "Lighting variance option" too.
If a desk lamp's spot light is waved over the rigid modeled object and the program is aware (by entering another modeling stage) that lighting changes are happening, then some useful triangle refinement information can be in play.
For example, reflectivity info and bump maps could be added for improved texture. It would add in some false triangles with shadows, but that can be averaged out.
Matrix29bear 2 years ago
Since stray vertex triangles are a problem in the modeling, how about a "Squeeze down" factor?
For example, if the person holding the church model had moved a few sheets of different colored paper (white, black, yellow, blue, green, red) behind the model then the stray triangles could've been "squeezed to the nearest surface because it would be obvious that they are not part of the scene. At the moment the model is too triangle-stingy and resists removing early wrong assumption triangles.
Matrix29bear 2 years ago
imagine that program for making titles.
fsfer 2 years ago
This is really neat technology. Unfortunately it would be very impractical for doing real modeling, since the polygons are constructed very poorly and in a very haphazard manner. But as someone else said, this could be great for future robots that can learn and map out new environments in 3D.
CapnDingo 2 years ago
@CapnDingo The key here is online. It might be impractical for use in a video game, but it is much faster than typical laser scanning and other more accurate techniques. I think that there are plenty of applications (like robots) for this sort of technology.
quadelirus 2 years ago
This would be so nice to try out, I can't wait for those months to pass when it'll be made available for testing.
caturn88 2 years ago
Or you could read the paper and implement it yourself...
ostrorawr 2 years ago
SO your telling me I could make it for myself? How come they have a mailing list for when (in a few months) they release software for Linux and Windows??!
caturn88 2 years ago
@caturn88:
I'm a bit puzzled as to what having a mailing list and a software release has to do with having (or not) access to the information and being able to implement it yourself.
ostrorawr 2 years ago
(I'm not saying it would be trivial to implement, especially with the tweaking required to get it running in real time, but you could definitely get something up and running by yourself)
ostrorawr 2 years ago
@ostrorawr its really simple, I want to use the program for myself (probably like a lot of people) but I'm not a developer so need it compiled and with a GUI... I just want a download link.
caturn88 2 years ago
@caturn88 You can download the paper, read it, and make it for yourself... yes. The mailing list is for people who don't want to bother with writing it themselves, not because you couldn't do it. This is an academic work, so the technique is freely available in the paper on his site.
quadelirus 2 years ago
@ostrorawr:
Why don't you?
Spectralancer 2 years ago
@Spectralancer:
I will next semester in our 3d geometry reconstruction class.
ostrorawr 2 years ago
You're going to develop a whole program?
Spectralancer 2 years ago
GTA in your own city !!!
Cuervaud 2 years ago
where is the sourcecode?
freesource for the win!!
juaxix 2 years ago
@juaxix You don't need the source code. The details are in the paper.
quadelirus 2 years ago
uhm... sample source always helps :)
juaxix 2 years ago
Hmm, great idea! Impressive :D
TheDexboy 2 years ago
This comment has received too many negative votes show
Where can I find the CRACK for this??
superskiez 2 years ago
Forget games...this thing's true potential lies in robot vision. If computers could generate a 3D environment out of a simple camera input, one could, for example, write a program to drive a car in a city. That's the end of traffic jams and accidents.
The possibilities are endless...
rev087 2 years ago
There IS a program to drive a car in a city! I saw it once, don't remember where!
millthor 2 years ago
If you just want a good 3D model, then this probably isn't for you, but imagine it's gaming potential? You could show it you mobile, and the use the tracking feature to use it like a Wii remote! Good work!
jeffwinterbourne 2 years ago
@jeffwinterbourne HAHAHAHAAH stupid idea
IPUNCHEDALION 2 years ago
So what if it isn't a clean model? It has great potential and not every application of 3D models needs those models to be clean.
Bravo!
ReverendJuice 2 years ago
If this is the best demo they can come up with it has serious flaws. The joints where the tower meets the building has loads of remnant polygons across the hinge. Considering the simplicity of this shape would love to see how it copes with more complex shapes
JonRashid 2 years ago
@JonRashid its an academic project FFS!
IPUNCHEDALION 2 years ago
Check Out Photobuilder from Autodesk. The fact its academic is irrelevant - some of the leading developments in this area are from the academic area wtf
JonRashid 2 years ago
Quite impressive! Great idea.
michal7x7 2 years ago
Our congratulations!
TipoDMedia 2 years ago
Shame it would not be much use in gaming environment - or much else as the need for correction and tidying up would take longer or at least as long to model it correctly in the 1st place by a reasonally competent 3D artist... Good work tho...
Pixlmixer 2 years ago
Not much use in creating high poly models is what you probably mean. I think it has great gaming application potential. Imagine if a kid wanted one of his action figures in his game.
3dzNutz 2 years ago
Obviously you dont have any idea how game models can be. Even low poly models. this demo is good but not good enoght for any production even games
d3digit 2 years ago
hard work indeed
ultimaroxy18 2 years ago
i hope you get rich....
ultimaroxy18 2 years ago 20
Linux users are going to love this. Good luck on the Windows Version. This is a freaking showstopper in my eyes!
gjmathews 2 years ago
Rename it to: World of Warcraft: Behind the scenes.
Very nice tho :O i wonder what would happen if i tried to do that with my stuff
Ixillius 2 years ago
agreed on the freeware! looks great. i would love to use this for soo many things from game development and web design to even custom viualizations for music preformances.
bobhatescomputers 2 years ago
Extremely impressive! How does it know not to track your hand?
zenboy3000 2 years ago 3
you have to relese it freeware!!! PLEASE, if so only just for linux!!! this is REALLY AMAZING!!!
SMMGOGO 2 years ago
Freeware and Linux? In that case just open-source it.
DaVince21 2 years ago
that was what i was trying to say, but didnt get the right idea in the comment, thanks, that was, make it open source for linux users.
SMMGOGO 2 years ago
wouldnt 2 cameras enhance the quality of 3 dimension (like the case is with human eye)?
prieresminion 2 years ago
Absolutely AMAZING
Eibriel 2 years ago
Really Impressive !
Fraer9 2 years ago
This has been flagged as spam show
WOW! It's awesome!
XXmaniak70XX 2 years ago
Comment removed
XXmaniak70XX 2 years ago
I have the same question as bakacdaz has.
I am highly interested in using this software(?) for architectural models.
Japanesable 2 years ago
Cool..!!
But...
Does the Resolution of webcam effect the model.
I mean if i use expensive webcam is my work quality will better than cheap one.. or it the same
bakacdaz 2 years ago
This is awesome! Great work! :-)
m1c4a1 2 years ago
Very neat. well done.
UncleUry 2 years ago
there are still little bugs around the roof/tower area. perhaps from a bug in the delaunay-surface reduction? but good work so far! :) I look forward to seeing what this will result in.
Evi1M4chine 2 years ago
amazing!
Open source This Please!
colorisgray 2 years ago 33
That would be awesome! open source please perhaps as libperforma! I wonder if it could even be integrated into programs such as pidgin for improved low bandwith video conferencing?
The point it is if it isn't open source how can progress be made from it without developers spending loads of money? Maybe you could sell your ideas to nokia and have them integrated into the QT toolkit?
cusbrar1 2 years ago
yes, where's the code already?
someman7 1 year ago
Molto interessante nell'ambito dell'architettura. Potrebbe funzionare anche su un oggetto immobile e la camera invece che si sposta?
Grazie
Arch. Emilie Rollandin
emilie1977 2 years ago
This is freaking awesome dude! Well done!!
EvieGurl6 2 years ago
of course some work got to be done but it's alredy fantastic
0x00ten 2 years ago
awesome, got no any words. flawless
0x00ten 2 years ago
Excellent work with great potential! Thanks for posting the videos.
dallakyan 2 years ago
How come the hand was not rendered at first? It's good it didn't happen, but how?
1Madis89 2 years ago 2
you notice he didn't place his hand in front of the model... it probably would have picked it up if he had...
cusbrar1 2 years ago
@1Madis89 look at the hand, every time the object turns around it changes it's position, so is not added. this is what i would say...
Lingsrobin 2 years ago
Where can i download this cool thing :D i can't fine the download link ind theys homesite
sorry for bad english right now xD
PLEASE SEND A PRIVAT MESSSAGE WHIT LINK XD
RadioactiveAcid 2 years ago
wonderful.
swatthree 2 years ago
It's amazing! Can't wait to see how this kind of technology will be used in game and Google Earth etc.
Aquaraider 2 years ago
Pure awesomeness.. All the best for your PHD :-)
satishgoda 2 years ago
Where is I can download this soft?
iSkyNets 2 years ago
This is FANTASTIC!
If the model was shot against a green screen or something similar and rotated using automated rigging could you avoid having to augment the video? Ie automate the whole process.
PlayhousePictures 2 years ago
This could really change technology as we see it. You should really capitalize on this man, imagine the offers you could get from Microsoft, or Sony.
melonsraum 2 years ago
I think this is a fantastic idea! I've done modeling before, and this would greatly cut down the amount of time spent to build object models. And it's also an amazing use of a webcam. Well done!
As for the naysayers, the question shouldn't be "What's the point?". It should be "How can this be useful?". This type of 2D to 3D live modeling is not the end product; it demonstrates what's possible, and may one day become a vital part of something that many can not do without. (like mobile phones?)
apalexander 2 years ago
simply amazing!
BSoaresComBr 2 years ago
Comment removed
BSoaresComBr 2 years ago
i definitely agree about the possibilities for the future, and don't want to bring down your work, so keep at it!! The tech will certainly come about in its own time...just consider pushing the idea sooner than later and you will be very fruitful with the tech, especially if the intention is marketability. Perhaps coordinate with those you may view as end users (studios) so they will support the tech possibilites
COLTRANStudios 2 years ago
3D scanning has been around for years and modelers continue to do things by hand, as the models that come from 3D scanners are usually too feature-bloated and too high polycount to be really useful expecially for animations.
This would be a really good way to do a "quick and dirty" 3D model that the artist can use to develop a cleaner model.
It's fun how a church model was used... were you citing the classic Paul Debevec's work? :P
PS: wish my PhD would have been so fun! Keep up the good work!
00oiio00 2 years ago
I would like to see a higher end 3d model...at this point, it's a novel idea but realistically, the polycount is silly considering the geometry, and any professional model/texture artist can create that in right about 30 minutes max. So, besides saying "neat"...whats the point?
COLTRANStudios 2 years ago
How about creating a photorealistic MMO?
Matrix here we come!
bluevspink 2 years ago
Maybe if would be even more amazing if he tried to model his hand, but I guess is too advanced for a "beta"
ProviderMR 2 years ago
This is amazing... next step, reduce the un-needed polygons. Dunno if this would be optionable live but a markup of the 3d object afterwards could do the trick.
epyonxl 2 years ago
good work Qi! ^^
qczhao 2 years ago
This has been flagged as spam show
i want it , i want it , i want it!!!
Sala1995 2 years ago
it's really awesome :D
MuriDJ 2 years ago
I'm really looking forward to piracy in 10 years.
CaptainClass 2 years ago
Sure. The thing is if they make a commercial lite version of this tool even none 3d modelers may be able to create basic 3D models for stuff like home videos.
Cometer 2 years ago
Amazing. As it does such quick tracking in 3D space, could this system not be used to quickly make an 3D input device?
arloj 2 years ago
good stuff qi - it's all about the cents.
np5488 2 years ago
Just imagine the accuracy with a Natal style depth sensing camera. Apparently, one of the guys who used to work at 3DV systems is now at Microsoft and works in 3D environment reconstruction.
Zalo10 2 years ago
I would like to know when this would be commercially available as I know many, including myself who would like to start using the application.
catizirtobe 2 years ago
A demo should be released in a few months depending on my PhD research - the problem is what makes interesting research doesn't necessarily make the product more user friendly and vice versa.
QiPanComputerVision 2 years ago
No doubt.
demiurge1776 2 years ago
The most impressive thing to me is how robust it is at interactive speeds. Exceptional work.
mypalmike 2 years ago
Nice work. Interesting how the algorythm seems to ignore your hand. I suspect you manually selected the region in the video prior to passing it to the recognition algorythm.
PatGirvin 2 years ago
The hand doesn't rotate on the y axis like the model does, so most of the recognised landmarks on it would probably be discarded. Also, if you look well at the beginning, part of the hand is recognised (on top of the roof) but then the algorithm removes [most of] the unneded polygons.
00oiio00 2 years ago
This is very useful and can have variety of applications. correct me if i'm wrong but augmented reality only scans flat pictogram which must already exist in database. This feature scans full 3D object, catches transformation in all axes. Try to do that with flat pictogram.
nosferathoo 2 years ago
great stuff want to see it on a big scale camera moving and objects static this would make a great tool for the gaming industry imagine whole cities with realistic textures and you playing
0000Reset0000 2 years ago
This is the coolest thing I've ever seen.
glacierise 2 years ago
Amazing. Finally an inexpensive rapid modelling tool.
ugtvdotorg 2 years ago
This comment has received too many negative votes show
simple stuff like that could take you 1 minute to model manualy - with clean geometry. nice feature tho , but not useful at all
FCB87 2 years ago
Way to miss the point..
MegaSkullCapable 2 years ago
QiPan - You are genius :)
This program would do wonders for archeology students in the world - imagine it used to catalogue objects in museums - you could rotate museum object from Cairo on your computer in Cambridge...
Imagine archeologists scanning dug out pieces of broken objects and then putting them together in computer.
This program will make archeologists and museums salivate. Go to Cambridge museum and show them what can you do just walking around a statue with your laptop in hands
lehcyfer 2 years ago 4
Congratulations very beautiful technical exploit!
1 / question: is the placement of points on visible edges or on surfaces?
2nd question: where let us can test this software ?
Congratulations also to Delaunay and Voronoï ;-)
28did 2 years ago
This comment has received too many negative votes show
Old technology ! You could do this like a year ago with your webcam !
funckyjunky 2 years ago
oh yes? show me that
tehdog22 2 years ago
wow toy companies will have boost in sales for sure.
impulsive2urge 2 years ago
I just watched this video on Engadget. It looks cool, but it's not obvious what the applications are - apart from looking cool...
strawberrysubmarine 2 years ago
I'm assuming this isn't yet marketed... any ideas as to how and when it will be available??
WeAreTheLostBoyz 2 years ago
where do we download the program? *Serious face*
...
hehe i want the software so i can create models for a game =) will be fun! 8D
NytroDesigns 2 years ago
dont get too excited, look at how many errors in geometry were made, and that model was basically 2 rectangles. Imagine trying to scan in a more complex model, you'd spend more time clearing up errors and fixing the needless verts.
Its impressive, but 3d-scanning has been around for years, and its just not viable for that line of work. It would be ideal for creating displays.
ModExtirpation 2 years ago
the point is 3D scanning need a particular 3D scanner and a fixed turntable. Base on the video, Qi's concepts is a software which can generate 3D object using webcam only. It is alone a brilliant idea.
jascript 2 years ago 2
Seriously impressive. Would you be able to get this running in AS3 using the papervision3d library I wonder? That would be an incredibly useful tool.
nowt835 2 years ago
Is there a camera calibration step, or can it do this without correcting for lens distortion, etc?
How much impact does the camera resolution have on the quality of the results?
conolan 2 years ago
The camera needs to be calibrated for this system, otherwise there would be an ambiguity during reconstruction. Higher res would mean higher quality, but might not be able to run in real-time, as higher res = more features = more computation.
QiPanComputerVision 2 years ago
Could you run it in non-real time?
NextDesign 2 years ago
RAD
rdanielbautista 2 years ago
Very interesting. How does the algorithm distinguish between the object you want to scan, and other objects such as your hand, the desk, etc? Does it look at other frames and take the difference as the object you want to scan?
NextDesign 2 years ago
The hand, like the background, is discarded from the reconstruction as it does not conform to the rigid body motion of the object. The only assumptions made are that the object is a rigid body and at least part of it is within the white circle you see at the start. No background subtraction is being done, which means that the camera does not have to remain completely still (e.g. can be worn on an AR headset)
QiPanComputerVision 2 years ago
Absolutely epic!! I can already think of so many things to do with it!!
zincopper 2 years ago
you can bet an updated version of this technology will be used in the sims 4 in 2014 to make your character look exactly like you haha..
AdamKaoru 2 years ago
can't wait for its public release!
LTF85199 2 years ago
Wow, this is really cool ! keep up the good work and write us an easy to use software !
nitrofcire 2 years ago
Brilliant! Definitely useful for augmented reality as well.
10thdim 2 years ago
excellent work, you should work a bit more in the hand, it still looks 3d. Maybe the textures are not accurate. The desk doesn't look realistic at all.
luchorliev 2 years ago
Amazing Mr Qi Pan,how old are you?
JorgeIvanovich 2 years ago
Thanks - I'm 24
QiPanComputerVision 2 years ago
Very Impressive work. On what kind of computer did you run those tests? Was it normal "citizen class" hardware, or any members of the "supercomputing league" ?
fiedel 2 years ago
Thanks. The system you see in the video was running on an Intel E6700 2.6GHz dual core cpu with 2GB of RAM, so just a standard desktop PC.
QiPanComputerVision 2 years ago
Brilliant. I'm sure there's a huge science side to this, but you've just made 3D easy for the film industry.
pyre76 2 years ago
Not quite yet - this technique only works for textured (detailed) objects for now, but we are trying to improve the algorithm soon to be less dependent on texture. This is only a proof of concept after all!
QiPanComputerVision 2 years ago
right, but people can take actually sculptures, or puppets and manipulate them in a computer. most of the time a physical replica is created before hand. you've just found an easy in between step.
now the question I have is, once the scan has finished can you break apart the 3d model into layers for separate manipulation? Also what kind of file does it save as? is it compatible with other 3d programs?
pyre76 2 years ago
This comment has received too many negative votes show
Fake
Alfonxdk 2 years ago
Generally speaking its quite hard to fake a live demo at an international conference (and then win best demo prize for it), especially when also reconstructing things from people's pockets such as packets of chewing gum, cans of beer and mobile phones. However, I am honoured that you think my results are good enough to be fake ;-)
QiPanComputerVision 2 years ago
Awesome work, very impressive.
wingedtoad 2 years ago
Well this is a start, for sure. Once the algorithm gets better, this will be kick ass.
Amazing work!
Iggyhopper 2 years ago 2
This new process is amazing!!! As a computer science teacher in high school this type of thing will build students interest and fire them up to continue in the field.
coachdave99 2 years ago 3
Wow x 2! Can we get a copy of this software? Assist with beta testing?
ManorFarmer 2 years ago
Wow this is amazing, Im just wondering how you cancel your hand out of the model building process as your hand is part of the scene that is changing. And If someone with a different colour hand used it would it still work as well. I'm glad no one saw this video (or mentioned it) before my honours presentation last week, lol as I did something similar but no where near as good. Congrats with this amazing system.
syngen101 2 years ago
The system doesn't actually need to take into account the colour of the hand to get rid of it. The hand, like the background, is discarded from the reconstruction as it does not conform to the rigid body motion of the object. The only assumptions made are that the object is a rigid body and at least part of it is within the white circle you see at the start. Hope that explains it a bit! Qi
QiPanComputerVision 2 years ago