Learning 3D Models from a Single Still Image

Google Tech Talks
January, 29 2008

ABSTRACT

We present an algorithm to convert standard digital pictures into
3-d models.

This is a challenging problem, since an image is formed by a projection of the 3-d scene onto two dimensions, thus losing the depth information. We take a supervised learning approach to this problem, and use a Markov Random Field (MRF) to model the image depth cues as well as the relationships between different parts of the image. We show that even on unstructured scenes (of indoor and outdoor environments, including forests, trees, buildings,
etc.), our algorithm is frequently able to recover fairly accurate 3-d models.

We use our method to create visually pleasing 3-d flythroughs from the
image. We also present a few extensions of these ideas, such as additionally incorporating triangulation (stereo) cues, and using multiple images to produce large scale 3-d models. We also apply our methods to two robotics applications: (a) high speed offroad obstacle avoidance on an autonomously driven remote-controlled car, and (b) having a robot unload items from a dishwasher.

To convert your own image of an outdoor scene, landscape, etc. to a 3-d model, please visit: http://make3d.stanford.edu

Joint work with Min Sun and Andrew Y. Ng.

Speaker: Ashutosh Saxena
Ashutosh is a PhD candidate with Prof. Andrew Y. Ng in the Computer
Science department in Stanford University. He received his B. Tech.
from Indian Institute of Technology (IIT Kanpur) in 2004.

His research focuses on machine learning approaches to problems in
computer vision and in robotic manipulation. Using data-driven machine
learning techniques, he developed algorithms for creating 3-d models from
a single image, and algorithms for robotic manipulation tasks such as
opening doors, and grasping previously unseen objects.

Category:

People & Blogs

Tags:

• google
• techtalks
• techtalk
• engedu
• talk
• talks
• googletechtalks
• education

[anotherelvis]

Nice work. BTW, are there any open source (Linux) programs for extrapolating a 3D structure from a set of images?

[rne1223]

cool stuff

[adelle0001]

good video and presentation as well.

[DefyDimension]

@anotherelvis You can use the free software 3Defy to create a 3D structure from a single image. It requires a manual process to extrapolate and texture the objects, but it can result in a pretty cool result.

[Flashrahhh]

Good presentation :]

Now I am working at same scientifical theme.

[Ayntperfect]

vee are nerds!.......

[BrutusJones]

all this all reeks of NERD-ness

[knoxjeff]

Nokia tune at 46:28

:-D

[291006058]

i liked this video :)

i cant watch this video js