Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning

Bay Area Vision Meeting (more info below)
Unsupervised Feature Learning and Deep Learning
Presented by Andrew Ng
March 7, 2011

ABSTRACT

Despite machine learning's numerous successes, applying machine learning to a new problem usually means spending a long time hand-designing the input representation for that specific problem. This is true for applications in vision, audio, text/NLP, and other problems. To address this, researchers have recently developed "unsupervised feature learning" and "deep learning" algorithms that can automatically learn feature representations from unlabeled data, thus bypassing much of this time-consuming engineering. Building on such ideas as sparse coding and deep belief networks, these algorithms can exploit large amounts of unlabeled data (which is cheap and easy to obtain) to learn a good feature representation. These methods have also surpassed the previous state-of-the-art on a number of problems in vision, audio, and text. In this talk, I describe some of the key ideas behind unsupervised feature learning and deep learning, describe a few algorithms, and present case studies pertaining.

The Bay Area Vision Meeting (BAVM) is an informal gathering (without a printed proceedings) of academic and industry researchers with interest in computer vision and related areas. The goal is to build community among vision researchers in the San Francisco Bay Area, however, visitors and travelers from afar are also encouraged to attend and present. New research, previews of work to be shown at upcoming vision conferences, reviews of not-well-publicized work, and descriptions of "work in progress" are all welcome.

Category:

Science & Technology

Tags:

• bay area vision
• google tech talk
• machine learning
• machine vision

[Mangalaiii]

Andrew Ng got bored of improving one algorithm so he decided to improve all algorithms at once...

[lei07fun]

This talk is awesome; I can quickly pick up key points of deep-learning.

[leverwang]

Yes, unsupervised learning! We have taught too much on classification, regression, SVM, ANN, that focus on supervised learning. Our brains are sub/un-consciously learning about the environment continuously, i.e. doing unsupervised learning. 

[razblack]

Mr Ng has an interesting pattern in his own speech... starting a sentence in a clear strong audio, and fading to a silent muted tone at the end of a sentence. :) (makes it difficult to hear the complete statement sometimes )

[fingerprint211b]

Andrew Ng is the best professor I've ever had the privilege to learn from (ml class).

[Funtasmia]

guys dont forget his free online Machine Learning class starting in January.

[ahmedgalcaio]

andrew a great machine learning scienctist

[alfaalfa99]

@matpalmyt neither do I D:

[adelle0001]

napakaganda ng video! another one from google

[artificialintellige1]

REALLY VERY GOOD VIDEO

[mehdigoudarzi]

amazing!