Loading...

The Evolution of Gradient Descent

40,310 views

Loading...

Loading...

Transcript

The interactive transcript could not be loaded.

Loading...

Loading...

Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Published on Jun 2, 2017

Which optimizer should we use to train our neural network? Tensorflow gives us lots of options, and there are way too many acronyms. We'll go over how the most popular ones work and in the process see how gradient descent has evolved over the years.

Code from this video (with coding challenge):
https://github.com/llSourcell/The_evo...

Please subscribe! And like. And comment. Thats what keeps me going.

More learning resources:
http://sebastianruder.com/optimizing-...
https://www.tensorflow.org/api_docs/p...
http://machinelearningmastery.com/gra...
http://cs231n.github.io/optimization-1/
https://www.cs.toronto.edu/~hinton/cs...
https://www.youtube.com/watch?v=umAeJ...

Join us in the Wizards Slack channel:
http://wizards.herokuapp.com/

And please support me on Patreon: https://www.patreon.com/user?u=3191693
Follow me:
Twitter: https://twitter.com/sirajraval
Facebook: https://www.facebook.com/sirajology Instagram: https://www.instagram.com/sirajraval/ Instagram: https://www.instagram.com/sirajraval/

Loading...

Advertisement
When autoplay is enabled, a suggested video will automatically play next.

Up next


to add this to Watch Later

Add to

Loading playlists...