Loading...

Capsule Networks (CapsNets) – Tutorial

70,419 views

Loading...

Loading...

Transcript

The interactive transcript could not be loaded.

Loading...

Loading...

Rating is available when the video has been rented.
This feature is not available right now. Please try again later.
Published on Nov 21, 2017

CapsNets are a hot new architecture for neural networks, invented by Geoffrey Hinton, one of the godfathers of deep learning.

NIPS 2017 Paper:
* Dynamic Routing Between Capsules,
* by Sara Sabour, Nicholas Frosst, Geoffrey E. Hinton
* https://arxiv.org/abs/1710.09829

The 2011 paper:
* Transforming Autoencoders
* by Geoffrey E. Hinton, Alex Krizhevsky and Sida D. Wang
* https://goo.gl/ARSWM6

A 2018 paper submitted to ICLR 2018 (under review):
* Matrix capsules with EM routing
* https://openreview.net/pdf?id=HJWLfGWRb

CapsNet implementations:
* My TensorFlow implementation: https://github.com/ageron/handson-ml/...
It is presented in my video: https://youtu.be/2Kawrd5szHE
* Keras w/ TensorFlow backend: https://github.com/XifengGuo/CapsNet-...
* TensorFlow: https://github.com/naturomics/CapsNet...
* PyTorch: https://github.com/gram-ai/capsule-ne...

Book:
Hands-On Machine with Scikit-Learn and TensorFlow
O'Reilly, 2017
Amazon: https://goo.gl/IoWYKD

Github: https://github.com/ageron
Twitter: https://twitter.com/aureliengeron

Slides:
https://www.slideshare.net/aurelienge...

Errata:
* At 15:47, in the margin loss equation, the max should be squared, but not the norm: L_k = T_k max(0, m+ − ||v_k||)² + λ (1 − T_k) max(0, ||v_k|| − m−)². Therefore, at 16:08, the network should output a vector whose length (not squared length) is longer than 0.9 for digits that are present, or smaller than 0.1 for digits that are absent. I'll clarify this point in my next video on implementing Capsule Networks.

Loading...

When autoplay is enabled, a suggested video will automatically play next.

Up next


to add this to Watch Later

Add to

Loading playlists...