Deep Learning
Alvin Chan
with
Tensorflow
Personal Journey
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5782970/cat_water.gif)
Takeaways
- Parts of a DL project
- Implementation
- Tensorflow codes
- Basic DL concepts
Deep Learning
- Branch of machine learning
Tensorflow
- Software library to implement deep learning
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5785632/Screenshot_2019-02-15_at_3.36.50_PM.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004102/pasted-from-clipboard.png)
- Open-source Software Framework
- Uses CPU or GPU (or TPU)
- Build, Train & Predict with Deep Learning
Tensorflow
What's
CPU
GPU
ALU
CONTROL
CACHE
2000us/sample
216us/sample
10x Faster!
Colab
- https://colab.research.google.com
- Jupyter notebook with libraries
- Free GPU
- https://bit.ly/2By6AHC
https://slides.com/alvinchan/tensorflow-ntu-levelup
Training a Model
- Dataset ~ Textbook & lecture notes
- Model ~ Student
- Optimizer ~ Correction mechanism
Dataset
- Image
- Text
- Graphs
- etc
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5783002/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5783006/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5785188/pasted-from-clipboard.png)
Model
- With layers of 'neurons'
- Dense layer
- Convolutional layer
- Recurrent layer
- etc
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004102/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5785191/pasted-from-clipboard.png)
Optimizer
- Adjust learned 'knowledge'
- Examples
- SGD
- ADAM
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5783058/pasted-from-clipboard.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5785192/pasted-from-clipboard.png)
A neuron
input_1
input_2
input_3
output
param_1
param_2
param_3
+
+
=
output
input_1 * param_1 input_2 * param_2 input_3 * param_3
'Rectangle' neuron
length
breadth
brightness
perimeter
x0
x2
x2
length
breadth
Deep learning
input_1
input_2
input_3
output
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5785172/pasted-from-clipboard.png)
- Dense Layer
- Convolutional Layer
- Recurrent Layer
- Many more..
of neural layer
Types
Dense layers
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004102/pasted-from-clipboard.png)
Dense Layer 1
Dense Layer 2
Example
- https://playground.tensorflow.org/
- https://colab.research.google.com
- mnist-basic_classification_final.ipynb: https://bit.ly/2H3mCga
Links
- https://slides.com/alvinchan/tensorflow-ntu-levelup
Convolutional layers
input_1
input_2
input_3
output_1
input_4
input_5
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004175/pasted-from-clipboard.png)
Convolutional layers
input_1
input_2
input_3
output_1
input_4
input_5
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004175/pasted-from-clipboard.png)
output_2
Step 2
Convolutional layers
input_1
input_2
input_3
input_4
input_5
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004175/pasted-from-clipboard.png)
output_3
step 3
output_1
output_2
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004058/pasted-from-clipboard.png)
Parallel computations
Why
GPU
Deep learning for images
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004335/cat.jpg)
32 px
32 px
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004398/cnn_full.png)
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004417/cnn_full2.png)
Source: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture6.pdf
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004335/cat.jpg)
32 px
32 px
Deep layers
Source: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture6.pdf
![](https://s3.amazonaws.com/media-p.slid.es/uploads/427101/images/5004371/cnn.jpeg)
Cheers!
Alvin Chan
https://github.com/cheeseprata/
twitter: @a1vinchan
Slides @
https://slides.com/alvinchan/tensorflow-ntu-levelup
Tensorflow NTU Level up
By Alvin Chan
Tensorflow NTU Level up
Tensorflow NTU Levelup
- 810