Deep Learning
Alvin Chan
with
Tensorflow
Personal Journey
Takeaways
- Parts of a DL project
- Implementation
- Tensorflow codes
- Basic DL concepts
Deep Learning
- Branch of machine learning
Tensorflow
- Software library to implement deep learning
- Open-source Software Framework
- Uses CPU or GPU (or TPU)
- Build, Train & Predict with Deep Learning
Tensorflow
What's
CPU
GPU
ALU
CONTROL
CACHE
2000us/sample
216us/sample
10x Faster!
Colab
- https://colab.research.google.com
- Jupyter notebook with libraries
- Free GPU
- https://bit.ly/2By6AHC
https://slides.com/alvinchan/tensorflow-ntu-levelup
Training a Model
- Dataset ~ Textbook & lecture notes
- Model ~ Student
- Optimizer ~ Correction mechanism
Dataset
- Image
- Text
- Graphs
- etc
Model
- With layers of 'neurons'
- Dense layer
- Convolutional layer
- Recurrent layer
- etc
Optimizer
- Adjust learned 'knowledge'
- Examples
- SGD
- ADAM
A neuron
input_1
input_2
input_3
output
param_1
param_2
param_3
+
+
=
output
input_1 * param_1 input_2 * param_2 input_3 * param_3
'Rectangle' neuron
length
breadth
brightness
perimeter
x0
x2
x2
length
breadth
Deep learning
input_1
input_2
input_3
output
- Dense Layer
- Convolutional Layer
- Recurrent Layer
- Many more..
of neural layer
Types
Dense layers
Dense Layer 1
Dense Layer 2
Example
- https://playground.tensorflow.org/
- https://colab.research.google.com
- mnist-basic_classification_final.ipynb: https://bit.ly/2H3mCga
Links
- https://slides.com/alvinchan/tensorflow-ntu-levelup
Convolutional layers
input_1
input_2
input_3
output_1
input_4
input_5
Convolutional layers
input_1
input_2
input_3
output_1
input_4
input_5
output_2
Step 2
Convolutional layers
input_1
input_2
input_3
input_4
input_5
output_3
step 3
output_1
output_2
Parallel computations
Why
GPU
Deep learning for images
32 px
32 px
Source: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture6.pdf
32 px
32 px
Deep layers
Source: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture6.pdf
Cheers!
Alvin Chan
https://github.com/cheeseprata/
twitter: @a1vinchan
Slides @
https://slides.com/alvinchan/tensorflow-ntu-levelup
Tensorflow NTU Level up
By Alvin Chan
Tensorflow NTU Level up
Tensorflow NTU Levelup
- 790