Neural Networks

A brief discussion

Foundation

Perceptron model

Relation with Logistic Regression

Neurons and ANN

Artificial Neural Network

Interactive Example

Tensorflow Playground

Gradient Descent

Optimization

Backpropagation

(Chain rule for neural nets)

What's going on inside the black box?

Neural Nets as Feature extractors

It's all about Manifolds

Every layer is a transformation operation

Some examples of transformation operations

Session 02:Convolutions

And CNN

What is Convolution?

Some parameters...

Padding, Strides etc...

Application to Neural Networks

Advantages and Disadvantages over ANN

Hands-on with CNNs

Toy example

The MNIST dataset

How it works?

Some visualizations of filters 

ImageNet datasets

models like VGG, AlexNet, Inception-v3 etc.

Using Pre-trained models

Use VGG-19 from Keras

Session 03: Transfer Learning

• What is it?
• Applications

Small Demo with MNIST

Knowledge transfer

with VGG-16/19 Net

Results and Discussion

• Accuracy and Loss
• Training Time
• Improvements

Exciting Applications!

Deep Dream and Style Transfer

Let's build both!

Sequence Processing

Introduction to Recurrent Architectures

The Recurrent Neural Network

Training of RNN

Backprop through time

Improvements over RNN

Long Short-Term Memory (LSTM)

Encoder-Decoder models

and thought-vector representations

Session 04: Reinforcement Learning

• Supervised, Unsupervised and RL
• Learning through Rewards
• The algorithm powering AlphaGo

Q-Learning

• A Dynamic Programming approach
• Update function
• Toy task with simple graph

Approximate Q-Learning

• Feature based learning
• Approximate rewards
• Basis for Deep Q-Networks

Deep Q-Network

and solving Atari games

Problem Statement

• Game-play understanding
• The Reward function
• DQN on Atari Ms-Pacman
• Hands-on project