The Deep Learning Revolution

• Automatic Feature Learning
• Hierarchical Representation

The Deep Learning Revolution

The Deep Learning Revolution

• Automatic Feature Learning
• Hierarchical Representation
• Gradient Descent based Optimization
  • Differentiable Networks

The Deep Learning Revolution

The Deep Learning Revolution

Recurrence

Recurrent Neural Network

Vector to Sequence

Sequence to Sequence

Bidirectional RNN

Stacked RNN

Vanilla

LSTM

Long Short Term Memory

LSTM

LSTM

GRU

Gated Recurrent Unit