(Weird) Introduction to Deep Learning

Favio Vázquez
Data Scientist


@faviovaz

https://github.com/faviovazquez
https://www.linkedin.com/in/faviovazquez/


Webinars

Problem
Top barrier to AI Adoption
Attracting, Acquiring and developing the right AI talent
Right AI talent needs to have following skills:
- Deep Learning Concepts
- Python Programming
- Data libraries like OpenCV, Pandas etc.
- DL Frameworks: TensorFlow, Keras, MxNet etc.
Solution

AI Development Tools
(available today)
AI Marketplace
(coming soon)
Deep Learning Studio (DLS)
Deep Learning Concepts:
- Python Programming
- Data libraries like OpenCV, Pandas etc.
- DL Frameworks: TensorFlow, Keras, MxNet etc.
- No programming or DL knowledge
- Reconfigure and retrain vertical focused AI Apps.
- Only needs basic knowledge of data
Solution – AI Development Tools

Drag and Drop AI IDE
And Jupyter Notebook
(Available today)
Preconfigured and optimized container environment for different AI frameworks (coming soon)



Outline

What is DL?
What is weird about DL?
Breakthroughs of DL
How to get started with DL?
Doing stuff with DL
Why DL?

Favio Vázquez
About me
- Venezuelan
- Physicist and Computer Engineer
- Master in Physics UNAM
- Data Scientist
- Collaborator of Apache Spark project on GitHub and StackOverFlow
- Sr. Data Scientist Raken Data Group
- CDS Iron
- Main Developer of Optimus


Favio Vázquez
- Very active member of LinkedIn ;)
- Editor - International Journal of Business Analytics and Intelligence
- Lecturer Afi (Data Science program-MX)
- Writer en Towards Data Science, Becoming Human y Planeta Chatbot


About me
Intelligence

Favio Vázquez

Favio Vázquez
Intelligence & AI

What is Intelligence?
Ability to accomplish complex goals.

Lex Fridman - MIT.

Favio Vázquez
We need more than Intelligence.
We need understanding.
We need modeling.

Favio Vázquez
Intelligence & AI

What is Understanding?
Ability to turn complex information into simple, useful information.

Lex Fridman - MIT.

Favio Vázquez
Intelligence & AI


How long for us to be intelligent?
This only took 3.800.000.000 years

Favio Vázquez
And we want this to happen in 5 years...

Favio Vázquez
Intelligence & AI

Kurzweil’s Law of Accelerating Returns


Favio Vázquez
Raymond Kurzweil



Favio Vázquez
Repetitive
Complex
Automation
High
High
Low
Low
Not Common and simple
Not Common and Complex
Common and Simple
Common and Complex
High Level Programming
Conventional Machine Learning
Deep Learning
Intelligence & AI

Human Intelligence

Favio Vázquez
Intelligence & AI

Achieving Human Intelligence == Singularity of AI


Favio Vázquez
Intelligence & AI

Current state of AI


Favio Vázquez
There will be a breakthrough that will lead us to the singularity
Prophesy of AI

Favio Vázquez
The deep in deep learning isn’t a reference to any kind of deeper understanding achieved by the approach; rather, it stands for this idea of successive layers of representations.

Deep Learning


Favio Vázquez
Learning, in the context of machine learning, describes an automatic search process for better representations.

Deep Learning


Favio Vázquez
Deep Learning


Deep learning is a specific subfield of machine learning, a new take on learning representations from data which puts an emphasis on learning successive “layers” of increasingly meaningful representations.
What is it then??

Favio Vázquez
Artificial Neural Networks

Never say that Deep Learning is just Neural Networks that works like our brain.
Deep Learning


Favio Vázquez
Weird things about Deep Learning

Favio Vázquez

Favio Vázquez
Deep Learning

Normally you have to wait for sometime (sometime years) to be able to digest difficult and advance information in papers or research journals.

DLPaper2Code. arXiv:1711.03543v1
Sethi et al.

Favio Vázquez
Breakthroughs

of/towards DL

Favio Vázquez
Deep Learning is not all about Neural Networks




Favio Vázquez
Back Propagation



Favio Vázquez
Better initialization of the parameters of the nets.

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results.

Favio Vázquez
Better activation functions.
This mean, better ways of approximating the functions faster leading to faster training process.





Favio Vázquez
Dropout
(finally not a bad thing to say you did).
Better ways of preventing overfitting and more.

Favio Vázquez
Convolutional Neural Nets


Favio Vázquez
Residual Nets


Favio Vázquez
Region Based CNNs


Favio Vázquez
Recurrent Neural Networks (RNNs) and LSTMs.



DeepBach. arXiv:1612.01010v2.
Hadjeres, Pachet and Nielsen

Favio Vázquez
BTW: It was shown by Liao and Poggio (2016) that
ResNet == RNN
arXiv:1604.03640v1


Favio Vázquez

Generative Adversarial Networks (GANs)

Favio Vázquez

Capsule Networks (CapsNet)

Favio Vázquez
WAIT!
What about Big Data and Data Science?

Favio Vázquez
Big Data + Data Science + AI current state

Favio Vázquez
Big Data is one of the Catalysers to get to Artificial General Intelligence
What else do we need?

Favio Vázquez
It enable us to create intelligence through AI

Favio Vázquez
Data Science!
Getting Started with Deep Learning

Favio Vázquez

Favio Vázquez



Favio Vázquez



Favio Vázquez

Siraj Raval


Favio Vázquez

Brandon Rohrer


Favio Vázquez

Lex Fridman


Favio Vázquez
François Chollet

Favio Vázquez

IBM

Favio Vázquez


Favio Vázquez

Favio Vázquez

Favio Vázquez
Doing stuff with DL


Favio Vázquez



Programming (Learn!!)

Favio Vázquez



AutoML+GUI+Notebook



Favio Vázquez


DEMO
Questions?
Favio Vázquez
Data Scientist


@faviovaz




Introduction to Deep Learning
By Favio Vazquez
Introduction to Deep Learning
- 1,407