(Weird) Introduction to Deep Learning
Favio Vázquez
Data Scientist
@faviovaz
https://github.com/faviovazquez
https://www.linkedin.com/in/faviovazquez/
Webinars
Problem
Top barrier to AI Adoption
Attracting, Acquiring and developing the right AI talent
Right AI talent needs to have following skills:
- Deep Learning Concepts
- Python Programming
- Data libraries like OpenCV, Pandas etc.
- DL Frameworks: TensorFlow, Keras, MxNet etc.
Solution
AI Development Tools
(available today)
AI Marketplace
(coming soon)
Deep Learning Studio (DLS)
Deep Learning Concepts:
- Python Programming
- Data libraries like OpenCV, Pandas etc.
- DL Frameworks: TensorFlow, Keras, MxNet etc.
- No programming or DL knowledge
- Reconfigure and retrain vertical focused AI Apps.
- Only needs basic knowledge of data
Solution – AI Development Tools
Drag and Drop AI IDE
And Jupyter Notebook
(Available today)
Preconfigured and optimized container environment for different AI frameworks (coming soon)
Outline
What is DL?
What is weird about DL?
Breakthroughs of DL
How to get started with DL?
Doing stuff with DL
Why DL?
Favio Vázquez
About me
- Venezuelan
- Physicist and Computer Engineer
- Master in Physics UNAM
- Data Scientist
- Collaborator of Apache Spark project on GitHub and StackOverFlow
- Sr. Data Scientist Raken Data Group
- CDS Iron
- Main Developer of Optimus
Favio Vázquez
- Very active member of LinkedIn ;)
- Editor - International Journal of Business Analytics and Intelligence
- Lecturer Afi (Data Science program-MX)
- Writer en Towards Data Science, Becoming Human y Planeta Chatbot
About me
Intelligence
Favio Vázquez
Favio Vázquez
Intelligence & AI
What is Intelligence?
Ability to accomplish complex goals.
Lex Fridman - MIT.
Favio Vázquez
We need more than Intelligence.
We need understanding.
We need modeling.
Favio Vázquez
Intelligence & AI
What is Understanding?
Ability to turn complex information into simple, useful information.
Lex Fridman - MIT.
Favio Vázquez
Intelligence & AI
How long for us to be intelligent?
This only took 3.800.000.000 years
Favio Vázquez
And we want this to happen in 5 years...
Favio Vázquez
Intelligence & AI
Kurzweil’s Law of Accelerating Returns
Favio Vázquez
Raymond Kurzweil
Favio Vázquez
Repetitive
Complex
Automation
High
High
Low
Low
Not Common and simple
Not Common and Complex
Common and Simple
Common and Complex
High Level Programming
Conventional Machine Learning
Deep Learning
Intelligence & AI
Human Intelligence
Favio Vázquez
Intelligence & AI
Achieving Human Intelligence == Singularity of AI
Favio Vázquez
Intelligence & AI
Current state of AI
Favio Vázquez
There will be a breakthrough that will lead us to the singularity
Prophesy of AI
Favio Vázquez
The deep in deep learning isn’t a reference to any kind of deeper understanding achieved by the approach; rather, it stands for this idea of successive layers of representations.
Deep Learning
Favio Vázquez
Learning, in the context of machine learning, describes an automatic search process for better representations.
Deep Learning
Favio Vázquez
Deep Learning
Deep learning is a specific subfield of machine learning, a new take on learning representations from data which puts an emphasis on learning successive “layers” of increasingly meaningful representations.
What is it then??
Favio Vázquez
Artificial Neural Networks
Never say that Deep Learning is just Neural Networks that works like our brain.
Deep Learning
Favio Vázquez
Weird things about Deep Learning
Favio Vázquez
Favio Vázquez
Deep Learning
Normally you have to wait for sometime (sometime years) to be able to digest difficult and advance information in papers or research journals.
DLPaper2Code. arXiv:1711.03543v1
Sethi et al.
Favio Vázquez
Breakthroughs
of/towards DL
Favio Vázquez
Deep Learning is not all about Neural Networks
Favio Vázquez
Back Propagation
Favio Vázquez
Better initialization of the parameters of the nets.
This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results.
Favio Vázquez
Better activation functions.
This mean, better ways of approximating the functions faster leading to faster training process.
Favio Vázquez
Dropout
(finally not a bad thing to say you did).
Better ways of preventing overfitting and more.
Favio Vázquez
Convolutional Neural Nets
Favio Vázquez
Residual Nets
Favio Vázquez
Region Based CNNs
Favio Vázquez
Recurrent Neural Networks (RNNs) and LSTMs.
DeepBach. arXiv:1612.01010v2.
Hadjeres, Pachet and Nielsen
Favio Vázquez
BTW: It was shown by Liao and Poggio (2016) that
ResNet == RNN
arXiv:1604.03640v1
Favio Vázquez
Generative Adversarial Networks (GANs)
Favio Vázquez
Capsule Networks (CapsNet)
Favio Vázquez
WAIT!
What about Big Data and Data Science?
Favio Vázquez
Big Data + Data Science + AI current state
Favio Vázquez
Big Data is one of the Catalysers to get to Artificial General Intelligence
What else do we need?
Favio Vázquez
It enable us to create intelligence through AI
Favio Vázquez
Data Science!
Getting Started with Deep Learning
Favio Vázquez
Favio Vázquez
Favio Vázquez
Favio Vázquez
Siraj Raval
Favio Vázquez
Brandon Rohrer
Favio Vázquez
Lex Fridman
Favio Vázquez
François Chollet
Favio Vázquez
IBM
Favio Vázquez
Favio Vázquez
Favio Vázquez
Favio Vázquez
Doing stuff with DL
Favio Vázquez
Programming (Learn!!)
Favio Vázquez
AutoML+GUI+Notebook
Favio Vázquez
DEMO
Questions?
Favio Vázquez
Data Scientist
@faviovaz
Introduction to Deep Learning
By Favio Vazquez
Introduction to Deep Learning
- 1,292