Artificial Intelligence
Dr. Ahmad Haj Mosa
ahmad.haj.mosa@pwc.com
LinkedIn: ahmad-haj-mosa
Marvin Minsky
The definition of intelligence
Our minds contain processes that enable us to solve problems we consider difficult.
"Intelligence" is our name of those processes we don't yet understand.
History of AI
1980
1998
1943
Foundation of NN
9th century
Algorithms
Backpropagation Algorithm
LeNet
2007
Nvidia CUDA
2017
Transformers
GPT
2018
AI levels
Neuron Models
Text
Dendrites
Axons
Cell body
\( x_1 \)
\( x_2 \)
\( y \)
Text
\( w_1 \)
\( w_2 \)
Neural Network Model
Visual Cortext
Text
Learning using Hebbian Theory
"Any two cells or systems of cells that are repeatedly active at the same time will tend to become 'associated', so that activity in one facilitates activity in the other."
Neuron A
Neuron A
Neuron B
Neuron B
Neuron A
Neuron B
Time
Hebbian Theory
-
If Neuron A is active and conntected to Neuron B, then Neuron A will put Neuron B in a predicted state
-
If the prediction is correct (Neuron B is observed in an active state), then reward/increase the connection between them
-
If the prediction is wrong (Neuron B is not observed in an active state), then weaken/decrease the connections between them
Neuron A
Neuron A
Neuron B
Neuron B
Neuron A
Neuron B
Time
Learning using Hebbian Theory
Slow
Fast
Automatic
Effortful
Logical
Emotional
Conscious
Unconscious
Stereotypic
Reasoning
| System 1 | System 2 |
|---|---|
| drive a car on highways | drive a car in cities |
| come up with a good chess move (if you're a chess master) | point your attention towards the clowns at the circus |
| understands simple sentences | understands law clauses |
| correlation | causation |
| hard to explain | easy to explain |
Thinking fast and slow
source: Thinking fast and slow by Daniel Kahneman
Classification: wolf or husky?
source: “Why Should I Trust You?” Explaining the Predictions of Any Classifier
ChatGPT
GPT
Generative
Pre-trained
Transformer
How GPT is trained
I
was
am
He
She
is
from
in
at
Austria
Germany
Syria
.
,
;
GPT Training Data
I am from Austria.
I am from Austria.
I am from Austria.
I am from Austria.
I am from Austria.
I am from Austria.
I was in Germany.
I was in Germany.
I was in Germany.
I was in Germany.
I was in Germany.
I was in Germany.
I was in Germany.
How GPT is trained
I
was
am
He
She
is
from
in
at
Austria
Germany
Syria
.
,
;
How GPT is trained
I
was
am
He
She
is
from
in
at
Austria
Germany
Syria
.
,
;
Why ChatGPT is becoming smarter and smarter
What are the limitations
It’s likely that this will have significant implications for labor.
The risk is real
Thank you for your attention
Dr. Ahmad Haj Mosa
Director at PwC
ahmad.haj.mosa@pwc.com