Dr. Stefan Hackstein
Generative Pre-trained Transformer
Generates new text
by transforming the input text Transforms
just like it was trained before
Reads text
writes continuation / response
Guardian: How Chatbots work
Article: medium.com
Completes the next word in a sentence
Completes word by word a whole sentence
Article: medium.com
Transforms request into response
Article: medium.com
Trained on 570 GB of text data
100 billion neurons (200 TB)
Human ~86 billion neurons
Article: medium.com
800 thousand books
100 billion neurons
~86 billion neurons
By Albert Einstein
By Albert Einstein
to Donald Trump
??? Neurons ???
800 thousand books
100 billion neurons
~86 billion neurons
By Albert Einstein
to Donald Trump
Spectrum of quality
By Albert Einstein
to Donald Trump
Spectrum of quality
Rolle: Albert Einstein
Frage: Was ist Energie?
Role assignment refines tone & quality
By Albert Einstein
to Donald Trump
Spectrum of quality
Role assignment changes tone & quality
Rolle: Donald Trump
Frage: Was ist Energie?
By Albert Einstein
to Donald Trump
Spectrum of quality
Frage: Was ist Energie?
Perfect "Bullshitter"
sounds eloquent - truthfulness irrelevant
! Check every detail of the answer !
Hallucinations ~ false memories
Perfect "Bullshitter"
sounds eloquent - truthfulness irrelevant
! Check every detail of the answer !
Hallucinations ~ false memories
How to recognize hallucinations?
Hallucinations are rarely the same!
Ask the question more often. Does the answer remain the same?
Manakul et al. 2023
The assistant,
that I always wanted
Article: DevOps.com
AI improves
The assistant,
that I always wanted
Article: DevOps.com
AI improves
The assistant,
that I always wanted
Article: DevOps.com
AI improves
First learn the skill,
then use AI!
The assistant,
that I always wanted
How not to Work with AI
How to Work with AI