What is a Chatbot?

Dr. Stefan Hackstein

What is ChatGPT?

Generative Pre-trained Transformer

Generates new text

by transforming the input text Transforms

just like it was trained before

What is ChatGPT?

Reads text

writes continuation / response 

Guardian: How Chatbots work

How does ChatGPT learn?

Article: medium.com

Completes the next word in a sentence

How does ChatGPT learn?

Completes word by word a whole sentence

Article: medium.com

How does ChatGPT learn?

Transforms request into response

Article: medium.com

How does ChatGPT learn?

Trained on 570 GB of text data

  • 500 billion characters
  • 250 million book pages
  • 800 thousand books

100 billion neurons (200 TB)

Human ~86 billion neurons
 

Article: medium.com

What does ChatGPT learn?

800 thousand books

100 billion neurons

 

 

 

 

~86 billion neurons

By Albert Einstein

What does ChatGPT learn?

By Albert Einstein

to Donald Trump

??? Neurons ???

800 thousand books    

100 billion neurons

 

 

 

 

~86 billion neurons

What is ChatGPT?

By Albert Einstein

to Donald Trump

Spectrum of quality

What is ChatGPT?

By Albert Einstein

to Donald Trump

Spectrum of quality

Rolle: Albert Einstein
Frage: Was ist Energie?

Role assignment refines tone & quality

What is ChatGPT?

By Albert Einstein

to Donald Trump

Spectrum of quality

Role assignment changes tone & quality

Rolle: Donald Trump
Frage: Was ist Energie?

What is ChatGPT?

By Albert Einstein

to Donald Trump

Spectrum of quality


Frage: Was ist Energie?

What is ChatGPT?

Perfect "Bullshitter"

sounds eloquent   -   truthfulness irrelevant

! Check every detail of the answer !

Hallucinations ~ false memories

What is ChatGPT?

Perfect "Bullshitter"

sounds eloquent   -   truthfulness irrelevant

! Check every detail of the answer !

Hallucinations ~ false memories

 

How to recognize hallucinations?

Hallucinations are rarely the same!
Ask the question more often. Does the answer remain the same?

Manakul et al. 2023

Why Artificial Intelligence?

Why Artificial Intelligence?

The assistant,

that I always wanted

Article: DevOps.com

AI improves

  • Productivity
  • Satisfaction
  • Effectiveness

The assistant,

that I always wanted

Article: DevOps.com

AI improves

  • Productivity
  • Satisfaction
  • Effectiveness
     
  • not competence
  • but efficiency

The assistant,

that I always wanted

Article: DevOps.com

AI improves

  • Productivity
  • Satisfaction
  • Effectiveness
     
  • not competence
  • but efficiency

First learn the skill,

then use AI!

The assistant,

that I always wanted

How not to Work with AI

How to Work with AI

What is a Chatbot?

  • Trained to communicate like a rational human
  • Strength: Versatile phrasing
  • Weakness: No understanding
  • Helpful: Rephrasing, quick overviews
  • Harmful: Outsourcing thinking processes
  • Good Use: Work iteratively, self-directed
  • Always think along

What is a Chatbot?

By Stefan Hackstein

What is a Chatbot?

  • 127