This presentation was created using AI as assistant.

All content is carefully checked and arranged by hand

AI Disclaimer

What is AI?

lost Group of wanderers

no sight, no directons, no map

Target: home alley

LLMs

Computer uses

natural language

Computer solves complex tasks

What is AI?

Behavior is trained on data

What is AI?

Search for the smallest Error

What is AI?

Neuronal Net

What is AI?

Neuronal Net

complicated net of simple computation

What is AI?

AI seeks configuration

with smallest error

What is AI?

find valley in

multidimensional space

What is AI?

What is AI?

lost Group of wanderers

no sight, no directons, no map

Target: home alley

Generative Pre-trained Transformer

Generates new text

by transforming input text

exactly as trained previously

What are LLMs?

What are LLMs?

Artikel: medium.com

Complete next word in sentence

What are LLMs?

Completes sentence word by word

Artikel: medium.com

What are LLMs?

Transforms Request into Answer

Artikel: medium.com

What are LLMs?

Transforms Request into Answer

Artikel: medium.com

What are LLMs?

Mechanical Parrot
 

Does not repeat

but give expected answer

What are LLMs?

LLMs trained on

  • high quality science content

What are LLMs?

LLMs trained on

  • high quality science content
  • Twitter of Trump

Range of Quality

perfect "Bullshitter"

Wants to sound smart

doesn't care for thruth

What are LLMs?

Why is GPT so good?

Architecture

  • Vast Training Data
    570 GB Text ~ 800.000 Books

     
  • Transformer Architecture

handles data sequences

Attention: learns relation of words

Why is GPT4 better than GPT3?

Architecture

  • 10x More Training Data 
  • 10x Bigger Architecture
  • >10x Bigger Context Window
  • Better Mixture of Experts (MoE)

Mixture of Experts

Mixture of Experts

GPT:
a single Assistant?

Mixture of Experts

GPT:
a Team of Assistants

Factcheck

Ethics

Code of Conduct

Mixture of Experts

GPT:
a Team of Assistants

Factcheck

Ethics

Code of Conduct

MoE improved constanly

better Ethics, worse Maths

Evolution of LLMs

Evolution of LLMs

LLM Moore's Law: Every year model size increases by 10x

Cost of LLMs

Cost of Training GPT4

  • 8 GWh (700 years US household)
  • 3 Month
  • 300 t CO2 (1 Mio km Car)

Cost of LLMs

Sam Altman: 40x Cost reduction for ChatGPT in 1 Year

(Unconfuse Me with Bill Gates)

Cost of Training GPT4

  • 8 GWh (700 years US household)
  • 3 Month
  • 300 t CO2 (1 Mio km Car)

Cost per Request GPT4

  • 0.01 kWh (15xGoogle,  100ml Tea)
  • few seconds
  • 0.4 g CO2 (10 Breath)
    = 4 t CO2 / 10 Mio requests (daily)

My use of ChatGPT

GPT Power User since April '23

  • Brainstorm Ideas
  • prepare talks & lectures
  • ehance study material
  • coding
  • search for reference, incl academic
  • research in science
  • produce videos
  • ...

My use of ChatGPT

GPT is the Assistant I've been waiting for

GPT Power User since April '23

  • Brainstorm Ideas
  • prepare talks & lectures
  • ehance study material
  • coding
  • search for reference, incl academic
  • research in science
  • produce videos
  • ...

GPT is the Assistant I've been waiting for

Artikel: DevOps.com

AI enhances

  • productivity
  • satisfaction
  • efficiency

simplify and improve our work lives

GPT is the Assistant I've been waiting for

Artikel: DevOps.com

AI enhances

  • productivity
  • satisfaction
  • efficiency
  • not success
  • but speed

Use of LLMs

costumer service

Summarizing

write code

Assisting

Use of LLMs

costumer service

Summarizing

write code

Assisting

- Jack Ma, Satya Nadella, Elon Musk, Andrew Ng, Ginni Rometty, Marc Benioff, Kai-Fu Lee, ...

- Jack Ma, Satya Nadella, Elon Musk, Andrew Ng, Ginni Rometty, Marc Benioff, Kai-Fu Lee, ...

- Jack Ma, Satya Nadella, Elon Musk, Andrew Ng, Ginni Rometty, Marc Benioff, Kai-Fu Lee, ...

I made this with DallE-3

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

Churned code

3.3 %

7.1 %

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

Future vision:

  • Programming language designed by AI
     
  • co-work pseudo code with LLM
     
  • Required skills:
    abstraction, problem solving,
    logics, adaptability,
    system & algorithm design

LLMs - 24/7 software engineer

Future vision:

  • Programming language designed by AI
     
  • co-work pseudo code with LLM
     
  • Required skills:
    abstraction, problem solving,
    logics, adaptability,
    system & algorithm design

AI has no aim or purpose

How to Code with AI

How to Code with AI

GPT3.5 Output:

  • 59.7% plagiarized
  • 45.7% copied
  • 46.5% paraphrased
  • 27.4% Minor Changes

Basically: No GPT Output is original

GPT3.5 Output:

  • 59.7% plagiarized
  • 45.7% copied
  • 46.5% paraphrased
  • 27.4% Minor Changes

Basically: No GPT Output is original

LLMs can do serious comedy!?!

Internet dies of AI

Internet dies of AI

AI dies of bad (Internet) Data

AI dies of bad (Internet) Data

AI dies of bad (Internet) Data

!!! Explicitly label AI generated text !!!

Improvement of AI

Improvement of AI

GenAI brings Images to live

GenAI brings Images to live

Improvement of AI

Improvement of AI

Future of Mankind

Future of Mankind

Future of Mankind

Future of Mankind

Future of Mankind

Future of Mankind

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Achievements of AI

Pivotal Role of LLMs?

Achievements of AI

Pivotal Role of LLMs?

Achievements of AI

Pivotal Role of LLMs?

Achievements of AI

Pivotal Role of LLMs?

Future of AI

Future of AI

  • talk & reason with machines
  • explanation for failure
  • clarify questions
  • explain new task
  • personalize

Future of Work

  • Creativity
  • Innovation
  • Leadership & Mentorship
  • Collective Intelligence
  • Connecting Dots

Responsible Use

  • collaborate with AI
  • Iterate
  • cite when & for what you use AI
  • label AI generated content
  • don't overuse AI

Conclusion

  • AI - revolution in the making
  • LLMs - Universal Interface   man - machine
  • huge increase in productivity
  • already transforming entire industries
  • humans lead the way of AI
  • we are just getting started...

Selbstlernkurs

Didaktik mit KI

Grundwissen zu KI

Offene Diskussion

KI in der Lehre

Jeden 1. Montag im Monat

12:00 - 13:00

Mathematikzentrum

LLMs - Revolution or Hype?

By Stefan Hackstein

LLMs - Revolution or Hype?

  • 214