LLMs

This presentation was created using AI as assistant.

All content is carefully checked and arranged by hand

Brainstorming: OpenAI ChatGPT4
Research: OpenAI ChatGPT4 + Bing, Bing, perplexty.ai
Generate Images: DallE3 in OpenAI ChatGPT4 and Bing/create
do you recognize all generated images?

AI Disclaimer

What is AI?

lost Group of wanderers

no sight, no directons, no map

Target: home alley

Computer uses

natural language

Computer solves complex tasks

What is AI?

Behavior is trained on data

What is AI?

Search for the smallest Error

What is AI?

Neuronal Net

What is AI?

Neuronal Net

complicated net of simple computation

What is AI?

AI seeks configuration

with smallest error

What is AI?

find valley in

multidimensional space

What is AI?

lost Group of wanderers

no sight, no directons, no map

Target: home alley

Generative Pre-trained Transformer

Generates new text

by transforming input text

exactly as trained previously

What are LLMs?

Mehr Info

Artikel: medium.com

Complete next word in sentence

What are LLMs?

Completes sentence word by word

Mehr Info

Artikel: medium.com

What are LLMs?

Transforms Request into Answer

Mehr Info

Artikel: medium.com

What are LLMs?

Transforms Request into Answer

Mehr Info

Artikel: medium.com

What are LLMs?

Mechanical Parrot

Does not repeat

but give expected answer

What are LLMs?

LLMs trained on

high quality science content

What are LLMs?

LLMs trained on

high quality science content
Twitter of Trump

Range of Quality

perfect "Bullshitter"

Wants to sound smart

doesn't care for thruth

What are LLMs?

Why is GPT so good?

Architecture

Vast Training Data
570 GB Text ~ 800.000 Books
Transformer Architecture

handles data sequences

Attention: learns relation of words

Why is GPT4 better than GPT3?

Architecture

10x More Training Data
10x Bigger Architecture
>10x Bigger Context Window
Better Mixture of Experts (MoE)

Mixture of Experts

GPT:
a single Assistant?

Mixture of Experts

GPT:
a Team of Assistants

Factcheck

Ethics

Code of Conduct

Mixture of Experts

GPT:
a Team of Assistants

Factcheck

Ethics

Code of Conduct

MoE improved constanly

better Ethics, worse Maths

Evolution of LLMs

Evolution of LLMs

LLM Moore's Law: Every year model size increases by 10x

Cost of LLMs

Cost of Training GPT4

8 GWh (700 years US household)
3 Month
300 t CO2 (1 Mio km Car)

Cost of LLMs

Sam Altman: 40x Cost reduction for ChatGPT in 1 Year

(Unconfuse Me with Bill Gates)

Cost of Training GPT4

8 GWh (700 years US household)
3 Month
300 t CO2 (1 Mio km Car)

Cost per Request GPT4

0.01 kWh (15xGoogle, 100ml Tea)
few seconds
0.4 g CO2 (10 Breath)
= 4 t CO2 / 10 Mio requests (daily)

My use of ChatGPT

GPT Power User since April '23

Brainstorm Ideas
prepare talks & lectures
ehance study material
coding
search for reference, incl academic
research in science
produce videos
...

My use of ChatGPT

GPT is the Assistant I've been waiting for

GPT Power User since April '23

Brainstorm Ideas
prepare talks & lectures
ehance study material
coding
search for reference, incl academic
research in science
produce videos
...

GPT is the Assistant I've been waiting for

Artikel: DevOps.com

AI enhances

productivity
satisfaction
efficiency

simplify and improve our work lives

GPT is the Assistant I've been waiting for

Artikel: DevOps.com

AI enhances

productivity
satisfaction
efficiency
not success
but speed

Use of LLMs

costumer service

Summarizing

write code

Assisting

Use of LLMs

costumer service

Summarizing

write code

Assisting

- Jack Ma, Satya Nadella, Elon Musk, Andrew Ng, Ginni Rometty, Marc Benioff, Kai-Fu Lee, ...

I made this with DallE-3

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

Churned code

3.3 %

7.1 %

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

LLMs - 24/7 software engineer

Future vision:

Programming language designed by AI
co-work pseudo code with LLM
Required skills:
abstraction, problem solving,
logics, adaptability,
system & algorithm design

LLMs - 24/7 software engineer

Future vision:

Programming language designed by AI
co-work pseudo code with LLM
Required skills:
abstraction, problem solving,
logics, adaptability,
system & algorithm design

AI has no aim or purpose