YOU GUNNA LEARN

Markov Chains

How to fake smart with dumb math.

I MAKE SILLY
CHAT BOTS

HOW
DOES IT WORK?

A markov chain is a model of some random process where to determine the next step only depends on what's happened by probability.

HOW MAKE MAPPING

Every bot has a mapping like this

But with letters, instead of words

LET'S
SEND A MESSAGE

How do the bots make sentences?

H = 78%

t = 10%

: = 9%
...

Markov Depth = 3

How do the bots make sentences?

e = 33%

o = 10%

a = 50%

i  = 3%
...

►H

Markov Depth = 3

►H

How do the bots make sentences?

l = 83%

p = 10%

t = 7%
...

►Ho

Markov Depth = 3

►Ho

How do the bots make sentences?

e = 5%

l = 95%
...

►Hol

Markov Depth = 3

Hol

How do the bots make sentences?

e = 67%

a = 25%

o = 8%
...

►Holl

Markov Depth = 3

oll

How do the bots make sentences?

_  = 67%

m = 25%

...

►Holla

Markov Depth = 3

lla

How do the bots make sentences?

k = 1%

b = 99%
...

►Holla

Markov Depth = 3

la_

How do the bots make sentences?

o = 21%

y = 65%

u = 14%
...

►Holla b

Markov Depth = 3

a_b

How do the bots make sentences?

d = 2%

t = 48%

i = 50%

...

►Holla bo

Markov Depth = 3

_bo

How do the bots make sentences?

►Holla boi

Markov Depth = 3

boi

= 85%

!    = 15%
...

Holla boi

Sent!

LEMME
SEE DAT CODE

OTHER
USE CASE THO?

Google PageRank

Foreign Exchange Analysis

Modelling Thermodynamic Systems

Reinforcement Learning

Population Dynamics

Simulate DNA sequences

MUCH
THANKS
YO

Markov Chains

By Scott Tolksdorf

Markov Chains

  • 84