b o n j o u r

W =
V_S^{|V|}

b

o

 n

j

o

u

r

bo

on

bon

jou

jour

b o n jour

bon jour

bo n jour

bo n j o u r

b on jou r

All these decompositions should account for the probability of the full word

b o n j o u r

W =
p(W) = \sum_{i=0}^{|W|} p(w_i|w_{\lt i})
p(w_i | w_{\lt i}) = \prod_{j=0}^i p(w_j) * p(w_i)

Subword decomposition

By mb1475963

Subword decomposition

  • 135