Bob Or Alice

real-time honest A/B testing

~ 60 commit

Python + Shiny

optimal decision?

A

B

A

simple A/B test

huge risk

? sample size
? A/B ratio
? reliability

real-time results

click rate uplift

click rates

A

B

A

B

B

automate the decision

- great for customer

- great for A.I.M.     

Bob Or Alice

real-time honest A/B testing