Which Tests Should We Automate?

Angie Jones

http://angiejones.tech

@techgirl1908

Senior Automation Engineer

Twitter, San Francisco, CA, USA

@techgirl1908

@techgirl1908

Automation requires maintenance

@techgirl1908

@techgirl1908

Lots of automation can require lots of time

@techgirl1908

@techgirl1908

Redundant automation is noisy

@techgirl1908

@techgirl1908

@techgirl1908

@techgirl1908

Automation Worksheet

What's your gut feeling?

@techgirl1908

Probability

Impact

1

1

2

3

4

5

2

3

4

5

RISK

frequency of use by customers

@techgirl1908

if broken, what's the impact to customers?

Distinctness

Induction to Action

1

1

2

3

4

5

2

3

4

5

VALUE

@techgirl1908

does this test provide new info?

how quickly would this failure be fixed?

Time

Simplicity

1

1

2

3

4

5

2

3

4

5

COST-EFFECIENCY

@techgirl1908

how quickly can this be scripted

how easy will it be to script this

Similar to weak areas

Frequency of breaks

1

1

2

3

4

5

2

3

4

5

HISTORY

@techgirl1908

volume of historical failures in related areas

volume of historical failures for this test

Area #
setting location 51
updating handle 27
pinning tweet 2
viewing tweets 10

Add them up

@techgirl1908

Automate
Possibly automate
Don't automate

75 - 100

25 - 74

0 - 24

@techgirl1908

SCORES

ID DESCRIPTION R V C H Score
1 Add a tweet 25 25 25 0     75
6 Set location 10 15 25 25     75

Different Analysis, Same Score

@techgirl1908

ID DESCRIPTION R V C H Score
24 Add tweet to a moment 5 5 25 0     35

Do We Automate?

@techgirl1908

@techgirl1908

Thanks, Dot!

@techgirl1908

Good luck!

Angie Jones

http://angiejones.tech

@techgirl1908

Senior Automation Engineer

Twitter, San Francisco, CA, USA