Which Tests Should We Automate?

Angie Jones

http://angiejones.tech

@techgirl1908

Senior Developer Advocate

Applitools, San Francisco, CA, USA

@techgirl1908

@techgirl1908

Automation requires maintenance

@techgirl1908

@techgirl1908

Lots of automation can require lots of time

@techgirl1908

@techgirl1908

Redundant automation is noisy

@techgirl1908

@techgirl1908

@techgirl1908

@techgirl1908

Automation Worksheet

What's your gut feeling?

@techgirl1908

Probability

Impact

1

1

2

3

4

5

2

3

4

5

RISK

frequency of use by customers

@techgirl1908

if broken, what's the impact to customers?

Distinctness

Cause for Action

1

1

2

3

4

5

2

3

4

5

VALUE

@techgirl1908

does this test provide new info?

how quickly would this failure be fixed?

Quickness

Ease

1

1

2

3

4

5

2

3

4

5

COST-EFFECIENCY

@techgirl1908

how quickly can this be scripted

how easy will it be to script this

Similar to weak areas

Frequency of breaks

1

1

2

3

4

5

2

3

4

5

HISTORY

@techgirl1908

volume of historical failures in related areas

volume of historical failures for this test

Area #
setting location 51
updating handle 27
pinning tweet 2
viewing tweets 10

Add them up

@techgirl1908

Automate
Possibly automate
Don't automate

67 - 100

34 - 66

0 - 33

@techgirl1908

SCORES

ID DESCRIPTION R V C H Score
1 Add a tweet 25 25 25 0     75
6 Set location 10 15 25 25     75

Different Analysis, Same Score

@techgirl1908

ID DESCRIPTION R V C H Score
24 Add tweet to a moment 5 5 25 0     35

Do We Automate?

@techgirl1908

@techgirl1908

Thanks, Dot!

@techgirl1908

Good luck!

Angie Jones

http://angiejones.tech

@techgirl1908

Senior Developer Advocate

Applitools, San Francisco, CA, USA

Which Tests Should We Automate

By Angie Jones

Which Tests Should We Automate

When asked “which tests should we automate?”, my answer is always “it depends”. Several factors should be considered when deciding on which tests to automate and many times that decision is contextual.

  • 20,037