Angie Jones PRO
Senior Developer Advocate specializing in test automation. International Keynote Speaker. Master Inventor.
Which Tests Should We Automate?
Angie Jones
http://angiejones.tech
@techgirl1908
Senior Developer Advocate
Applitools, San Francisco, CA, USA
@techgirl1908
@techgirl1908
Automation requires maintenance
@techgirl1908
@techgirl1908
Lots of automation can require lots of time
@techgirl1908
@techgirl1908
Redundant automation is noisy
@techgirl1908
@techgirl1908
@techgirl1908
@techgirl1908
Automation Worksheet
What's your gut feeling?
@techgirl1908
Probability
Impact
1
1
2
3
4
5
2
3
4
5
RISK
frequency of use by customers
@techgirl1908
if broken, what's the impact to customers?
Distinctness
Cause for Action
1
1
2
3
4
5
2
3
4
5
VALUE
@techgirl1908
does this test provide new info?
how quickly would this failure be fixed?
Quickness
Ease
1
1
2
3
4
5
2
3
4
5
COST-EFFECIENCY
@techgirl1908
how quickly can this be scripted
how easy will it be to script this
Similar to weak areas
Frequency of breaks
1
1
2
3
4
5
2
3
4
5
HISTORY
@techgirl1908
volume of historical failures in related areas
volume of historical failures for this test
| Area | # |
|---|---|
| setting location | 51 |
| updating handle | 27 |
| pinning tweet | 2 |
| viewing tweets | 10 |
Add them up
@techgirl1908
| Automate |
|---|
| Possibly automate |
|---|
| Don't automate |
|---|
67 - 100
34 - 66
0 - 33
@techgirl1908
SCORES
| ID | DESCRIPTION | R | V | C | H | Score |
|---|---|---|---|---|---|---|
| 1 | Add a tweet | 25 | 25 | 25 | 0 | 75 |
| 6 | Set location | 10 | 15 | 25 | 25 | 75 |
Different Analysis, Same Score
@techgirl1908
| ID | DESCRIPTION | R | V | C | H | Score |
|---|---|---|---|---|---|---|
| 24 | Add tweet to a moment | 5 | 5 | 25 | 0 | 35 |
Do We Automate?
@techgirl1908
@techgirl1908
Thanks, Dot!
@techgirl1908
Good luck!
Angie Jones
http://angiejones.tech
@techgirl1908
Senior Developer Advocate
Applitools, San Francisco, CA, USA
Which Tests Should We Automate
By Angie Jones
Which Tests Should We Automate
When asked “which tests should we automate?”, my answer is always “it depends”. Several factors should be considered when deciding on which tests to automate and many times that decision is contextual.
