Which Tests Should We Automate?
Angie Jones
http://angiejones.tech
@techgirl1908
Senior Developer Advocate
Applitools, San Francisco, CA, USA
@techgirl1908
@techgirl1908
Automation requires maintenance
@techgirl1908
@techgirl1908
Lots of automation can require lots of time
@techgirl1908
@techgirl1908
Redundant automation is noisy
@techgirl1908
@techgirl1908
@techgirl1908
@techgirl1908
Automation Worksheet
What's your gut feeling?
@techgirl1908
Probability
Impact
1
1
2
3
4
5
2
3
4
5
RISK
frequency of use by customers
@techgirl1908
if broken, what's the impact to customers?
Distinctness
Cause for Action
1
1
2
3
4
5
2
3
4
5
VALUE
@techgirl1908
does this test provide new info?
how quickly would this failure be fixed?
Quickness
Ease
1
1
2
3
4
5
2
3
4
5
COST-EFFECIENCY
@techgirl1908
how quickly can this be scripted
how easy will it be to script this
Similar to weak areas
Frequency of breaks
1
1
2
3
4
5
2
3
4
5
HISTORY
@techgirl1908
volume of historical failures in related areas
volume of historical failures for this test
| Area | # |
|---|---|
| setting location | 51 |
| updating handle | 27 |
| pinning tweet | 2 |
| viewing tweets | 10 |
Add them up
@techgirl1908
| Automate |
|---|
| Possibly automate |
|---|
| Don't automate |
|---|
67 - 100
34 - 66
0 - 33
@techgirl1908
SCORES
| ID | DESCRIPTION | R | V | C | H | Score |
|---|---|---|---|---|---|---|
| 1 | Add a tweet | 25 | 25 | 25 | 0 | 75 |
| 6 | Set location | 10 | 15 | 25 | 25 | 75 |
Different Analysis, Same Score
@techgirl1908
| ID | DESCRIPTION | R | V | C | H | Score |
|---|---|---|---|---|---|---|
| 24 | Add tweet to a moment | 5 | 5 | 25 | 0 | 35 |
Do We Automate?
@techgirl1908
@techgirl1908
Thanks, Dot!
@techgirl1908
Good luck!
Angie Jones
http://angiejones.tech
@techgirl1908
Senior Developer Advocate
Applitools, San Francisco, CA, USA