2016 UI Commons SH
Automation Review
ShawnShao 2016.12
aGENDA
- Before 2016
- UI Auto 2016
- Next Step
Before 2016
- Automation member: JackZhen + EdwinLiu
- Cases number: 19
- Approach: 1 - SAF
- Defect detected number: N/A
- Front code coverage: No
UI AUto 2016
- Automation Member
- Case Number:45+16+90+15
- Approaches
- Defects:3
SAF in 2016
- Triditional SAF = Java+Selenium+CI
-
2016 achievements
- 3 Manual QA involved
- 20+ sync up meetings (manual QA+ automation QA)
- 29 page actions updated
- 53 cases created
- 45 cases check in
- 2 AEP Job created
- 2 defects caught
-
Limitation:
- Slow! Data preparation.
- Slow! Running.
- Slow! Debugging.
Simplified SAF
Previous Workflow
- Create base object
- Permission
- Field
- Asso
- conditional
- Business Rules
- Create configUI
- UI Rules
- Propeties..
- Runtime
Start verify results
Data Preparations...
Testing
SIMPLIFIED SAF
New Workflow
-
Login specific GIN page
-
Check the components
SIMPLIFIED SAF
How it works
- Collects DWR calls from compleated JIRA ticket
- Mock DWR call results
- Continuous integration front end code with SVN
SIMPLIFIED SAF
Achievements
- 2 scripts
- 16+ common assertions
- 6+ month job running
SIMPLIFIED SAF
Limitation
-
Hard to be customized
-
hard to be extended
-
hard to maintain
-
STILL NOT FAST ENOUGH
-
STILL NO JS Coverage report
SIMPLIFIED SAF
New UI Automation (Pilot)
Auto Pilot
Traditional v.s. New
| SAF | New UI Automation | |
|---|---|---|
| Speed and Efficiency | 14 mins/case | 8 secs (7 scripts 104 assert) |
| Code Coverage | Java | Javascript |
| Agile | Agile | More Agile |
| Continuous Integration | Regression Testing level | CI level |
AUTO PILOT
- 9 scripts
- 100+ common assertions
- CI in real world
- 2 defects detected
- Provide frontend code coverage
AUTO PILOT
MISC
We also attempted something else...
Postman/Jmeter to handle semi automation...
Previous Workflow
- Create base object
- Permission
- Field
- Asso
- conditional
- Business Rules
- Create configUI
- UI Rules
- Propeties..
- Runtime
Start verify results
Data Preparations...
Testing
OData API Data Preparation
MISC
Comparison
2017 evolution
