AUTOMATED TESTING
Why Automated Testing
Predictable costs
Lesser regression
Shorter feedback times
Focus on Value Delivery
The big picture
Test focused - simplified
Automate and refine the V model
Test types
-
Unit
-
Component
-
Integration
-
Functional
-
Acceptance
-
Security
-
Performance
Test Maturity
-
Base: Testing as defect detection
-
Beginner: Testing as functional requirements validation
-
Intermediate: Testing as quality measurement
-
Advanced: Testing as quality control
- Expert: Testing to verify business value
Automated Testing Maturity
-
Base: Testing as defect detection
-
Automatic unit tests
-
Seperate test enviroments
- Automatic integration tests
- Some automated functional UI tests (isolated)
-
Automatic component tests (isolated)
- Automated functional UI tests (isolated)
- Some automatic acceptance tests
- Full automatic acceptance tests
- Automatic performance tests
- Automatic security tests
- Risk based manual testing
- Verify expected business value
Automated Testing Maturity - requirements
-
Base: Testing as defect detection
-
Documented manual deploy
- Documented manual testscripts
- Centralised release builds
- Dedicated CI (build) server
- Dedicated test enviroment
-
Automatic deploy to test server
- Static code analysis
- Manual testscripts are versioned
- Isolated test systems (internal and external)
- Automated Test scripts are versioned
- Predictable and isolated test datasets
- Quality metrics per build and trend reporting
- Automated test reporting
- Standard process for all enviroments
- Quality and test metrics feedback integrated in deploy pipeline (Automated quality gate control)
- Automated Acceptance test are written before code is written
- Analytics to confirm business value are included in features
- Centralised Quality dashboards
-
Automaticly validate analytics against business value
- Analytics report integration
Automated Testing
By dverhoeckx
