Why should we adopt "Continuous Testing"?
Giridhar Rajkumar
Test Automation Consultant | Author | Podcaster | Blogger
https://giridharrajkumar.com | https://anchor.fm/testing-paradise
giridhar rajkumar
grajk88
vgrk2017
World Environment Day
June 5, 2021 , Since 5 June 1974
https://en.wikipedia.org/wiki/World_Environment_Day
Agenda
QA in DevOps
Continuous Testing (CT) - Introduction
How does it different from regular testing?
Stages of CT in Pipeline
Demo
Benefits and Challenges of CT
QA in DevOps
Go Automation
Less Manual Functional Testing
Implement a fully integrated Continuous Testing process
Work closer with developers and business (Did I say BDD?)
Adopt in-sprint automation
Invest on more relevant automation tools
https://pngio.com/PNG/a134220-test-automation-png.html
Continuous Testing
Continuous Integration (CI)
Continuous Testing (CT)
CI is defined as a practice in which the developer's work is committed, built on a regular basis, deploy to an environment & runs tests. Everything in an automated fashion.
CT is defined as a software testing process in which the tests are automated and executed in an automated build process to ensure the AUT is tested thoroughly. (remember, Go Automation?)
The Differences
The Traditional Way!!!
Google Images
QA Environment
Staging Environment
The Differences
The DevOps Way!!!
Google Images
Faster Feedback
Early Detection of Defects
Stages of CT
* All the jobs includes API & UI tests
Google Images
Best Practices
Adhere to Test Automation Pyramid
Choose right automation tool
Introduce Parallel Execution
Periodic audit for regression test cases
Leverage the usage of AI tools like ReportPortal.io post-execution
Avoid time consuming tests like batch processes etc.,
Power of Service Virtualisation, Visual Testing
50%
40%
10%
Google Images
Demo
Google Images
Benefits
70% - 80% faster test process
More confidence on builds & Agile way of working
Early detection of defects
Complete CT automated
Effective living documentations
Cost and efforts saving for testing
Accelerate time-to-market drastically
Google Images
Challenges
Technically skilled testers
Multiple technologies & tools automation
CT cannot be effective if the system is complex
Can slow down the tests if automation scripts are not robust
Prior test data generation & management
Sometimes external dependencies can slow down execution
Google Images
Recap
DevOps and QA
CI & CT
How to do CT ?
Difference stages of CT & threshold limits
Best practices, benefits & challenges
Demo with Azure DevOps
Google Images
Google Images