Why should we adopt "Continuous Testing"?

Giridhar Rajkumar

Test Automation Consultant | Author | Podcaster | Blogger

https://giridharrajkumar.com | https://anchor.fm/testing-paradise

giridhar rajkumar

grajk88

vgrk2017

World Environment Day

June 5, 2021 , Since 5 June 1974

https://en.wikipedia.org/wiki/World_Environment_Day

Agenda

QA in DevOps

Continuous Testing (CT) - Introduction

How does it different from regular testing?

Stages of CT in Pipeline

Demo

Benefits and Challenges of CT

QA in DevOps

Go Automation

Less Manual Functional Testing

Implement a fully integrated Continuous Testing process

Work closer with developers and business (Did I say BDD?)

Adopt in-sprint automation

Invest on more relevant automation tools

https://pngio.com/PNG/a134220-test-automation-png.html

Continuous Testing

Continuous Integration (CI)

Continuous Testing (CT)

CI is defined as a practice in which the developer's work is committed, built on a regular basis, deploy to an environment & runs tests. Everything in an automated fashion.

CT is defined as a software testing process in which the tests are automated and executed in an automated build process to ensure the AUT is tested thoroughly. (remember, Go Automation?)

The Differences

The Traditional Way!!!

Google Images

QA Environment

Staging Environment

The Differences

The DevOps Way!!!

Google Images

Faster Feedback

Early Detection of Defects

Stages of CT

* All the jobs includes API & UI tests

Google Images

Best Practices

Adhere to Test Automation Pyramid

Choose right automation tool

Introduce Parallel Execution

Periodic audit for regression test cases

Leverage the usage of AI tools like ReportPortal.io post-execution

Avoid time consuming tests like batch processes etc.,

Power of Service Virtualisation, Visual Testing

50%

40%

10%

Google Images

Demo

Google Images

Benefits

70% - 80% faster test process

More confidence on builds & Agile way of working

Early detection of defects

Complete CT automated

Effective living documentations

Cost and efforts saving for testing

Accelerate time-to-market drastically

Google Images

Challenges

Technically skilled testers

Multiple technologies & tools automation

CT cannot be effective if the system is complex

Can slow down the tests if automation scripts are not robust

Prior test data generation & management

Sometimes external dependencies can slow down execution

Google Images

Recap

DevOps and QA

CI & CT

How to do CT ?

Difference stages of CT & threshold limits

Best practices, benefits & challenges

Demo with Azure DevOps

Google Images

Google Images

Thank you!