Continuous Testing

Giridhar Rajkumar

Test Automation Consultant | Author | Podcaster | Blogger

https://learndevtestops.com | https://thetestershub.info | https://anchor.fm/testing-paradise

giridhar rajkumar

grajk88

Here's what you need to know...

vgrk2017

Agenda

What is DevOps? (2 mins)

QA in DevOps (2 mins)

Continuous Testing (CT) - Introduction (2 mins)

How does it different from regular testing? (5 mins)

Stages of CT in Pipeline (5 mins)

Demo - Selenium Framework for DevOps Pipeline (10 mins)

Benefits and Challenges of CT (5 mins)

DevOps - Introduction

What is DevOps?

“DevOps is a set of practices that combines software development (Dev) and information-technology operations (Ops) which aims to shorten the systems development life cycle and provide continuous delivery with high software quality.”

- Lovingly, Wikipedia

DevOps - Introduction

QA in DevOps

Go Automation

Less Manual Functional Testing

Implement a fully integrated Continuous Testing process

Work closer with developers and business (Did I say BDD?)

Adopt in-sprint automation

Invest on more relevant automation tools

https://pngio.com/PNG/a134220-test-automation-png.html

Continuous Testing

Continuous Integration (CI)

Continuous Testing (CT)

CI is defined as a practice in which the developer's work is committed, built on a regular basis, deploy to an environment & runs tests. Everything in an automated fashion.

CT is defined as a software testing process in which the tests are automated and executed in an automated build process to ensure the AUT is tested thoroughly. (remember, Go Automation?)

The Differences

The Traditional Way!!!

Google Images

QA Environment

Staging Environment

The Differences

The DevOps Way!!!

Google Images

Test Automation Pyramid

Google Images

UI

API

Unit Tests

10%

40%

50%

Fast and Cheap

Fast and Cheap

Stages of CT

* All the jobs includes API & UI tests

Google Images

Best Practices

Adhere to Test Automation Pyramid

Choose right automation tool

Introduce Parallel Execution

Periodic audit for regression test cases

Leverage the usage of AI tools like ReportPortal.io post-execution

Avoid time consuming tests like batch processes etc.,

Power of Service Virtualisation, Visual Testing

50%

40%

10%

Google Images

Demo

Google Images

Advanced DevOps Pipeline

Benefits

70% - 80% faster test process

More confidence on builds & Agile way of working

Early detection of defects

Complete CT automated

Effective living documentations

Cost and efforts saving for testing

Accelerate time-to-market drastically

Google Images

Challenges

Technically skilled testers

Multiple technologies & tools automation

CT cannot be effective if the system is complex

Can slow down the tests if automation scripts are not robust

Prior test data generation & management

Sometimes external dependencies can slow down execution

Google Images

Recap

DevOps and QA

CI & CT

How to do CT ?

Difference stages of CT & threshold limits

Best practices, benefits & challenges

Demo with Azure DevOps

Google Images

Google Images

Thank you!