Flaky automated

tests story

Sergey Pirogov

Senior QA Automation

Testing Center of Excellence

Ciklum

http://automation-remarks.com

@s_pirogov

Project team

Developers

Product owners

Manual QA

Development process

Release process

Desired future

QA Automation Engineer hired

Two month later

Test Automation Results

Problem areas

Asynchronous operations

Badly written tests

Environments

Black magic

Environments

Badly written code

Git workflow

Video Recording

public class JUnitVideoTest {

    @Rule
    public VideoRule videoRule 
                    = new VideoRule();

    @Video
    @Test
    public void shouldLogin() {
        // test code here
    }
}

https://github.com/SergeyPirogov/video-recorder-java

Results

Lessons learned

Team work it's hard

Monitor flaky tests

Keep test always green

Thank you!

http://automation-remarks.com

@s_pirogov