VISUAL REGRESSION TESTING FOR INFOVIZ AND OTHER INTERACTIVE SYSTEMS
Nychol Bazurto Gómez
John Alexis Guerra Gómez
Advisor
Master's student
What is there currently in whole software testing topic?
Definitions
que podia hacer antes y que no (recordar cuadro de John)
que haria un experto, que es lo que hacen para hacer ese testing como lo hago yo, mejor!!
1. Lo que hace nbackstop con una viz.
2. CAntidad de codigo. no puedo probar animaciones.
universo de los mecanismos visuales que el chequea... y que no.
What kind of surveys were found...
1. A Survey on Load Testing of Large-Scale Software Systems. Jiang, Zhen Ming and Hassan, Ahmed E.
2. A Comparative analysis on Black box testing strategies. Jacob, Pramod Mathew and Prasanna, M.
Relationships among testing types: load, stress and performance [1].
Classification proposed by [2].
Tools
Record and playback
Test automation
Code coverage
Performance/Load
There are well-established tools for automating the testing of how software behaves, but very few that automate the testing of how software looks.
Run some tests through the site.
Take screenshots of components.
Compare those screenshots against a baseline and report differences
1
2
3
Phantom
A headless Webkit browser that allows you to quickly render web pages, and most importantly, take screenshots of them.
Casper
A navigation and scripting tool that allows us to interact with the page rendered by PhantomJS. Actions like move the mouse, perform clicks, enter text into fields and even perform javascript functions directly in the DOM are allowed.
Wraith
SlimerJs
BackstopJs
PhantomCSS
...or...
Some associated tools
Grunt
A comparison engine that can compare two images and determining if there are any pixel differences between them
ResembleJS
What kind of things are including currently...
Disadvantages/ lacks
- Take screenshots by user interaction.
- Transitions and animations are noise.
- Interactions are taken from basic elements (d3 works with special tags, directed to form).
- Compare size, position of some elements like divs, tags (h1..), images/banners, bottoms.
- There is some testing advance in others devices (mobile testing).
- There isn't a close solution to simulations or visualization in real time.
What are the most interesting things for viz investigators?
1
2
3
Which tool do you use to develop your viz?
What kind of things would you like test when you are developing them?
What are the main bugs/problems when you update your code?
Do you use some particular technique to test?
overlapping
What kind set of experiments we are going to do for?
- Experiments with the current tools.
2. Define some basic visualizations.
3. Experiments testing some marks and channels.
4. Take baselines from differents resolutions.
Bogotá
Medellín