eValid LoadTest, eV.manger and Validation

Agenda Load Test capability of eValid How to execute load test by using eValid Introduction to eV.manager Validation in eValid

Introduction Load testing tools can be used to test the system behavior and performance under stressful conditions by emulating thousands of virtual users. eValid can run a Load Test scenario made up of repeated playbacks of multiple script files at varying delay multiplier values. By running multiple copies of the eValid browser simultaneously, eValid can impose heavy work loads on a Web Server.

Load Test capability of eValid (1/4) eValid can run a LoadTest scenario made up of repeated playbacks of multiple script files at varying delay multiplier values Two kinds of files –One scenario file Containing the construction of loading test –Multiple script files Generated by recording

Load Test capability of eValid (2/4) Sub-session title of that test The repetition count Parameters use during play Additional Parameters pm means playback multiplier

Load Test capability of eValid (3/4) Some Important Factors –The master script runs each specified script in a separate eValid sub-browser. –Each eValid sub-browser runs the script the specified number of times at the specified delay multiplier, and then closes itself. –Each script runs without cache to assure that each page is actually downloaded, not just read from local storage

Load Test capability of eValid (4/4) Some Important Factors –Playback of each script sequence begins as soon as its sub-browser is fully launched. The sub-browsers are launched in the sequence specified in the master script –The load test scenario expressed in the master script can be made up of a set of per-recorded script files –Timing data on each complete playback is written to a single consolidated timing log file, the default name of which is LoadTest.log

Steps to create load test script 1. Create a test script, *.evs file, to include one URL for the session loads. 2. Next, select File > New Load Test to begin constructing a separate master LoadTest script. 3. Use the LoadTest Script Generator to create a LoadTest Script. 4. Select Settings > Record/Play Preferences > Load Testing and click Display HTML Load Test Monitor. Make sure that only this option is clicked. This enables the Real-Time monitoring function. 5. Select Playback > Start Playback to begin the LoadTest.

Detailed Explanation for LoadTest Scenario Editor FULL (Default Setting) -- Using full featured eValids to run the LoadTest. A Thin: Stripped down version of eValid which can maximize the number of browsers that can run on a single machine by using a minimal footprint Modifies the HTTP requests to indicated display type. The options are: FULL: Normal, full browser output. TEXT: No Images are requested through HTTP or rendered These are $NAME=value pairs that are to be substituted into this specific script file These are switch variables that are to be applied to playback of the specified script for this particular user. Pm: playback multiplier =1.0

LoadTest Monitor

LoadTest Chart

Introduction to eV.Manager The eValid E-Commerce Test Tool also comes with a companion, called eV.Manager. eV.Manager is a test suite manager specifically aimed at making it very easy and intuitive to handle suites of eValid tests. The target test suite size is ~1000 playback scripts. eV.Manager follows all eValid conventions but is a free- standing application that runs eValid scripts by calling eValid each time a script is to be played.

Quick Start in using the eV.Manager Create a new EVM file by selecting the Project directory containing your eValid script file(s) and save it You will be prompted to select the Project directory containing your eValid script files. The script files must be stored in the Project Name > Test Group hierarchy. Once a project directory has been selected, you will be prompted to select a directory to save the EVM file. The name of the EVM file will be identical to the project name, but with the.evm extension.

Quick Start in using the eV.Manager Add and remove tests by using a spreadsheet-like editor to add and remove eValid scripts from your test suite eV.Manager uses a spreadsheet-like editor to add and remove eValid scripts from your test suite. The editor is accessed from the pull down menu eV.Manager > View > EVM File Name of the script file to run if the test passes Name of the script file to run if the test fails

Quick Start in using the eV.Manager eV.Manager uses a spreadsheet-like editor to add and remove eValid scripts from your test suite. The editor is accessed from the pull down menu eV.Manager > View > EVM File SwitchExplanation -Run numberRun Number Specification. Runs the currently selected test suite [specified in the default EVM] the specified number of times. -QeV.Manager Run Termination Option. Instructs eV.Manager to quit after all of the specified tests have been run. Requires use of the -run switch.

Quick Start in using the eV.Manager At a time you can select different types of script files such that for Applet testing, Benchmark Testing etc. Select the tests to Run in your test suite After selecting the tests, those can be run either once or even multiple number of times View the EVM file and other eV.Manager files to see what eV.Manager has reported as Test Output and Test Results

Validation Unique feature in eValid A test validation function is a way of stating (and recording) what is expected to be true at playback time, based on what is seen at record time. Complete list at mentation.5/Testing/validation.html

Validating Text Click on Record to start recording Select the text that you want to validate Click on Record > Validate > Selected > Text Click stop recording On playback the validation will take place

Validating Text

Live Demos Presentations and live demos by eValid. ng.5/Tutorials