Auto-test Tools: Sahi and Rational Robot Ting Yu Xia Liu University of Ottawa

Outline Introduction Introduction Business case Business case Evaluation criteria Evaluation criteria Evaluation Evaluation Conclusion Conclusion

Introduction What is What is Test Automation? –The use software to the execution of tests –The use software to control the execution of tests –the comparison of actual outcomes to predicted outcomes Advantages of Test Automation Advantages of Test Automation –Reduce test time as well as cost

Business Case Company: heyhey.inc set up in 2002 Company: heyhey.inc set up in Mainly provide web development services, also web enabled database application built in Oracle and Java - Staffs: project manager, 2 technical team leaders, 14 developers Look for some automation testing tool: Look for some automation testing tool: - Rational Robot (IBM) -Sahi (Sahi)

General introduction of two tools Sahi Sahi A free web-functional auto testing tool A free web-functional auto testing tool which can recognize most HTML patterns which can recognize most HTML patterns Rational robot Rational robot Commercial functional auto testing tool, develop by the IBM, much powerful and easy for beginners Commercial functional auto testing tool, develop by the IBM, much powerful and easy for beginners

Evaluation Criteria High-impact criteria High-impact criteria –Record and Playback –Web testing Impact criteria Impact criteria –Cost –Technical Support Low-impact criteria Low-impact criteria –Environment support –Ease of use

Evaluation: Record and Playback Rational robot Rational robot 1) Record: click the red GUI button in the robot main window

2) create new record script 3) set the record type and application direction 4) make a functional test: set verification point 5) stop the recording 6) modify the test script 7) play back the script: click playback script button on the robot tools bar on the robot tools bar 8) choose the playback script

Sahi Sahi

Script compare Script compare example example

Error report Sahi -- Change the click button item Searcher"

Log

Rational Rational -compare data with base line -compare data with base line

Evaluation: web test Rational robot Rational robot HTML link for performing a click on a web link HTML link for performing a click on a web link HTML ActiveX, table and other common element HTML ActiveX, table and other common element HTML Image for clicking an image in a web page HTML Image for clicking an image in a web page HTML Document for positioning the cursor in web pages HTML Document for positioning the cursor in web pages Website Verification point allows you to check for broken links and set link baseline Website Verification point allows you to check for broken links and set link baseline

Sahi Sahi HTML link for performing a click on a text link HTML link for performing a click on a text link HTML Image for clicking an image in a web page HTML Image for clicking an image in a web page Common HTML element Table, single line text area, scrolling text area check box Common HTML element Table, single line text area, scrolling text area check box

Evaluation: environment support Rational robot Rational robot windows, windows, IE/Firefox, IE/Firefox, HTML, DHTML, HTML, java Visual Basic, Visual C++, HTML, DHTML, HTML, java Visual Basic, Visual C++, Oracle Developer/2000, Delphi, Oracle Developer/2000, Delphi, SAP, PeopleSoft and Sybase PowerBuilder SAP, PeopleSoft and Sybase PowerBuilder Sahi Sahi Windows / Linux; Windows / Linux; IE/Firefox; IE/Firefox; HTML, Delphi, java, HTML, Delphi, java, AJAX and dynamic applications AJAX and dynamic applications

Evaluation: cost Rational robot Rational robot Temperature license: download free 7 days Temperature license: download free 7 days Commercial license: about dollars for one year Commercial license: about dollars for one year Sahi Sahi Free to use, paid technical support Free to use, paid technical support

Evaluation: ease of use Rational robot Rational robot The rational robot is easy to learn. The record and playback, log files, Test Result, verification points and debugging is very simple for the beginner The rational robot is easy to learn. The record and playback, log files, Test Result, verification points and debugging is very simple for the beginner Sahi Sahi Friendly layout, easy to use Friendly layout, easy to use

Evaluation: Support Rational robot Rational robot There are lots of documents, demos to help you to install and play with the robot. There are lots of documents, demos to help you to install and play with the robot ibm.com/software/awdtools/tester/robot/support/index.html ibm.com/software/awdtools/tester/robot/support/index.html ibm.com/software/awdtools/tester/robot/support/index.html ibm.com/software/awdtools/tester/robot/support/index.html Sahi Sahi Only limited online resource available, no use manual Only limited online resource available, no use manual Only one demo on Sahi website Only one demo on Sahi website there is paid technical support provided there is paid technical support provided

Conclusion For each evaluation, we give a range 1-10 For each evaluation, we give a range Excellent, 9-Superb, 8-Very Good, 7-Good, 6-Above Average, 5-Average, 4-Below Average, 3-Poor, 2-Bad, 1- Horrible Weight Weight –1.2: high-impact –1.0: impact –0.8: low-impact

Record and Playback Web testing CostTechnical Support Environment support Ease of use Rational robot Sahi Rational robot: 8*1.2+8*1.2+5*1+8*1+8*0.8+7*0.8=44.2 Sahi: 6*1.2+6*1.2+9*1+6*1+6*0.8+7*0.8=39.8 We advice to choose the rational robot!

Any questions? Thanks!