1. Auto-test Tools: Sahi and Rational Robot Ting Yu Xia Liu University of Ottawa

2. Outline Introduction Introduction Business case Business case Evaluation criteria Evaluation criteria Evaluation Evaluation Conclusion Conclusion

3. Introduction What is What is Test Automation? –The use software to the execution of tests –The use software to control the execution of tests –the comparison of actual outcomes to predicted outcomes Advantages of Test Automation Advantages of Test Automation –Reduce test time as well as cost

4. Business Case Company: heyhey.inc set up in 2002 Company: heyhey.inc set up in 2002 - Mainly provide web development services, also web enabled database application built in Oracle and Java - Staffs: project manager, 2 technical team leaders, 14 developers Look for some automation testing tool: Look for some automation testing tool: - Rational Robot (IBM) -Sahi (Sahi)

5. General introduction of two tools Sahi Sahi A free web-functional auto testing tool A free web-functional auto testing tool which can recognize most HTML patterns which can recognize most HTML patterns Rational robot Rational robot Commercial functional auto testing tool, develop by the IBM, much powerful and easy for beginners Commercial functional auto testing tool, develop by the IBM, much powerful and easy for beginners

6. Evaluation Criteria High-impact criteria High-impact criteria –Record and Playback –Web testing Impact criteria Impact criteria –Cost –Technical Support Low-impact criteria Low-impact criteria –Environment support –Ease of use

7. Evaluation: Record and Playback Rational robot Rational robot 1) Record: click the red GUI button in the robot main window

8. 2) create new record script 3) set the record type and application direction 4) make a functional test: set verification point 5) stop the recording 6) modify the test script 7) play back the script: click playback script button on the robot tools bar on the robot tools bar 8) choose the playback script

9. Sahi Sahi

11. Script compare Script compare example example

14. Error report Sahi -- Change the click button item Searcher"

15. Log

16. Rational Rational -compare data with base line -compare data with base line

17. Evaluation: web test Rational robot Rational robot HTML link for performing a click on a web link HTML link for performing a click on a web link HTML ActiveX, table and other common element HTML ActiveX, table and other common element HTML Image for clicking an image in a web page HTML Image for clicking an image in a web page HTML Document for positioning the cursor in web pages HTML Document for positioning the cursor in web pages Website Verification point allows you to check for broken links and set link baseline Website Verification point allows you to check for broken links and set link baseline

18. Sahi Sahi HTML link for performing a click on a text link HTML link for performing a click on a text link HTML Image for clicking an image in a web page HTML Image for clicking an image in a web page Common HTML element Table, single line text area, scrolling text area check box Common HTML element Table, single line text area, scrolling text area check box

19. Evaluation: environment support Rational robot Rational robot windows, windows, IE/Firefox, IE/Firefox, HTML, DHTML, HTML, java Visual Basic, Visual C++, HTML, DHTML, HTML, java Visual Basic, Visual C++, Oracle Developer/2000, Delphi, Oracle Developer/2000, Delphi, SAP, PeopleSoft and Sybase PowerBuilder SAP, PeopleSoft and Sybase PowerBuilder Sahi Sahi Windows / Linux; Windows / Linux; IE/Firefox; IE/Firefox; HTML, Delphi, java, HTML, Delphi, java, AJAX and dynamic applications AJAX and dynamic applications

20. Evaluation: cost Rational robot Rational robot Temperature license: download free 7 days Temperature license: download free 7 days Commercial license: about 12000 dollars for one year Commercial license: about 12000 dollars for one year Sahi Sahi Free to use, paid technical support Free to use, paid technical support

21. Evaluation: ease of use Rational robot Rational robot The rational robot is easy to learn. The record and playback, log files, Test Result, verification points and debugging is very simple for the beginner The rational robot is easy to learn. The record and playback, log files, Test Result, verification points and debugging is very simple for the beginner Sahi Sahi Friendly layout, easy to use Friendly layout, easy to use

22. Evaluation: Support Rational robot Rational robot There are lots of documents, demos to help you to install and play with the robot. There are lots of documents, demos to help you to install and play with the robot. http://www- 306.ibm.com/software/awdtools/tester/robot/support/index.html http://www- 306.ibm.com/software/awdtools/tester/robot/support/index.html http://www- 306.ibm.com/software/awdtools/tester/robot/support/index.html http://www- 306.ibm.com/software/awdtools/tester/robot/support/index.html Sahi Sahi Only limited online resource available, no use manual Only limited online resource available, no use manual Only one demo on Sahi website Only one demo on Sahi website there is paid technical support provided there is paid technical support provided

23. Conclusion For each evaluation, we give a range 1-10 For each evaluation, we give a range 1-10 10-Excellent, 9-Superb, 8-Very Good, 7-Good, 6-Above Average, 5-Average, 4-Below Average, 3-Poor, 2-Bad, 1- Horrible Weight Weight –1.2: high-impact –1.0: impact –0.8: low-impact

24. Record and Playback Web testing CostTechnical Support Environment support Ease of use Rational robot 885887 Sahi 669667 Rational robot: 8*1.2+8*1.2+5*1+8*1+8*0.8+7*0.8=44.2 Sahi: 6*1.2+6*1.2+9*1+6*1+6*0.8+7*0.8=39.8 We advice to choose the rational robot!

25. Any questions? Thanks!