1. 1 © ALP International CorporationMarch 2001 MD-CFUG Automating your Website Testing By Andrew L. Pollner and Lei Wang ALP International Corporation

2. 2 © ALP International CorporationMarch 2001 MD-CFUG Why Load Test? u To Simulate Multiple Users on a System u To Measure end-to-end performance u To Measure Server Performance: –Database (Oracle) –Application (CF) –Middleware (Web Logic) –Web (Netscape)

3. 3 © ALP International CorporationMarch 2001 MD-CFUG When Should Loadtesting Occur? u When sizing a server u After Application Has Stabilized u When other users are not on the system u After notifying Sys Admin.s, DBA’s, Test Managers

4. 4 © ALP International CorporationMarch 2001 MD-CFUG What’s Needed for Loadtesting? Knowledge of: u Application u Database u Environment u LoadRunner!

5. 5 © ALP International CorporationMarch 2001 MD-CFUG Loadtesting Concepts - Part I u Transaction u Rendezvous Measured event (i.e. Time it takes to return data to a screen after a QUERY button is pressed) Synchronized point where transaction is to occur simultaneously

6. 6 © ALP International CorporationMarch 2001 MD-CFUG Loadtesting Concepts - Part II u Vuser u Sgroup u Scenario A defined user type which executes a specific test A group of Vusers which with a characteristic profile A combination of sgroups

7. 7 © ALP International CorporationMarch 2001 MD-CFUG Types of Vusers u Web u C/S GUI u Terminal Emulation u SQL

8. 8 © ALP International CorporationMarch 2001 MD-CFUG Using LoadRunner - Web u Record HTTP Script u Generalize trace u Add Transaction points: –start_transaction(“ClaimWriteback”) –end_transaction(“ClaimWriteback”, PASS) u Add Rendezvous: –rendezvous(“Login”) rendezvous(“ClaimWriteback”)

9. 9 © ALP International CorporationMarch 2001 MD-CFUG Login Enter Data Save Data Login Enter Data Save Data Login Enter Data Save Data Rendevouz 1 ==> Rendevouz 2 ==> Rendevouz 3 ==> Start Synchronization

10. 10 © ALP International CorporationMarch 2001 MD-CFUG Login Enter Data Save Data Login Enter Data Save Data Login Enter Data Save Data Rendevouz 1 ==> Rendevouz 2 ==> Rendevouz 3 ==> Step Synchronization

11. 11 © ALP International CorporationMarch 2001 MD-CFUG Using LoadRunner - DB u Get SQL trace u Generalize SQL trace u Add Transaction points: –start_transaction(“ClaimWriteback”) –end_transaction(“ClaimWriteback”, PASS) u Add Rendezvous: –rendezvous(“Login”) rendezvous(“ClaimWriteback”)

12. 12 © ALP International CorporationMarch 2001 MD-CFUG Product Categories u GUI/Web vusers –Netscape Browser –IE Browser –Client Server u RTE vusers –Terminal Emulation u SQL (dB) vusers –Client Server

13. 13 © ALP International CorporationMarch 2001 MD-CFUG LoadRunner Family of Products u Both Client AND Server Load Testing u Wide range of platforms –Win 2000 –NT –Win95/98 –UNIX u Reporting –Automatically for each user –By transaction

14. 14 © ALP International CorporationMarch 2001 MD-CFUG u Single point of control: Controller Client AND Server Load Testing Testing the Site WAN/ Internet SYBASE SERVER NT SQL SERVER

15. 15 © ALP International CorporationMarch 2001 MD-CFUG u Single point of control: Controller u Drive multiple real NT GUI clients :End-to-End Client AND Server Load Testing Testing the Site SYBASE SERVER NT SQL SERVER WAN/ Internet

16. 16 © ALP International CorporationMarch 2001 MD-CFUG u Single point of control: Controller u Drive multiple real NT GUI clients : End-to-End u Stress SQL Server with multiple virtual NT clients Client AND Server Load Testing Testing the Site SYBASE SERVER NT SQL SERVER WAN/ Internet

17. 17 © ALP International CorporationMarch 2001 MD-CFUG u Single point of control u Drive multiple real clients u Stress SQL Server virtual clients NT u Stress Sybase: virtual clients NT/UNIX Client AND Server Load Testing Testing the Enterprise SYBASE SERVER NT/UNIX NT WAN/ Internet

18. 18 © ALP International CorporationMarch 2001 MD-CFUG Advanced Loadtest Measurement u Mean vs. Median u 90% Percentile u Performance under load u System Performance Measurement –CPU –SWAP –DISK

19. 19 © ALP International CorporationMarch 2001 MD-CFUG Analyzing Loadtest Results - I CLIENTLANWAN GUI Application Protocol SQL Server Total System Performance: Client, LAN, SQL Server, WAN, Sybase Sybase SERVER Client Load

20. 20 © ALP International CorporationMarch 2001 MD-CFUG Transaction Performance: LAN, SQL Server, WAN & Sybase Analyzing Loadtest Results - II CLIENTLANWAN GUI Application Protocol SQL Server Sybase SERVER Client Load Server Load

21. 21 © ALP International CorporationMarch 2001 MD-CFUG Analyzing Loadtest Results - III CLIENTLANWAN GUI Application Protocol SQL Server Transaction Performance: WAN, Sybase Sybase SERVER Client Load Server Load

22. 22 © ALP International CorporationMarch 2001 MD-CFUG Analyzing Loadtest Results - IV CLIENTLANWAN GUI Application Protocol SQL Server Sybase SERVER Transaction Performance: SYBASE Client Load Server Load

23. 23 © ALP International CorporationMarch 2001 MD-CFUG Analyzing Loadtest Results - V CLIENTLANWAN GUI Application Protocol SQL Server Sybase SERVER Client Load Server Load Transaction Response Time: Client Transaction Response Time: LAN, SQL Server

24. 24 © ALP International CorporationMarch 2001 MD-CFUG Conclusions Loadtesting: u Is a necessary component in testing an application and its environment u Has multiple purposes u Comes in many flavors u Is an extension to Functional testing u Is complex!

25. 25 © ALP International CorporationMarch 2001 MD-CFUG DEMO!

26. 26 © ALP International CorporationMarch 2001 MD-CFUG Virtual User Generator

27. 27 © ALP International CorporationMarch 2001 MD-CFUG LoadRunner Controller

28. 28 © ALP International CorporationMarch 2001 MD-CFUG Controller Vusers

29. 29 © ALP International CorporationMarch 2001 MD-CFUG Vuser Protocol

30. 30 © ALP International CorporationMarch 2001 MD-CFUG Transaction Report

31. 31 © ALP International CorporationMarch 2001 MD-CFUG Page Faults Graph

32. 32 © ALP International CorporationMarch 2001 MD-CFUG On-line Monitors

33. 33 © ALP International CorporationMarch 2001 MD-CFUG Q&A