IBM Software Group | Rational software 2 Agenda Rational Performance Tester Overview Demonstration
IBM Software Group | Rational software 3 The SWEAT Method Mission Impossible: Test a Gazillion Users We only have to prove that it works for 20,000 users! And just HOW are we supposed to do that?
IBM Software Group | Rational software 4 The SWEAT Method for Performance Testing Steps Workload Equipment Analysis Tools Five Essentials of Loadtesting: Help! What have I gotten myself into?
IBM Software Group | Rational software 5 Steps in the Process 1.Identify Testing Goals 2.Define the Workload Model 3.Build the Lab Environment 4.Build and Test the Workload 5.Analyze and Tune the System 6.Measure and Report the Results Many important steps need to be taken “It’s hard work!”
IBM Software Group | Rational software 6 Identify Testing Goals Performance tests are designed to answer specific questions Identify the key stakeholders for the test and its results Work with the stakeholders to explicitly list the questions Gain agreement on goals before scoping and planning the test Negotiate project scope against the cost of the test Write it down: testing goals, project artifacts, and criteria for project completion
IBM Software Group | Rational software 7 Workload (Model) Document the test goals Elaborate the user scenarios List any specific emulated user characteristics such as think time Identify input data variation needed to defeat optimistic server caching Determine transaction rates during peak load (per user and aggregate) Identify key measurement points Sometimes it feels like… a hard hat zone
IBM Software Group | Rational software 8 Workload Definition Approach #1 – User Groups Define each type of user in a workload and what they do Concentrate on a “busy hour” definition with an analyst who knows the customer’s work flow Transactions / Busy Hour (# in group)Telesales (1500) Cust Svc (200) Managers (50) Enter new customer data Take a customer order Check status on a customer order Provide return # for a customer order Adjust quantities on customer order020050
IBM Software Group | Rational software 9 Workload Definition Approach #2 –Transaction Rates Get a monitored workload log from the customer’s production environment Make sure you can isolate a peak workload period and separate out the transaction rates during that time Transactions / Busy Hour * daily batch reports running 10 AM Peak Noon Rush 3 PM Peak* Enter new customer data Take a customer order Check status on a customer order Provide RMA for a customer order Adjust quantities on customer order
IBM Software Group | Rational software 10 Equipment Use a powerful workstation for your console (2GB main memory) Use an array of identical servers as driver systems (Blade Center) Plan on 10-20% spare driver capacity Provide adequate network bandwidth between drivers and system under test A maze of twisty little passages…
IBM Software Group | Rational software 11 What about Driver Sizing for RPT Test Agent Equipment Sizing -- General Guidelines Dual processor systems (or better) where possible > 2 GB main memory where possible May get better performance running two engines on one agent box Beware of running out of CPU before memory Treat Windows and Linux as equivalent for sizing Hot AIX (JS21) boxes could be the most scalable As always, mileage may vary especially if you accelerate “per user” rates Server HardwareCPU SpeedMain MemoryCapacity xSeries 330 (2 CPUs)800 MHz (PIII)1 GB memory 800 VTs xSeries 346 (2 CPUs)3.4 GHz DualCore3.2 GB memory1500 VTs AIX JS21 (2 CPUs)2.7 GHz (64-bit)16 GB memory2500 VTs
IBM Software Group | Rational software 12 Analysis – Gain Access to the Right Expertise Arrange for a Subject Matter Expert familiar with tuning WebSphere and any back-end databases involved Set up system resource and network monitoring Set up server logging with transaction timing enabled Tune the subsystems first before trying to do a full capacity load test The value of IBM Services
IBM Software Group | Rational software 13 Monitoring and Analyzing the Test Results Make sure driver system run with <70% CPU utilization once in steady state to ensure valid response time data Monitor CPU, memory, and I/O statistics on systems under test Look for hot spots from a resource usage perspective Tune multi-tiered and clustered systems on a subsystem basis first before looking at overall system performance Evaluate system performance from an architectural perspective Login authentication servers Front-end web servers Web application servers Database servers
IBM Software Group | Rational software 14 Rational Performance Tester v7.0 – The tool of choice Visual test representation Fully adaptable test execution without running wizards Zero programming required for input data variation Custom Java code environment for enhanced functionality Highly scalable architecture with multiple agents Customizable reports of real-time performance measurements System monitoring and application breakdown data available Support for statistical analysis for the steady state interval Full support for all major packaged ERP applications
IBM Software Group | Rational software 15 Rational Performance Tester New in v7 Benefits Simplifies process for problem diagnosis by easily identifying performance bottlenecks in underlying application code Simplify reports for faster interpretation and analysis Root Cause Analysis Integrated IPOT Functionality Agentless remote monitoring Enhanced reporting Resource Overlay New Environment Support Firefox mySAP (SAP HTTP Interface) Client Side Digital Certificates Expands the breadth of environments in which Performance Tester can be used Execution within a Citrix environment Enable remotely distributed resources to participate in functional testing process Adoption of Process Advisor Provide guidance and expertise to enhance tool experience
IBM Software Group | Rational software 16 Rational Performance Tester New in v7 Benefits Remove various objections and barriers to adoption for new users Collectively improve overall tool experience for both new and experienced users Various enhancements Time based reporting Schedule cut/copy/paste Added Test Save As… Simplified IP Aliasing, Std Deviation, Test Stop Startup and Scalability enhancements
IBM Software Group | Rational software 17 Solution: Root Cause Analysis Benefits: Ability to perform detailed analysis and breakdown of J2EE transactions when a system is under load. Helps testing teams to pinpoint the component responsible for the bottleneck. For IT organizations that use Tivoli ITCAM solutions, detailed performance data can be delivered directly to the developers desktop to help the developer pinpoint the source code causing the bottleneck. Key Features: Problem Analysis Tools Response Time Breakdown Agentless Resource Monitoring Resource Overlays with Response Times IBM Tivoli Monitoring Collectors Additions New! IBM Rational Performance Tester decomposes poor response times identified during a performance test… …into the amount of time spent within each application component.
IBM Software Group | Rational software 18 Challenge: Provide test automation support for mission critical enterprise resource planning applications New in this release: Functional Tester SAP 6.2 and 6.4 support Siebel 7.8 support Performance Tester mySAP support (SAP HTTP interface) Partner BSD offering for Oracle eBusiness Suite Provides a comprehensive solution for all key ERP solutions New! Existing foundation Functional Tester Siebel 7.7 support Performance Tester Siebel and SAP support PeopleSoft support implicit with RFT and RPT support for HTML/HTTP environments Packaged Application Support
IBM Software Group | Rational software 19 Root Cause Analysis Root Cause Analysis is a collection of features which provide the user with information to diagnose the cause of their performance problems Root Cause Analysis collectively refers to the following functionality Problem Analysis Tools Technology formerly bundled as the IBM Performance Optimization Toolkit Response Time Breakdown Agentless Resource Monitoring Report Data Overlay Report Filtering by Time
IBM Software Group | Rational software 20 Problem Analysis Tools Feature: Response Time Breakdown provides response time information at J2EE method level for applications running on Weblogic or WebSphere Benefit: Normal performance testing identifies performance delays, response time breakdown provides information to diagnose the cause of a performance delay On schedule, specify tests for which to capture additional data
IBM Software Group | Rational software 21 Response Time Breakdown Feature: Breakdown page response times into composite element response time Benefit: Performance report identifies slow performing page. Breakdown data drills down to highlight slowest elements of a given page. Break page response time down into response time for individual page elements
IBM Software Group | Rational software 22 Response Time Breakdown Feature: Breakdown page response times into composite element response time Benefit: Performance report identifies slow performing page. Breakdown data drills down to highlight slowest elements of a given page.
IBM Software Group | Rational software 23 Agentless Resource Monitoring Feature During a performance test run, RPT can capture resource monitoring information from IBM Tivoli Monitoring UNIX rstatd monitor Windows Performance Monitor Does not require any installation on any tier of the application Benefit Provides additional data during results analysis to identify root cause of performance problems
IBM Software Group | Rational software 24 Performance & Resource Statistic Report Overlay Data from different graphs can easily be consolidated on to one graph. Includes resource monitoring data
IBM Software Group | Rational software 25 Report Filtering by Time Range Feature: Filter results on any report to focus on a given time range Benefit: For long runs, enables focused analysis on subset of data most interesting to customer
IBM Software Group | Rational software 26 Standard Deviation Statistic Reporting Feature Standard Deviation statistic can be added to reports Benefit Provides an indication of how representative average response time is for a page The higher the standard deviation, the further the typical individual virtual tester response time is from the average
IBM Software Group | Rational software 27 Automated Firefox and Mozilla Support Feature RPT will now automatically launch and configure Firefox and Mozilla browsers Previously RPT could only launch and configure Internet Explorer Benefit Users are no longer required to manually launch and configure Mozilla and Firefox browsers Saves time and avoids confusion and errors of setting and resetting proxy configuration for Firefox and Mozilla
IBM Software Group | Rational software 28 Client Side Digital Certificates Feature: New support for applications using Client Side Digital Certificates Benefit: Expands the breadth of environments supported by RPT
IBM Software Group | Rational software 29 IP Aliasing Feature Enable individual Virtual Testers to send and receive data from individual IP addresses instead of using one IP address for all virtual testers Feature released in previous iFix, though only in Caspian is IP aliasing configurable through GUI Benefit Provides a more realistic workload Avoids problems where load balancers examine IP address as part of load balancing algorithm
IBM Software Group | Rational software 30 SAP Enhancements SAP Enhancements Visual Design Support Visual Design is a feature of SAPGUI which allow the customer to modify the colors & fonts of SAPGUI. In v 6.1.2, user customized visual design is ignored; the SAPGUI is always grey. In v7.0.0, record uses visual design as specified. Playback uses grey design. SAP HTTP Interface now supported SAP 4.6, 4.7 and 5.0 offer an HTTP interface to SAP. RPT supports HTTP testing for this interface
IBM Software Group | Rational software 31 SAP Enhancements SAP Enhancements Insert a recording at a selected point in a test suite. During editing, you can play back a test to a certain point, then launch the recorder to add additional steps to a test. You can use test elements such as loops, conditions and transactions anywhere in a test. For more information, see the help topic "Adding elements to an SAP test." Verification points are enhanced. You can capture any property of a SAP GUI object and optionally check it against an expected value. Previously VPs could not be applied to all objects. Content verification points now support expected and unexpected results. Documented process to replace a host name in a test. See the help topic "Reusing tests on different hosts."
IBM Software Group | Rational software 32 Performance Tester Migration Migration: Tests are automatically upgraded upon first access by version 7.0 client Note: Upgraded tests are not usable by 6.x clients Version 6.x assets can be opened by 7.0 clients with no updates, but new features are not fully available
IBM Software Group | Rational software 33 Partner BSD Group : Oracle Applications 11i Support Oracle 11i Applications Performance Testing and Monitoring BSD agreement with Oracle to use proprietary NCA protocol Integrated with Rational Performance Tester and Tivoli ITCAM RTT RPT Base Price Includes 500 BSD VTs and 1 st year maintenance. Customer must purchase both Rational VTs and BSD VTs Approximate 50% of Mercury Pricing ITCAM Base Price Includes 1 st year maintenance and 2 floating licenses (1 per RTT processor license) BSD Contacts for additional information Mills Ripley: Mills Robb Ralston: Robb