Professional Services Performance Testing Center of Excellence Application Performance Management Solution Information Technology Services Click to Advance Presentation Mute sound if necessary (sound icon)

Todays Challenges Business lines rarely share information on tool research, usage, testing practices, and cost containment. Software Development Life Cycle models frequently compromise testing initiatives to meet deliverable deadlines. Performance Testing Practices vary in most projects. Knowledge Transfer – performance testing information leaves with consultants. Performance Tools are expensive, and very complex to integrate. No global approach to Performance Testing tools, techniques, or costs. Expensive consultants are frequently hired for Performance Testing Many projects cannot afford to make long term commitments to Performance testing. Decentralized approach to building and testing software. 2

Industry Trends Application owners often ask the following: Does my application scale to meet business goals? 75% of ERP systems fail to do so (Gartner) Does my application scale to meet business goals? 70% of performance problems can be resolved by configuration changes (survey of 3,000 HP/Mercury engagements) Can I resolve application bottlenecks? 40% of app bottlenecks are first noticed by a customer or executive (Mercury Survey) $2B + spent in app server overcapacity from 2001 to 2003 (Gartner) Have I overspent on infrastructure? 3

One Platform Solution T3 works to empower Business, Quality Assurance, and Development teams to deliver better software by centralizing all aspects of testing and performance management. Become Performance center of excellence Centralize performance testing and monitoring tools Global Performance testing execution capability Focus on quick cost savings wins! Reduce dependency on expensive consultancy QUICK START- Bring automation in quickly that addresses an immediate need. Reduce infrastructure support for testing Take a value approach and network it Forge alliances & partnerships Leverage vendor Purchasing Power Bringing the pieces together 4

Performance Approach Phase-driven approach to Performance Optimization Phase 1: Plan Fully Plan the project Organize the Team Determine the business goals Define the business process Inventory HW, SW and network Identify key participants Mobilize test team Create test plan Agree execution schedule Phase 2: Baseline Quantify the System Performance Create test cases Deploy monitoring agents Run initial test plan Document the baseline profile Compare baseline with target Phase 3: Optimize Iteratively Isolate and Reduce Bottlenecks Emulate production load Monitor system performance Identify problem areas Analyze root cause Determine resolution Apply modification Assess the Performance Improvements and Report Phase 4: Report Document improved throughput Increased capacity reduced error rate greater stability better user response time Compare with baseline and target Produce findings/recommendations Retain data for future comparison 5

Why HP/Mercury 1.Proven Leadership 2.Market Visionaries 3.Strategic Alliance Worldwide Performance Testing Market Share Source Newport Group, Inc © 2004 Empirix 4% Compuware 4% Other 9% Segue 2% Rational 9% RadView 1% HP/Mercury 71% 6

Automated Performance Testing Web ServerApp. ServerDatabase Internet/ WAN Controller User Simulation PERFORMANCE MONITORS Replaces real users with thousands of virtual users Generates consistent, measurable, and repeatable load, managed from a single point of control Efficiently isolates performance bottlenecks across all tiers/layers with automated reporting and analyses 7

Types of Performance Testing 1.Stress Testing 2.Capacity Planning 3.Throughput Improvement 4.Server Consolidation 5.Baseline Assessment 6.New Version Impact Analysis 7.Ensure Business Performance 8

Application Monitoring Application Server Web Servers Database Server Router Load Balancer Firewall ISP 98% of sites experience critical performance problems –Typical applications encounter problems at 15% of design capacity Problems occur both inside & outside firewall –25% - network and bandwidth related –23% - application server related –20% - load balancers, web server or proxy server issues Source: Mercury Interactive hosted services Application Management monitors the entire infrastructure from the users perspective! 9

A Day In the Life… Daily Challenges 07:17AMTicket opened 07:05AMProblem detected - data center serving e-Bank customers is down 07:31AMBridge-line opened - 8 people 11:48AM4 more people paged, DBA joins line 04:05PMRoot cause identified: mis-configured connection pooling caused DB crash at peak traffic. At least 800 customers affected, business impact unknown 04:20PMIT representative sent to client impact assessment meeting 08:03AMCheck UNIX issue, escalate to hardware vendor 08:06AMBusiness urgency discussed, not well understood 10:51AMHardware is ok, Informix DB appears down 10:20AMSecurity clearance delays hardware vendor from entering data center 10

Diagnose Root Cause Define SLAs Business Console Customer Impact SLM Event Viewer Tier 2Top View BUSINESS AVAILABILITY CENTER Tier 1Tier 3 RESOLUTION CENTER 11

Application Management Dashboard Define SLAs Business Console Customer Impact SLM Event Viewer Tier 1Tier 2Tier 3Top View BUSINESS AVAILABILITY CENTERRESOLUTION CENTER 12

Appendix Supplemental Information 13

Introducing LoadRunner Our Center of Excellence approach uses Mercury Interactive LoadRunner product to deliver an integrated solution for business technology optimization. Network bandwidth Routers Switches Hosting equipment Load balancers Application servers Databases Middleware Back office Firewalls IDS systems DDoS systems Gateways Web servers Cache servers LAN / WAN Client Systems Legacy system.NET services Sun ONE services SecurityInfrastructureApplication Load Runner SystemMonitor Automated Scripts Data Repository It provides an end-to-end tool set for performance tuning a user simulation module to create business transaction load a system monitoring module to display infrastructure behavior and application errors a set of automated scripts that identifies modifications a data repository for future comparisons 14

Powering the CoE Application Delivery Foundation Application Monitoring Business Availability Center Resolution Center Application Delivery Console Virtual Users ProtocolsMonitors PERFORMANCE CoE Global Management Multi-project Management Resource Management Diagnostics TuningLoadRunner Capacity Planning 15

LoadRunner Coverage RecommendationResolution Problem Identification MonitoringUser Simulation Infrastructure (e.g. Linux, Solaris, Windows) Vendor Product (e.g. Oracle, Websphere) Performance Tuning Steps Tunable Components LoadRunner Capabilities in Optimization Exercise In-house Apps method level for J2EE apps program level for other types * J2EE source code line-level identification available using OptiBench add-on. 16

LoadRunner Overview Web ServerApp. ServerDatabase Internet/ Intranet USER SIMULATION PROTOCOLS Clients PERFORMANCE MONITORS SAP Oracle Siebel PeopleSoft ERP/CRM HTTP(S) XML Citrix ICA SOAP WAP Web EJBs CORBA COM RMI MQSeries VT100 Oracle MS SQLServer DB2 ODBC MiddlewareLegacyDatabases Operating Systems Network Web Servers App Servers JavaDatabases Windows Unix Linux SNMP WAN Emulation MS IIS iPlanet Apache EJB JDBC JSP Sitraka JMonitor Oracle MSSQL Server DB2 BEA WebLogic IBM WebSphere ATG Dynamo iPlanet App Server 17

LoadRunner Deployment Application Tier Applications Application Servers Infrastructure Tier Fire wall Web Servers Load Balancer Fire wall Database Tier Database Servers Storage Distributed System App & System Monitoring Measure Performance Identify Constraints Apply Modification ~~~ Stress Simulation Telecomm Fabric Infrastructure Consumption CPU28 CPUs Memor y 2,560MB Disk I/O70% Networ k 80% System Capacity User count100 Tranx rate100/mi n User Experienc e Response time 10 sec Error rate10 % Automated & Manual Tuning Apply Tuning Process Gather Metrics Step 1 1.Define business process 2.Capture user behavior 3.Create simulation profile 4.Apply controlled load Step 2 Step 4 Sample Recommendations WebLogic- misconfigured Java VM heap size Database- missing indexes, full table scan... Step 3 Environmen t under User Load Typical Statistics 18

Metrics Databases Oracle Total file opens Enqueue deadlocks Enqueue waits Opened cursors current SQL*Net roundtrips to/from client Plus 164 other counters Sybase Disk Reads Memory Disk Writes Disk Waits Locks count % Hits % Processor Time (process) % Plus 49 other counters Microsoft SQL Server SQL Re-Compilations/Sec I/O - Outstanding Reads Lock Wait Time (ms) Total Latch Wait Time (ms) SQL Re-Compilations/Sec Plus 38 other counters DB2 Local_con_exec Total_sorts Plus 174 other counters App. Servers IBM WebSphere ThreadCreates ActiveThreads ConnectionPoolSize SessionsActive Plus 82 other counters BEA WebLogic HeapSizeCurrent ActiveConnectionsCurrentCount WaitingForConnectionCurrentCount Plus 118 other counters Iplanet Application Server nasKesEngAutoStart nasEngSYBPreparedQueryTotal nasEngThreadWait Plus 118 other counters Microsoft Active Server Pages Requests Executing Requests Queued Request Bytes Out Total Requests/Sec Transactions Aborted Transactions Pending Oracle 9iAS HTTP Server Allaire ColdFusion SilverStream Ariba ATG Dynamo Microsoft COM+ Monitor BroadVision Web Servers Apache #Busy Servers #Idle Servers CPU Usage Hits/Sec KBytes Sent/Sec MS IIS Connection Attempts/Sec Files Received/Sec Logon Attempts/Sec Total Files Transferred Plus 50 other counters Iplanet (Netscape) Bad requests/Sec Bytes Sent/Sec Hits/Sec Plus 11 other counters Other Software and Hardware Streaming Media Monitors Checkpoint Firewall Server ERP Performance Monitors Middleware Monitors Java Performance Monitors Citrix MetaFrame Monitors Network Delay Customized Counters Capability 19

The Tuning Process Apache Web Server 1.x/2.x BEA Weblogic 6.x/7.x IBM HTTP Server IBM Websphere Advanced 4.x IBM Websphere Single Server 4.x iPlanet Enterprise Server 6 & higher Microsoft IIS 4/5 Microsoft Active Server Pages 2/3 Oracle Database Oracle 9iAS PeopleSoft 8.x SAP Enterprise Portals 5 Siebel 7.x SQL Server 7.5/2000 Windows: NT, 2000 and XP UNIX: Solaris, HP, AIX and Linux LoadRunners tuning agent can be deployed to automatically recommend optimum settings for a wide range of industry-standard applications. IT specialists will manually optimize additional hardware and software based on LoadRunner performance metrics. 20

Benefits of Tuning Optimizes application and infrastructure performance Isolates and resolves performance bottlenecks Establishes optimized configuration settings for production 21

Benefits of LoadRunner Diagnostics Pinpoints application bottlenecks, e.g., J2EE to method/ SQL level Reduces time to resolution for application issues Integrated with Mercury LoadRunner combines end user response time with diagnostics 22

23 Visit Us Online Global Virtual Testing Capabilities For additional information contact: Click HereClick Here or copy/paste