Presentation is loading. Please wait.

Presentation is loading. Please wait.

Copyright © 2006 Quest Software Title slide Copyright: 8 pt. Arial Who Needs benchmarking…You Do! Mike Ault Domain Specialist, Oracle Quest Software.

Similar presentations


Presentation on theme: "Copyright © 2006 Quest Software Title slide Copyright: 8 pt. Arial Who Needs benchmarking…You Do! Mike Ault Domain Specialist, Oracle Quest Software."— Presentation transcript:

1 Copyright © 2006 Quest Software Title slide Copyright: 8 pt. Arial Who Needs benchmarking…You Do! Mike Ault Domain Specialist, Oracle Quest Software

2 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Michael R. Ault Oracle Domain Specialist - Nuclear Navy 6 years - Nuclear Chemist/Programmer 10 years - Kennedy Western University Graduate - Bachelors Degree Computer Science - Certified in all Oracle Versions Since 6 - Oracle DBA, author, 16 years

3 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Books by Michael R. Ault

4 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Who Needs benchmarking? You Do! Types of things that we need to predict when dealing with databases operating system memory needs operating system CPU needs operating system storage requirements. Growth

5 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black What Needs Analysis? The analysis may be simple: “When will this table run out of space” Or complex: “How many CPUs will be required to support this database when the data has increased by a factor of 20 in size and user load has been increased ten fold”.

6 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black How? We must be able to control two specific parts of the database environment: User load Transaction mix If you can not control the users or the transactions impacting the database then it becomes impossible to accurately predict the trends.

7 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black What is a Normal Load? if we are concerned with average loads and normal data growth then we must ensure that the transaction mix and user load when we do our measurements is “normal” if we don’t know what a normal load is our efforts will probably result in inaccurate forecasts based on biased trends.

8 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Use Standard Tools One way to completely control both the users and the transaction load is to utilize benchmarking tools.

9 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Types of Benchmarks AS3AP Scalable Hardware TPC-B TPC-C TPC-D TPC-H Home Grown Results from the “standard” benchmarks are posted to the www.tpc.org websitewww.tpc.org

10 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black AS3AP The AS3AP benchmark is a scalable, portable ANSI SQL relational database benchmark. This benchmark provides a comprehensive set of tests for database processing power; has a built-in scalability and portability that tests a broad range of systems; minimizes human effort in implementing and running benchmark tests; and provides a uniform metric straight- forward interpretation of benchmark results.

11 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Scaleable Hardware The Scaleable Hardware benchmark measures relational database systems. This benchmark is a subset of the AS3AP benchmark. This benchmark tests the following: CPU, disk, network, and combination of these three entities.

12 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-B The TPC-B benchmark stresses databases and is characterized by significant disk input/output, moderate system, application execution time, and transaction integrity. This benchmark targets database management systems (DBMS) batch applications, and back- end database servers. TPC-B is not an OLTP benchmark.

13 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-C TPC-C is an online transaction processing (OLTP) benchmark. TPC-C involves a mix of five concurrent transactions of different types and complexity executed either online or queried for deferred execution. The database is comprised of nine types of tables with a wide range of record and population sizes. TPC-C is measured in transactions per minute (tpmC.).

14 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-D The TPC-D benchmark represents a broad range of decision support (DS) applications that require complex, and long running queries against large complex data structures. Real- world business questions were written against this model, and resulted in 17 complex queries.

15 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H The TPC-H is a decision support benchmark. It consists of a suite of business oriented ad-hoc queries and concurrent data modifications.

16 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Home Grown You select the transactions You select the number of users Can be exact for your environment

17 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Tests and Databases Usually you see TPC-C and TPC-H TPC-C is OLTP, small transactions TPC-H is more decision support You must choose the right test for your system

18 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black An Example TPC-H Database Benchmark Scalability study of a data warehouse on a 64bit Dell|Oracle 10g R2 RAC Linux solution using Industry standard grid components Zafar Mahmood Dell Inc. Anthony Fernandez Dell Inc. Bert Scalzo Quest Software Inc.

19 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Scalability study of a data warehouse on a 64bit Dell|Oracle 10g R2 RAC Linux solution using Industry standard grid components Zafar Mahmood Dell Inc. Anthony Fernandez Dell Inc. Bert Scalzo Quest Software Inc.

20 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Overview Dell Database and Applications Team The Dell Oracle Solutions Engineering team has a complete ownership of the product design and development cycle: –Integrating, validating, bundling, and sustaining Dell’s Oracle DB and RAC solutions, based on PE servers, and Dell|EMC FC I/O Subsystems. Perform comprehensive Oracle Solution integration testing to detect defects that affect the database, OS, servers, interconnect or I/O subsystems (one-pass solution test). Continuously test with the latest version of OS (Linux and Windows X64, OS kernel updates, driver updates, and Oracle patch- sets/ASM/OCFS to verify continuous functionality of Oracle RAC Solutions (Rolling Test). Solution bundles listed with HW and SW component requirements at: http://www.dell.com/10g

21 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Standard Grid Components Oracle Database release N (10g) R1&R2 – EE, SE & SE1 Red Hat AS Updates/Major Releases N-1, OCFS N-1 & Raw Devices N Red Hat AS/ES, W2K3-SP1-SE Release N, OCFS N, and ASM N PE1750, 1850, 2600, 2650, 2800, 2850 4600, 6600, 6800, 6650 & 6850 QLogic QLA2340/2342, QLA200, QLE 2360, 2460/2462(4G) Emulex LP982/9802, LP10K, LP1050e, LP1150e(4G) Intel GigEBroadcom GigELOM GigE Intel GigEBroadcom GigE Database OS/OCFS versions Switch HBA/RAID Storage Pub Net Prvt Net Servers Brocade SW3200, 38x0, 4100 (4G), 200E(4G) McData Sph 4500, 4400(4G), 4700(4G) DA CX200/400/600AX100CX300/500/700

22 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Dell | EMC Fibre Channel Storage Server, Storage and Network Hardware Cluster Nodes –CPU: Dual Core Intel® Xeon™ Processor, 2x2MB Cache, 2.8GHz, 800MHz FSB –Memory: 8GB –IO slots: 2 x PCI-X Shared Storage –Storage Processors: x2 –IO Ports: x4 per SP –DAE’s/Spindles: 2x4/120 Private interconnect: 2xOnboard Intel Gigabit Public LAN: 1xPCI-X Intel Gigabit NIC IO channels and HBA’s: 1xQLA2342 dual port

23 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Server, Storage and Network Configuration Host configuration –IO load balancing –Kernel Parameters –User limits –RAW device bindings Shared Storage Configuration –FC switch configuration –Storage processor load balancing across two CX700 –Storage Cache settings Network configuration –Dual bonded interconnect –Jumbo frames

24 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Oracle 10g R2 RAC stack Applications Dell | EMC CLARiiON Host Bus Adapter Host Bus Adapter PowerPath Automatic Storage Management (ASM) RDBMS Management Utilities HBA Driver/SCSI mid layer Power Path multi path software for IO load balancing Automatic path failover Automatic detection and restore of failed components Dynamic load balancing User-selectable application priorities Online configuration and management Common HBA-driver support

25 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Oracle 10g R2 RAC stack Power Path multi path software for IO load balancing on Dell| EMC Clariion Dual-port disks, redundant FC-AL loops –All disks have paths to both Storage Processors CLARiiON LUNs are “owned” by one Storage Processor –One Storage Processor services I/O for LUN –Second path to LUN is passive *Asymmetrical Volume (LU) Access: LU accessible (active) on one Storage Processor at a time Storage Processor CLARiiON Cache Host HBA Switch SCSI disk Storage Processor Cache State Info CMI Port

26 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Oracle 10g R2 RAC stack Linux Optimizations Oracle Parameters TPC-H Benchmark –Test Description –Database Sizing –Data Model (ERD) –22 TPC-H Queries –Sample Query SQL –Sample TPC-H Results Shared Storage Configuration –Physical Disk Layout –Tablespace Configuration Database Partitioning Scheme

27 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Linux Optimizations sysctl.conf kernel.shmmax = 8589934592 kernel.sem = 250 32000 100 128 fs.file-max = 65536 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 262144 net.core.rmem_max = 262144 net.core.wmem_default = 262144 net.core.wmem_max = 262144

28 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Oracle Parameters Oracle spfile *._slave_mapping_enabled=FALSE (due to metalink Oracle bug) *.db_block_size=8,192 *.db_file_multiblock_read_count=128 (max’s out at 1 MB or 128) *.db_writer_processes=4 *.open_cursors=600 *.optimizer_index_caching=80 (default 0) *.optimizer_index_cost_adj=40 (default 100) *.parallel_execution_message_size=16,384 (default 4096??) *.parallel_max_servers=128 *.pga_aggregate_target=2G *.processes=4000 *.sga_target=6,442,450,944 *.star_transformation_enabled='TRUE' *.undo_management='AUTO' *.undo_retention=800,000

29 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: Test Description Transaction Processing Performance Council - defines database benchmarks The TPC Benchmark™H (TPC-H) is a decision support benchmark. It consists of a suite of business oriented ad-hoc queries and concurrent data modifications. The queries and the data populating the database have been chosen to have broad industry-wide relevance. This benchmark illustrates decision support systems that examine large volumes of data, execute queries with a high degree of complexity, and give answers to critical business questions. The performance metric reported by TPC-H is called the TPC-H Composite Query-per-Hour Performance Metric (QphH@Size), and reflects multiple aspects of the capability of the system to process queries. These aspects include the selected database size against which the queries are executed, the query processing power when queries are submitted by a single stream, and the query throughput when queries are submitted by multiple concurrent users. The TPC-H Price/Performance metric is expressed as $/QphH@Size. http://www.tpc.org/tpch/default.asp

30 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: Database Sizing TPC-H Benchmarking Scale Factors 1=1 GB 10=10 GB 30=30 GB 100=100 GB 300=300 GBOur tests – very common one 1000=1 TB 3000=3 TBTried this size – too few disks 10000=10 TB 30000=30 TB 100000=100 TB

31 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: Data Model (ERD) 25 5 150K / SF 45,000,000 10K / SF 3,000,000 200K / SF 60,000,000 800K / SF 240,000,000 6M / SF 1,800,000,000 1.5M / SF 450,000,000

32 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: 22 TPC-H Queries

33 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: Sample Query SQL

34 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPC-H: Sample TPC-H Results http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=cluster&ver sion=2%&currencyID=0

35 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Shared Storage Configuration - Physical Disk Layout Voting/CRS Backup DATA1_1 – 1TB …DATA2_1 – 1TB … INDX – 400GB … DATA3_1 – 800GB Backup DATA1_2 – 1TB …DATA2_2 – 1TB … DATA3_2 – 800GB INDX – 400 GB EMC CX700 #1EMC CX700 #2 DAE-0 DAE-1 DAE-2 DAE-3

36 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Shared Storage Configuration - Tablespace Configuration *Note: Undotbs1-10 are created for quest user ` QUEST_DAT1 DATA1_1DATA1_2 QUEST_DAT2 DATA2_1DATA2_2 QUEST_INDX INDX_1INDX_2 QUEST_DAT3 DATA3_1DATA3_2 +DG3/quest_dat3.dbf +DG1/quest_dat1.dbf +INDX/quest_indx.dbf +DG2/quest_dat2.dbf

37 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Database Partitioning Scheme Goal = spread IO across as many spindles as possible via partitioning

38 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Test Case Strategy Strategy Objective: Find out the scalability of 10g R2 8 node RAC with TPC-H workload –Test 1: Establish a single node single stream baseline –Test 2: Enable node level parallelism running 4 streams on a single node – PARALLEL (DEGREE 4 INSTANCES 1) –Test 3: Enable node and cluster level parallelism running 4 streams on 4 nodes – PARALLEL (DEGREE 4 INSTANCES 4) –Test 4: Run Test 3 using Intel Xeon dual core processors –Test 5: Enable node and cluster level parallelism running 4 streams on 8 nodes (DEGREE 4 INSTANCES 8) –Test 6: Enable node and cluster level parallelism running 8 streams on 8 nodes (DEGREE 4 INSTANCES 8) Compare average query response times for each test case and expect equal or better query response times for each test case

39 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Test Case Tools Monitoring and Test Tools Quest Software - BenchMark Factory –Simulates TPC-H environment (DSS environment) –Used to test scalability of up to 8 node Oracle 10g R2 RAC cluster Quest Spotlight on RAC –Provides monitoring and diagnosis information about cluster interconnect latency, throughput, ASM performance, Database bottlenecks and overall locking and wait events information Quest TOAD –Provides database monitoring, management and object creation, query performance analysis, explain plan, AWR and ADDM reports generation facilities Oracle Enterprise Manager AWR, ADDM reports

40 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Benchmark Factory

41 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Spotlight on RAC

42 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Toad DBA

43 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Scalability Results The Results –Total Run Time –Average Response Time Lessons learned Best practices for a data warehouse on RAC

44 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The Results: Total Run Time -13.39%-13.60%-17.59%

45 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The Results: Average Response Time -25.57% -15.14%

46 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The Results: Jumbo Frames Default Ethernet frame size is 1500 bytes Can be increased to 9000 bytes for better cluster interconnect performance Enable Jumbo Frames for the private network switch (some switches might have it disabled) Enable Jumbo frames for the bonded interface (bond0) for the private cluster interconnect Perform the same frame length settings on all cluster nodes Rerun Test 6

47 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Lessons Learned Lessons learned … –Parallel across cluster performs better than simply parallel within node –Dual core processor may often or usually improve total run time results regardless of other resource utilizations –Dual core processor will only significantly improve average response time results when you’re not already IO bound –TPC-H results are almost universally governed by the physical number of disk drives the data is spread across –For 8 node test (test 6), the private interconnect started to exhibit larger latency. It is a good idea to consider another high speed interconnect technology such as InifiniBand running RDS for scaling out to greater than 8 nodes.

48 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Best practices for a data warehouse on RAC Establish a baseline on single node with single stream Tune and optimize IO subsystem for parallelism using Parallel Execution –Add additional IO paths (HBA’s) if IO waits are high –Use multi-path software application such as PowerPath or MPIO for IO load balancing and failover across IO paths Enable Node level parallelism using Parallel Execution Add more processing power (Dual Cores CPU) to existing nodes before adding additional nodes. Add more nodes and enable cluster level parallelism if using Parallel Execution Use NIC bonding to provide interconnect scalability. Consider low latency and higher throughput cluster interconnect if scaling data warehouse beyond 8 nodes. Use Jumbo Frames for the cluster interconnect

49 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black What About Home Grown? Let’s take a look at a test case to determine: Does a particular set of transactions, specifically data manipulation language (DML) transactions to the base tables for an Oracle materialized view have an effect on the number of users that can select from the view In addition how many users can perform DML operations while users are performing selects against the materialized views.

50 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Is a Specific Architecture Useful? One of the suggested architectures to allow for rapid reporting without stressing the base tables is to use partitioned, refresh on commit, materialized views within Oracle. It is hoped this test will help show the affects of user load on such an architecture. In order to test this architecture the Quest Benchmark Factory was utilized with two GUI installations; one to do the INSERT into the base tables, the other to perform the SELECT activity against the refresh on commit materialized view.

51 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Test Phases The testing was performed in three phases: Phase 1: In phase one both the INSERT and SELECT potions of the test were cycled simultaneously from 1-60 users in 5 user increments on the INSERT side and 1-30 users in 5 user increments on the SELECT side. Phase 2: In phase two the INSERT side was cycled from 1-60 users in 5 user increments until the response time exceeded 6 seconds while the SELECT side was run at a single constant user level during individual INSERT runs. The SELECT side was run at constant user levels of 5, 10 and 20 users during the INSERT tests. Phase 3: In phase 3 the materialized view was recreated as a single table and the constant user level of 20 for SELECTs was used to test the difference between use of partitions and single tables.

52 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black All Phases In all phases the SALES table was used for the update target with ON COMMIT processing for the materialized views causing selects from all the base tables in the PUBS schema (SALES, AUTHOR, BOOK, AUTHOR_BOOK, PUBLISHER, STORE) to publish data into the MV_AUTHOR_SALES materialized view. In Oracle ON COMMIT processing means just that, whenever there is a commit on the base tables, the effected materialized view records are updated, inserted or deleted. Prior to each test the MV_AUTHOR_SALES materialized view and the SALES table were both truncated.

53 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The Test System

54 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Create the Partitioned MV base table CREATE TABLE mv_author_sales PARTITION BY RANGE (order_date) (PARTITION p1 VALUES LESS THAN (to_date('012002','mmyyyy')), PARTITION p2 VALUES LESS THAN (to_date('022002','mmyyyy')), PARTITION p3 VALUES LESS THAN (to_date('032002','mmyyyy')), … PARTITION p12 VALUES LESS THAN (to_date('122002','mmyyyy')), PARTITION p13 VALUES LESS THAN (MAXVALUE)) as (Select d.order_date, a.rowid idrowa, b.rowid idrowb, c.rowid idrowc, d.rowid idrowd, e.rowid idrowe, f.rowid idrowf, a.author_last_name, a.author_first_name,f.pub_name, a.author_contract_nbr, e.store_state,d.quantity From author a, book_author b, book c, sales d, store e, publisher f Where a.author_key=b.author_key And b.book_key=c.book_key And c.book_key=d.book_key And e.store_key=d.store_key and c.pub_key=f.pub_key) /

55 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Create the Indexes create index mv_rida on mv_author_sales(idrowa); create index mv_ridb on mv_author_sales(idrowb); create index mv_ridc on mv_author_sales(idrowc); create index mv_ridd on mv_author_sales(idrowd); create index mv_ride on mv_author_sales(idrowe); create index mv_ridf on mv_author_sales(idrowf);

56 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Create the Materialized View Create materialized view mv_author_sales on prebuilt table Refresh on commit as Select d.order_date,a.rowid idrowa, b.rowid idrowb, c.rowid idrowc, d.rowid idrowd, e.rowid idrowe, f.rowid idrowf, a.author_last_name, a.author_first_name,f.pub_name, a.author_contract_nbr, e.store_state,d.quantity From author a, book_author b, book c, sales d, store e, publisher f Where a.author_key=b.author_key And b.book_key=c.book_key And c.book_key=d.book_key And e.store_key=d.store_key and c.pub_key=f.pub_key /

57 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Statistics After creation and refresh the MV_AUTHOR_SALES and SALES tables we analyzed using a command similar to: dbms_stats.gather_table_stats('PUBS','MV_AUTHOR_SALES',cascade=>true); The dynamic sampling feature of 10g was utilized to maintain statistics for the test since the table and materialized view were growing during the entire test period for each test.

58 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Transaction Details Two basic transactions were utilized to test the affect of locking on the INSERT and SELECT activities. The SALES table formed the base of the materialized view MV_AUTHOR_SALES so the INSERT transaction focused on inserts into the SALES table. The inserts into the SALES table force the materialized view refresh (REFRESH-ON-COMMT) to select records from all of the base tables. The following Benchmark Factory function scripts where used to populate random values into the INSERT statement: –$BFRandList – Insert one of the provided list into the statement at this point with frequency based on the provided integer (“val”:f) if no integer is provided, use 1. –$BFRandRange – Insert a random integer in the range specified. –$BFDate – Insert a random date in the range specified.

59 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Example SQL Insert Transaction: INSERT INTO sales VALUES ( '$BFRandList("S101","S103","S103","S104","S105","S106","S107","S108", "S109","S110")', '$BFRandList("B101","B102","B103","B104","B105","B106","B107","B108","B109","B110", "B111","B112","B113","B114","B115","B116")', 'O'||to_char(order_number.nextval), to_date('$BFDate("01/01/2002","12/31/2002")','mm/dd/yyyy'), $BFRandRange(1,100)); The SELECT transaction was designed to fully access the materialized view placing the most stress on the view as possible. Select Transaction: SELECT to_number(to_char(order_date,'mmyyyy')) month_of_sales,author_first_name,author_last_name,sum(quantity) FROM mv_author_sales GROUP BY to_number(to_char(order_date,'mmyyyy')),author_first_name,author_last_name;

60 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Resulting Partition Loading PARTITION COUNT(*) --------- ---------- 012002 831 022002 765 032002 805 042002 799 052002 885 062002 788 072002 896 082002 864 092002 871 102002 843 112002 888 122002 857

61 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1: Both Insert and Select Varying In phase one, both Benchmark Factory tests were made to scale. From 1-30 users for selects in 5 user increments (1, 5, 10, 15, 20, 25, 30) and 1-60 users in inserts in 5 user increments. During testing locks were monitored using the procedure shown below. Create or replace procedure get_locks(tim_in_min number) as interations number; I integer; begin interations:=floor(tim_in_min*60/4)+1; for I in 1..interations loop insert into perm4_object_locks select sysdate, b.object_name,count(*) from v$locked_object a, dba_objects b where a.object_id=b.object_id and object_name!=’PERM4_OBJECT_LOCKS’ group by object_name; commit; dbms_lock.sleep(4); end loop; end;

62 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Example Locking Results The locking was monitored at 4 second intervals and the results for Phase 1, 1-30 User SELECT processes in 5 user increments versus INSERT processing at 1-60 users in 5 user increments. Lock profile for MV_AUTHOR_SALES materialized view: MEAS_ OBJECT_NAME SUM(NUM_LOCKS) ----- --------------- -------------- 21:10 MV_AUTHOR_SALES 2 21:11 MV_AUTHOR_SALES 4 21:12 MV_AUTHOR_SALES 2 21:13 MV_AUTHOR_SALES 2 21:14 MV_AUTHOR_SALES 4 21:17 MV_AUTHOR_SALES 2 21:18 MV_AUTHOR_SALES 2 21:19 MV_AUTHOR_SALES 2 21:21 MV_AUTHOR_SALES 3 21:22 MV_AUTHOR_SALES 4 21:23 MV_AUTHOR_SALES 2 21:25 MV_AUTHOR_SALES 2

63 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Results for the Insert Side

64 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Results for the Select Side

65 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1 Results Summary The results show that the locking affects INSERT processing resulting in the average time for inserts to increase to greater than 6 seconds within 15 user processes while SELECT processing shows little affect other than that which can be expected from the materialized view table size increase. However, the affects are hard to characterize when both INSERT and SELECT processes are varying.

66 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 2: SELECT transaction level constant In Phase 2 the transaction levels for SELECTs will be held at constant levels (5,10,20), and we will check TPS and response for Inserts ( levels 1-60 or where Response >6 sec.) In Phase 2 testing the number of SELECT user processes is kept at constant values while the number of INSERT processes is increased in 5 user intervals until response time increases above 6 seconds. SELECT user levels of 5, 10 and 20 were used. The TPS and response time for the SELECT processes were recorded at each user level for each upward increment in the number of INSERT processes to gauge the affect of increased locking on the SELECT processing.

67 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black 5 concurrent SELECTS

68 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black 10 concurrent SELECTS

69 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black 20 Concurrent Select Users

70 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 2 Summary Over all the Phase 2 testing shows that locking has little or no affect on SELECT operations while the number of SELECT processes has an affect on the number of INSERT processes capable of operating with a less than 6 second response time and the number of TPS that can be processed for that user level.

71 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 3: Materialized View with No Partitions In Phase three the affect of utilizing a single base table verses using multiple partitions at the maximum number of SELECT processes (20) is measured.

72 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black 20 Users No Partitions

73 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Value Distribution The total row count for the single table test was 9299 vice 10092 in the partitioned testing (on the average.) The distribution of the values in the single table is shown below. ORDER COUNT(*) ------ ---------- 012002 786 022002 692 032002 733 042002 737 052002 810 062002 722 072002 828 082002 803 092002 803 102002 781 112002 824 122002 780

74 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 3 Summary Phase 3 shows that while partitions are good for SELECT processing they may have a slightly detrimental affect on INSERT processing. The INSERT processing affects may be mitigated by changing how rows are stored in the table such as by large PCTFREE allocations limiting the rows per block.

75 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Combined Results It is easer to see the affects of the increasing number of SELECT processes by combining the results from the various tests into a series of graphs. In the first graph we examine the affect on transactions per second (TPS). The combined TPS graphs for the 5, 10, 20 SELECT Users and the 20 SELECT users with no partitions test results. Notice how the performance for the 20 SELECT user no partitions TPS is less than for the 20 SELECT user partitioned results. All of the other results show the affect of the increase stress of the SELECT processing on the INSERT users and the lack of affect of the INSERT processes on the SELECT users.

76 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Combined Results

77 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Select Response Times

78 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Insert TPS

79 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Response Time

80 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Combined Results Summary Again, these results show that locking, as expected, has little affect on SELECT processing since with Oracle’s single row (fine grained) locking model and multi-block concurrency model readers will not be blocked by writers and writers will not be blocked by readers. It also shows that using the REFRESH ON COMMIT materialized views should not adversely affect INSERT or SELECT processing. the tests seem to indicate that for SELECT processing using partitions is beneficial but for INSERT processing, at least at the single row per transaction level, the partitions may have a slightly negative affect on TPS and response time.

81 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Recommendations Based on the data in this report it is recommended that partitioned materialized views using the REFRESH ON COMMIT refresh mechanism should be used to reduce the strain on the underlying OLTP based tables when the same database instance is used in OLTP and reporting. While using partitioned materialized views shows a slight increase in response times on INSERTS, the benefits of their use outweigh the potential down sides. In this section we have seen an example of utilizing a benchmarking tool to see if a particular architecture was correct for our application and checking to see how our application would scale on a particular hardware setup. But how can we determine if a particular hardware setup is correct? In the next section we show an example of the use of a benchmark tool to determine projected hardware needs based on user load and projected data size.

82 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Planning Future Hardware & Software Needs Projecting future hardware and software needs requires you to establish what the current hardware is capable of, then project based on your criteria what hardware will be needed. For our example we will use an actual user test case. In this test case we have been tasked with determining for a production server with 20 times more data the number of CPUs and Memory that will be required to give performance comparable to that we currently experience. First let’s look at the architecture we will be testing.

83 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Architecture

84 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Test Summary Performance testing against the test table in the test database instance was accomplished during the period April 3 – April 7, 2006. The Benchmark Factory tool from Quest was utilized to simulate loads against the test database for various user loads and queries similar to those that will be generated by the reporting system against the database during normal operations. Two general types of queries were tested during this time period, an issues type query set and a parts type query set. A basic template for each of the queries was provided by site personnel and the Benchmark Factory provided scripts were utilized to insert random values into the queries to generate the query loads. The random values used in the tool where selected from the test database instance to provide for a varying load for each type of query presented.

85 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1 In Phase 1 only issues queries were utilized to perform a SQL scalability test. In Phase 1 the user load was ramped in 6 user increments from 6 users to a maximum of 84 users. Each user was able to run any of the six queries at any time and no “think”, “keyboard” or other delays were programmed into the scenario. In Phase 1 operating system statistics and statspack were used to collect additional statistics. NOTE; For the purposes of this example, we don’t need to include phases 2 and 3, so for purposes of brevity they will be omitted.

86 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Limitations and Caveats The testing described in this session was performed on a shared system where the team had no control over what other teams were doing on the server; therefore there are variations in transactions per second, transactions and bytes per second that would not be present in an isolated testing environment. The server memory configuration was not able to be adequately tuned due to the limitations of a shared environment, so there are some physical IOs which occur that would not have happened or would have been greatly reduced in a properly tuned environment. Oracle9i Release 2 was used for the test environment, there are several bugs in release two which caused Ora-00600 and other errors when large numbers of bind variables were utilized, the bind variables were considered “unsafe” (such as to replace a string value in a LIKE statement) and CURSOR_SHARING is set to SIMILAR.

87 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1: Issues Query Testing Phase 1 is a standalone test of the Issues queries. The user load was ramped from 6 to 84 users (note that at 78 users the system would begin giving resource related errors and refuse further connections.)

88 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Randomization of the Issues Queries USERIssue Count GEORGEB230 FRANKL225 MIKER2673 SAMMYJ417 BILLYB460 OZZYO354

89 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Product PRODUCTIssue Count RADIOX3172 RADIOY1479 DVDPX1210 CDPY7880 CAMCDR13187 CAMCDR22270 VCRX1510

90 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Randomization of Values The FINISHED column had the values of either NULL or ‘LATE’ so both of these conditions were utilized in various queries. At any time during the test a user process would be executing a query using any of the above values, providing a random number of return values for each unique query.

91 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Graph of Transaction Times by Query by User Load

92 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Average Transaction Times

93 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Response Time

94 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black TPS Notice one test has significantly higher TPS than the other two after the throttling effect at 18-24 users; this is due to the variances in server availability because of the shared user environment and makes it difficult to accurately predict overall performance for scaling purposes

95 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Database Activity col meas_date format a19 set pages 0 numwidth 12 spool logical_reads_q2 select a.instance_number,to_char(a.begin_interval_time,'yy yymmdd hh24:mi') meas_date, b.value from dba_hist_snapshot a, dba_hist_sysstat b where b.stat_name='session logical reads' and a.begin_interval_time>sysdate-7 and b.snap_id=a.snap_id order by a.instance_number,a.begin_interval_time / spool off set numwidth 10 pages 22

96 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Logical Reads

97 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Physical Reads

98 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Scattered and Sequential Reads

99 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Results The Issues queries are performing primarily in memory which is why their performance is excellent (sub-second on the average) if this could be maintained for the production environment at least as far as the database is concerned, performance for these queries would be optimal. However, it is projected that with the addition of the requirement to allow searching for issues that the current user (i.e. a supervisor checking on his subordinates issues) has no role would increase the number of table entries by a factor of around 20. This would increase the size to nearly a gigabyte in size driving up physical reads if the current database memory size is maintained. If the system shifts from predominately logical to predominately physical reads to satisfy the queries, processing time could increase by up to a factor of 17 to 100 times.

100 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Table/Index Reads

101 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Operating System Activity

102 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black CPU Results We see that there appears to be a great number of processing peaks, these are due to the startup of the test users and can generally be disregarded, the 7 point moving average is a better indicator of actual CPU activity in this case and shows that even with 78 users hammering at the system we only reached 67 percent of CPU. The biggest issue which stopped testing at 78 users was memory related and not CPU

103 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Memory Usage

104 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1 Conclusions Phase 1 shows that for the current data size (42 megabytes in the ISSUES base table) the data is completely cached in the database buffer area leading to excellent query performance at the database level. However, if system data volume increase by a factor of 20 as is predicted then the memory will no longer be able to fully cache the ISSUES data and increased physical reads will seriously impact performance of the Issues queries. Should the data size increase by a factor of 20 to get the same performance the database cache area would also need to be increased by a similar amount (from 500 megabytes to 10 gigabytes) unless some form of partitioning on the ISSUES table is utilized to reduce the working data set size.

105 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Phase 1 Conclusions In addition, increasing the data set size will increase the amount of logical IO and CPU usage. If CPU usage increases by a factor of 20 due to increases in data set size then to support the same 78 users with the same level of performance 10 CPUs would be required. Using ratios the current configuration utilizes 0.87 percent of the available CPUs (2) for each user at peak load: 68 percent of CPU at 78 users), increasing the workload by a factor of 20 would drive CPU usage to 1740 percent, allowing that this is for 2 CPUs, each CPU would be doing 870 percent, thus, at least 9 CPUs (assuming the data is fully cached) would be required to just handle the Issues type queries at a 78 user load with a factor of 20 data size increase.

106 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Maintaining Service Level Agreements (SLA’s) An SLA (Service Level Agreement) is a contractual agreement usually between a service provider such as a hosting service, and a client. SLA’s may also be between other departments and the IT department. Generally SLA’s related to databases call for a specific response time, for example, a particular screen may need to be populated within 7 seconds or a particular report must return results within 3 seconds. The IT department must define specific tests that are performed at specific intervals to verify SLA compliance, or lack of compliance, before the users notice. The results from the SLA performance tests are usually graphed or trended.

107 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Determining SLA Test Queries If a particular screen or report is the basis of the SLA, then the queries that fill the screen with data or the query that pulls the data for the report. In previous sections we saw queries that responded with data in sub second response times, yet the application response time was over the SLA of 3 seconds. The problem in the system in the previous section was the downstream reporting system. Even though the database responded in sub second time the downstream reporting system and web server resulted in delays that caused what the user saw as response time to be longer than the 3 second SLA, be sure your SLA is just for items you have control over!

108 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Determining SLA Test Queries You must make sure that a SLA is meaningful for your part of the system Did I mention that the system with the 3 second SLA also had to service clients in Asia from a server in the Midwestern portion of the USA where the network latency was 500 milliseconds for each leg of the network round trip? You must make sure that not only do you have a meaningful SLA, but that the queries you choose to test with are of sufficient complexity and quantity to fully test the important parts of the SLA.

109 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Ok, I have the SLA and Queries, What Now? Once you have a properly defined SLA and the queries to test it, you have to set up periodic testing routines that verify the SLA timing criteria are met. The tests must be run not just during off hours with a low load, but also during peak loads, after all, your users obviously don’t use the system on off-peak times only. Your test scripts can be as simple as a SQL test harness routine that utilizes the pre-chosen SQL and is run periodically during the day, to a mini-benchmark that is automatically run and a scheduled basis.

110 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Issues with Generating Your Own Scripts If you generate your own SQL test harness you face the following issues: SQL may change, requiring recoding It is very difficult to randomize code variables Capturing timing values can be problematic

111 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Issues with Generating Your Own Scripts Without a benchmark utility you are limited to either manually running the scripts and capturing the timings to verify your SLA, or developing your own SQL test harness to inject code into your database. However, if you inject the same identical SQL statements in each test run you may get artificially good performance due to caching at the database level. You must introduce randomness into SQL variables and run queries multiple times, then average the results to get valid results.

112 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The pseudo-code for such a SQL test harness Open procedure with “X” (number of times for each SQL iteration) Loop 1: Choose Template SQL statement from SQL table Loop 2: SQL Processing (iterate X times) Read example SQL string from test SQL table Parse variables from code Loop3 Read variable types and random values from variable table Replace variables in SQL string with proper variable End Loop3 Capture start timing Execute parsed and variable loaded SQL into cursor Capture end timing Calculate total time spent executing Load result table for executed SQL with timing End Loop2 End Loop 1 Calculate Averages for all SQL Compare calculated averages to SLAs Send alert if any SLA exceeded End Procedure

113 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black The Easy Way If you are using Oracle, the Grid Control and Database Control interfaces allow you to enter new procedures to calculate metrics which will be tested and the results can generate server alerts that will send you emails when SLAs are exceeded. Another easy method is to use a Benchmark tool that allows you to enter the test SQL and program in randomization of variables. Then the most difficult part is scheduling the test to run. Tools like Benchmark Factory will even email you with results from SQL testing.

114 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Supporting Server & Storage Consolidations

115 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Supporting Server & Storage Consolidations Determining memory needs is a matter of looking at current usage during peak times across the various platforms to be consolidated and adding the results. Determining disk needs can be much easier than determining the CPUs and memory needs. You must not only look at disk capacity, you must consider IO capacity as well as user concurrency issues when dealing with disk capacity. Always look at IO rates and concurrency needs first, allow no more than 90 IO/sec per drive (less if you use RAID5), concurrency is a bit harder to figure out, but if you allow for needed IO rates usually you get pretty close to allowing for concurrency as well. The RAID calculations for RAID 10 and RAID 5 are shown in the spreadsheet on the next page.

116 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Disk IO and RAID

117 Indications in green = Live content Indications in black = Edit in master Indications in white = Locked elements logo must not be moved, added to, or altered in any way. Background should not be modified. Presentation title: 12 pt. Arial Regular, light blue Slide heading: 28 pt. Arial Regular, black Maximum length: 1 lines Slide body: 22 pt. Arial Regular, black Recommended maximum length: 4 principal points Slide number: 8 pt. Arial bold, black Chart copy: 12 pt. Arial Bold, black Conclusions In this presentation we have examined the uses of benchmark tools to perform capacity analysis and prediction. We have seen examples using the Benchmark Factory tool to demonstrating the use of such tools for trending and planning for future needs. We have also examined the use of manual tools such as spreadsheets to do predictions of needed CPUs, memory and disks in server consolidations.


Download ppt "Copyright © 2006 Quest Software Title slide Copyright: 8 pt. Arial Who Needs benchmarking…You Do! Mike Ault Domain Specialist, Oracle Quest Software."

Similar presentations


Ads by Google