SESSION CODE: BIE07-INT Eric Kraemer Senior Program Manager Microsoft Corporation

●SQL Fast Track DW Overview ●Fast Track DW Implementation Key Principles (Server) ●Fast Track DW Implementation Key Principles (Storage Layer) ●Fast Track DW Implementation Key Principles (Data Loading) ●Q&A

Fast Track DW Overview

SQL 2008 Data Warehouse 4 Processor 16 Core Server Shared Network Bandwidth Enterprise Shared SAN Storage Dedicated Network Bandwidth Traditional SQL DW Architecture Shared Infrastructure Fast Track SQL DW Architecture Dedicated DW Infrastructure Architecture modeled after DW Appliances 1TB – 48TB Pre-Tested Dedicated Low Cost SAN Arrays 1 for every 4 CPU Cores EMC AX4 – HP MSA2312 OLTP Applications Benefits: -More System Predictability Thus User Experience -Pretested Configurations Lowers TCO -Balanced CPU to I/O Channel Optimized for DW -Modular Building Block Approach -Scale Out or Up within limits of Server and SAN

Software: SQL Server 2008 Enterprise Windows Server 2008 Software: SQL Server 2008 Enterprise Windows Server 2008 Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block

All databases contain both scans and seeks among with other types of reads and writes, DW workload indicate that the vast majority of reads are sequential – not all

Fast Track DW Implementation Key Principles Server Layer

FC HBA A B A B FC HBA A B A B FC SWITCH STORAGE CONTROLLER A B A B CACHE SERVER CACHE SQL SERVER WINDOWS CPU CORES CPU Feed RateHBA Port RateSwitch Port RateSP Port Rate A B DISK LUN DISK LUN SQL Server Read Ahead Rate LUN Read RateDisk Feed Rate SQL Server 2008 Potential Performance Bottlenecks Current Fast Track Architectures are rated at 200 MB/s per CPU core

Server Windows Server OS MCR 1.6 GB/s Storage Enclosure Fiber Switch 500 MB/s 300 MB/s HBA Min 2 GB/s Min 2 GB/s Min 2 GB/s

Server SQL Server OS BCR 1.2 GB/s HBA Storage Enclosure Fiber Switch 1.2 GB/s 1.2 GB/s 1.2 GB/s 300 MB/s 150 MB/s

LUN16LUN 2LUN 3 Local Drive 1 Log LUN 1 Permanent DB Log LUN 1 TempDB TempDB.mdf (25GB)TempDB_02.ndf (25GB)TempDB_03ndf (25GB)TempDB_16.ndf (25GB) Permanent FG Permanent_1.ndf Permanant_DB Stage Database Stage FG Stage_1.ndfStage_2.ndfStage_3.ndf Stage_16.ndf Stage DB Log Permanent_2.ndf Permanent_3.ndf Permanent_16.ndf Log LUN 2 Permanent DB Log Stage DB Log

1:32 1:31 1:35 1:34 1:33 1:36 1:38 1:37 1:40 1:39 1:32 1:31 1:35 1:34 1:33 Key Order of Index

Filegroup “Stage A” Filegroup “Stage A” Filegroup “A” Partition 1,2 Filegroup “B” Partition 3,4 Filegroup “C” Partition 5,6 Filegroup “D” Partition 7,8 Filegroup “Stage B” Filegroup “Stage B” 8 Source Data Files 8 Core Server Base Heap StageTable No Compression Base Heap StageTable No Compression Target Database Partition 2 Destination CI Partition 1 Destination CI Partition 4 Destination CI Partition 3 Destination CI Partition 6 Destination CI Partition 5 Destination CI Partition 8 Destination CI Partition 7 Destination CI 8 Concurrent BCP Loads Step 1 “Base Load” Step 1 “Base Load” Step 2 “Stage Insert” Step 2 “Stage Insert” Step 3 “Transform” Step 3 “Transform” Step 4 “Final Append” Step 4 “Final Append” 8 Heap Stage Table Constraint on CI Part Key 8 Heap Stage Table Constraint on CI Part Key 8 Concurrent Inserts 2 CI Stage Tables 2 sets, 4 concurrent Create Cluster Index with Compression INTO “Final Destination” 2 sets, 4 concurrent Create Cluster Index with Compression INTO “Final Destination” Create CI 8 Concurrent Partition Switch Part Switch Destination Partitioned CI Table

Filegroup “Stage A” Filegroup “Stage A” Filegroup “Current” Partition 47,48 Filegroup “Historical” Partition 1-46 Filegroup “Historical” Partition Core Server Target Database Partition 48 Destination CI Partition 47 Destination CI BCP Load Step 1 “Base Load” Step 1 “Base Load” Destination Partitioned CI Table 1 Source Data File Partition 1.. Destination CI

“ At the end of the day, IT operations is really about running your business as efficiently as you can so you have more dollars left for innovation. IPD guides help us achieve this.” Peter Zerger, Consulting Practice Lead for Management Solutions, AKOS Technology Services

Fans 6 hot plug redundant fans, 3 shown Core I/O - 2 USB, 1 serial, 1 video port, 3 RJ-45 PS2 keyboard/mouse support I/O slots 11 PCIe slots std., Option to upgrade to 2 HTx and 7 PCIe Power Supplies redundant power supplies

Fast Track DW Case Study

Teradata SQL Server Fast Track DW Comparison Loading Subject Area 1 5:10:21 total time0:51:31 total time  6x faster Loading Subject Area 2 4:36:08 total time1:50.01 total time  2.5x faster Query times Subject Area 1 3:03 avg query time (using 9 benchmark queries) 0:15 avg query time (using 9 benchmark queries)  12x faster Query times Subject Area 2 56:44 avg query time (using 4 benchmark queries) 8:09 avg query time (using 4 benchmark queries)  7x faster

Large Retailer with limited capabilities because of their legacy based business intelligence solution. The solution has capacity for 212 users at the cost of ~1 million in annual maintenance. Competition – Netezza & Oracle 1)Lower their maintenance cost 2)They wanted to address the business needs (POS data, etc) 3)They also wanted to proliferate the advantages of Business Intelligence across their enterprise. Business Needs Solution Situation Full MS BI stack Fast Track, SSRS, Excel Services, PPS & Office 2007 Our solution will replace and extend the existing DB2 AS400 system SSIS will replace existing COBOL ETL (including ODI) Benefit

ARY01D1v01ARY01D1v01 ARY01D2v02ARY01D2v02 ARY02D1v03ARY02D1v03 ARY02D2v04ARY02D2v04 ARY03D1v05ARY03D1v05 ARY03D2v06ARY03D2v06 ARY04D1v07ARY04D1v07 ARY04D2v08ARY04D2v08 DB1-1.ndfDB1-1.ndf DB1-7.ndfDB1-7.ndf DB1-5.ndfDB1-5.ndfDB1-3.ndfDB1-3.ndf DB1-2.ndfDB1-2.ndfDB1-4.ndfDB1-4.ndfDB1-6.ndfDB1-6.ndf DB1-8.ndfDB1-8.ndf 4MB4MB 4MB4MB 4MB4MB 4MB4MB 4MB4MB4MB4MB 4MB4MB 4MB4MB

57©2009 Microsoft Corporation