6. 11 33 55 Scalable Data Warehouse & Data Marts ReportsAnalysis SQL Server DBMS SQL Server Integration Services Custom OLTP Increase usage & trust Consolidate & reduce cost 44 22 66

7. 7 Method for designing a cost-effective, balanced system for Data Warehouse workloads Reference hardware configurations developed in conjunction with hardware partners using this method Best practices for data layout, loading and management

8. Software: SQL Server 2008 Enterprise Windows Server 2008 Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading

11. Data Path Data Warehouse Analysis Services Cubes PerformancePoint SAN, Storage Array Reporting Services Web Analytic Tools Integration Services ETL SharePoint Services Microsoft Office SharePoint Data Staging, Bulk Loading Subject Area Data Marts Supporting SystemsBI Data Storage SystemsPresentation Layer Systems Reference Architecture Scope (dashed) Excel Services Presentation Data

12. Designing High Performance I/O

13. CPU PCI Bus I/O Controller / HBA Cabling Array Cache Spindle Windows SQL Serv. DB ComponentBalance For… CPUMaximum consumption rate of cached data for targeted query mix Controller (Service Processor) Bandwidth needed to feed CPU cores (based on targeted query mix) HBAAggregate bandwidth array controllers will deliver SwitchAligned with HBA bandwidth and optimized for sequential IO DisksAggregate bandwidth of array controllers / Database capacity

14. Disk Subsystem Server NIC Memory Network 1 1 5 5 3 3 4 4 2 2 SQL File Layout HBA

18. Key takeaway: If tuning for sequential, be careful about I/O weaving

19. Stripe SizeTransfer SizeRandom SizeSequential 128KB64KB1.2GB/sec2.1GB/sec 128KB512KB1.5GB/sec2.1GB/sec 256KB64KB1.0GB/sec2.1GB/sec 256KB512KB2.0GB/sec2.1GB/sec

20. Cache Fiber Channel Ports Controllers/Processors Switch HBA Switch PCI Bus Best Practice: Make sure you have the tools to monitor the entire path to the drives. Understand utilization of individual componets Fabric Array

22. SELECTL_RETURNFLAG, L_LINESTATUS, SUM(L_QUANTITY) AS SUM_QTY, SUM(L_EXTENDEDPRICE) AS SUM_BASE_PRICE, SUM(L_EXTENDEDPRICE*(1-L_DISCOUNT)) AS SUM_DISC_PRICE, SUM(L_EXTENDEDPRICE*(1-L_DISCOUNT)*(1+L_TAX)) AS SUM_CHARGE, AVG(L_QUANTITY) AS AVG_QTY, AVG(L_EXTENDEDPRICE) AS AVG_PRICE, AVG(L_DISCOUNT) AS AVG_DISC, COUNT(*) AS COUNT_ORDER FROMLINEITEM GROUP BYL_RETURNFLAG, L_LINESTATUS ORDER BYL_RETURNFLAG, L_LINESTATUS

25. File 1 File 2 File 1 File 2 File 1 Extent File 1 Table 1 Table 2 Table 1 1:32 1:38 1:37 1:40 1:39 1:33 1:31 1:35 1:34 1:36

26. 1:32 1:31 1:35 1:34 1:33 1:36 1:38 1:37 1:40 1:39 1:32 1:31 1:35 1:34 1:33 Key Order of Index

28. ARY01D1v01ARY01D1v01 ARY01D2v02ARY01D2v02 ARY02D1v03ARY02D1v03 ARY02D2v04ARY02D2v04 ARY03D1v05ARY03D1v05 ARY03D2v06ARY03D2v06 ARY04D1v07ARY04D1v07 ARY04D2v08ARY04D2v08 ARY05v09ARY05v09 DB1-1.ndfDB1-1.ndf DB1-7.ndfDB1-7.ndf DB1-5.ndfDB1-5.ndfDB1-3.ndfDB1-3.ndf DB1-2.ndfDB1-2.ndfDB1-4.ndfDB1-4.ndfDB1-6.ndfDB1-6.ndf DB1-8.ndfDB1-8.ndf DB1.ldfDB1.ldf FT Storage Enclosure

29. ARY01D1v01ARY01D1v01 ARY01D2v02ARY01D2v02 ARY02D1v03ARY02D1v03 ARY02D2v04ARY02D2v04 ARY03D1v05ARY03D1v05 ARY03D2v06ARY03D2v06 ARY04D1v07ARY04D1v07 ARY04D2v08ARY04D2v08 ARY05v09ARY05v09 DB1-1.ndfDB1-1.ndf DB1-7.ndfDB1-7.ndf DB1-5.ndfDB1-5.ndfDB1-3.ndfDB1-3.ndf DB1-2.ndfDB1-2.ndfDB1-4.ndfDB1-4.ndfDB1-6.ndfDB1-6.ndfDB1-8.ndfDB1-8.ndf DB1.ldfDB1.ldf 4MB4MB 4MB4MB 4MB4MB 4MB4MB 4MB4MB4MB4MB 4MB4MB 4MB4MB

34. Extent 1..16 Extent 17..64 Extent 65… …Extent 128 Extent 129

35. Extent 1..16 Extent 17-64 Extent 65..70 Extent 70..89 Extent 90..99

37. Extent 1… …Extent 64 Extent 65… …Extent 128 Extent 129

38. ARY01D1v01ARY01D1v01 ARY01D2v02ARY01D2v02 ARY02D1v03ARY02D1v03 ARY02D2v04ARY02D2v04 ARY03D1v05ARY03D1v05 ARY03D2v06ARY03D2v06 ARY04D1v07ARY04D1v07 ARY04D2v08ARY04D2v08 DB1-1.ndfDB1-1.ndf DB1-7.ndfDB1-7.ndf DB1-5.ndfDB1-5.ndfDB1-3.ndfDB1-3.ndf DB1-2.ndfDB1-2.ndfDB1-4.ndfDB1-4.ndfDB1-6.ndfDB1-6.ndf DB1-8.ndfDB1-8.ndf 4MB4MB 4MB4MB 4MB4MB 4MB4MB 4MB4MB4MB4MB 4MB4MB 4MB4MB