4 What is Azure Storage Takeaways: Dont worry about RAID 1+ Geo redundancy/replicationTakeaways:Dont worry about RAID 1+Dont do geo-replication for SQL IaaSWrite penalty (expect WRITE_LOG)LRSZRSGRSRA-GRSTotal Copies36SLA99.9%99.99% read99.9% writeWarning: No write ordering on geo replication
5 Storage Choices for IaaS ? VHD on HDDVHD on SSDDirect to Blob StoreThroughput MB/Sec60200Max IOPS5005,000Latency10-40ms<5ms???Cost per TB/Month €17.28113.99VM SLANone99.9%CREATE DATABASE MyAzureDBON( NAME = MyAzureDBData,FILENAME = ' )LOG ON( NAME = MyAzureLog,FILENAME = '
7 SQL IO Characteristics (AVG IO Size) WorkloadTypeIO SizeLog WritesSequentialUp to 60kCheckpointRandomUp to 256kTable Scan64-512K (on EE)Index Seek8k64k (read ahead)Backup64k-4MB500 = 4MB/sec500 = 31MB/secMB/Sec80,000 64k = 5GB/SecConclusion – ignore iop limit on ssd vms and worry about throughput !
8 VM Throughput Limits DS-Series, ACU: 210-250 GS-Series, ACU: 180 - 240 CoresRAMVM “IOPS”Max MB/secEffectiveVM Cost €/Month2146,400961,53611942812,8001923,07223785625,6003846,1444761611250,00076812,2889542014064,00096015,3601,19048 MB/Sec per coreGS-Series, ACU:2285,0001252,00043945610,0002504,000878811220,0005008,0001,7571622440,0001,00016,0003,5143244880,00032,0006,267 (14,493 with EE)62.5 MB/Sec per core€1.23 euro per MB/Sec
9 The Three Levels of Throttling STORAGE ACCOUNT 20,000 iops or 1,250 MB/Sec4 Core VM386 MB/Sec8 Core VM768 MB/Sec32 Core VM2,000 MB/Sec1TB SSD 200 MB/Sec1TB SSD 200 MB/Sec1TB SSD 200 MB/SecX 2X 4X 10Also 10 Gbps
10 Managed Disks Eliminates limits of storage account ;-) P10 P20 P30 Eliminates limits of storage account ;-)P10P20P30P50 (new)Disk Size (GB)1285121TB4TBIOPS5002,3005,0007,5000Throughput100150200250Effective Throughput8143Cost €/month1868125455Cost € per MB/Sec2.250.460.6251.82Cost € per TB144136114P10 is only 8 MB/Sec
11 An Example of designing storage for elasticity We need a 3TB SQL but want to “max” storage performance on an 8 core server and burst up to 20 core at night8 Core VM384 MB/Sec1TB SSD 200 MB/Sec1TB SSD 200 MB/Sec1TB SSD 200 MB/Sec600 MB/Sec20 Core VM960 MB/Sec512GB SSD 150 MB/SecX 6 = 900 MB/Sec
12 Storage Host CachingDiscuss – why do not care so much about storage cache?Best Practise
13 The Tempdb Debate The usual practices apply Pre-size and set growth on tempdbUse multiple filesOnly use T1117 and T1118 before SQL 2016Tune to lower tempdb utilisationShould we use Local SSD – Maybe ;-)Side effect of permissions/startup issuesCan reduce latency on write intensive tempdbChoose latency or throughputOnly one local disk and limited size
15 Combing Disks with Storage Spaces Storage PoolJust a JBOD Collection of DisksSqlDataLayout: simple (Mirror, Parity)Number of Columns 8= Number of physical disks per write (aka stripe)Interleave 256KB= Size of read/write to a disk (eg I/O Size)SqlLogLayout: SimpleColumns=8Interleave=64kVirtual DisksF:\ (SqlData), or mount pointFormat: 64k (4k default)L:\ (SqlLog)Format: 64kVolume
17 The Data and Log Debate Same Volume (Same disk and pool) \SqlData \SqlLogDataLog2 Separate Volumes (Same disk and pool)DataLog3. Separate Virtual Disks and Volumes (Different Interleave…)DataLogDataLog4. Separate Pools, Disks and VolumesDataLog
18 The Magnificent Seven Capacity Planning Metrics Perfmondm_io_virtual_file_statsIOPSLogical Disk\Reads/SecLogical Disk\Writes/SecYOLTP, DW, MixedLogical Disk\ Avg Disk Bytes/ReadKindaThroughputLogical Disk\Read Bytes/SecSize of data, log, tempdbMSSQL$:Databases(x)\Data File Size (KB)MSSQL$:Databases(x)\Log File Size (KB)% of workload in tempDerivedRW RatioLatencyLogical Disk\Avg Disk Secs/Read[sys].[dm_io_virtual_file_stats]
19 Capacity Planning Tools Tools to capture metricsTools to analyse metrics
20 Benchmarking Use diskspd.exe to validate throughput and or IOPS Consider making a IO saturation chartRun diskspd as ever increasing thread and outstanding IOIf you are lazy use CrystalDiskMark
27 Sponsor Raffle!!!Each sponsor stamp will opt you into their raffle prize and mailingsCollect 9+ sponsor stamps on your Badge to be eligible for the XboxHand entire Badge/ ribbon back into registration desk at end of dayWe will draw Badges for prizes at 5pm in Cromwell (if you are drawn and do not have the pre-requisite stamp/s….. You lose!)SQLCloud: XBox One-S with Forza Horizon 3 Bundle; Amazon Fire TV with 4K Ultra HD; Raspberry Pi 3 Starter Kit; dbWatch: Apple iPad Mini; Skybow: Marshall Speaker; Coeo: A free place on any Coeo training course, RRP £600; Edison365: Helicopter ride (lunchtime session prize) and a Fire TV Stick; Pyramid Analytics: Amazon Echo; Quest: Samsung Gear S2 Smartwatch; DBPro/ SQLGovernor: Splash-proof JBL bluetooth speaker; Redgate: SQL Monitor License - with 12 months support and upgrades; Axioworks: Amazon Echo Dot; Idera: $100 Amazon card; Lightning Tools: Lego Technics Race Car; SQL Sentry: SQL Sentry license and 1 year of support (worth $2994); Locke Data: R for Data Science: Import, Tidy, Transform, Visualize, and Model Data; SharePoint Unite /BMM Media: A free pass to SharePoint Unite 2017 conference in Haarlem, Netherlands, on the 25th & 26th October. worth €699. travel and hotel not included; PASS: Recording (download) of all sessions from PASS Summit 2016
28 Social Make sure you tweet on #spscambridge or #sqlsatcambridge During the event we have Giant Jenga, Sack races and Conker Fights!After event, join us for a post event SharePint/ SQLPint from our barDon’t forget to thank Sponsors, Volunteers and Speakers!The event will close at 6.30pm