DBI313. MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly.

Slides:



Advertisements
Similar presentations
Windows Azure IaaS – Deep Dive
Advertisements

SQL Server Primary SQL Server Secondary SLA SLA High Availability Hardware and Software Windows and Linux.
Microsoft Azure Overview
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.
Workload Characterization Sept. 23 rd, 2008 CSCI 8710.
Azure Services Platform Piotr Zierhoffer. Agenda Cloud? What is Azure? Environment Basic glossary Architecture Element description Deployment.
OS and Hardware Tuning. Tuning Considerations Hardware  Storage subsystem Configuring the disk array Using the controller cache  Components upgrades.
Virtualized Workloads Supported Instant Messaging (IM) IM Conferencing Presence Enterprise Voice (PSTN) Audio/Video Conferencing Web Conferencing.
Chapter 9 Overview  Reasons to monitor SQL Server  Performance Monitoring and Tuning  Tools for Monitoring SQL Server  Common Monitoring and Tuning.
Name Title Microsoft Windows Azure: Migrating Web Applications.
VM Role (PaaS)Virtual Machine (IaaS) StorageNon-Persistent StoragePersistent Storage Easily add additional storage DeploymentBuild VHD offsite and upload.
Migrating Applications to Windows Azure Virtual Machines Michael Washam Senior Technical Evangelist Microsoft Corporation.
CONTROL COST-EFFICIENCY SharePoint (On-premises) SharePoint Value Prop Full h/w control – size/scale Roll-your-own HA/DR/scale Value Prop 100% of.
Lecture 11: DMBS Internals
Components of Windows Azure - more detail. Windows Azure Components Windows Azure PaaS ApplicationsWindows Azure Service Model Runtimes.NET 3.5/4, ASP.NET,
Introduction To Windows Azure Cloud
Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.
Windows Azure Virtual Machines Speaker Title Organization.
Dr Greg Low CEO and Principal Mentor SQL Down Under.
On Premises Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime You manage Infrastructure (as a Service) Storage.
Microsoft Azure Virtual Machines. Networking Compute Storage Virtual Machine Operating System Applications Data & Access Runtime Provision & Manage.
Larisa kocsis priya ragupathy
Profiling Grid Data Transfer Protocols and Servers George Kola, Tevfik Kosar and Miron Livny University of Wisconsin-Madison USA.
DCIM211. By 2015, 35% of enterprise IT expenditures for most organizations will be managed outside the IT department’s budget IT budget.
Windows Azure Conference 2014 Designing Applications for Scalability.
A Measurement Based Memory Performance Evaluation of High Throughput Servers Garba Isa Yau Department of Computer Engineering King Fahd University of Petroleum.
Lugano Microsoft Azure Overview Ken Casada Technical Evangelist Microsoft Switzerland
Emil VelinovNicholas Dritsas Senior Program ManagerPrincipal Program Manager Windows Azure Customer Advisory Team (AzureCAT) Microsoft Corporation.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
Windows Azure Virtual Machines Anton Boyko. A Continuous Offering From Private to Public Cloud.
North America Europe Asia Pacific Data centers.
Introduction: Memory Management 2 Ideally programmers want memory that is large fast non volatile Memory hierarchy small amount of fast, expensive memory.
Rick Claus Sr. Technical Evangelist,
Zvezdan Pavković. Storage Non-Persistent Storage Persistent Storage Easily add additional storage. Networking Internal and Input Endpoints configured.
Cloud Computing is a Nebulous Subject Or how I learned to love VDF on Amazon.
Total CapacityTotal Request RateTotal Bandwidth (Geo-redundant) Total Bandwidth (Locally Redundant) 500 TB20,000 / sec10 gb/sec Ingress 20 gb/sec.
Tweak Performance and Improve Availability of your Microsoft Azure VMs Rick
On Premises Storage Servers Networking O/S Middleware Virtualization Data Applications Runtime You manage Infrastructure (as a Service) Storage Servers.
DMBS Internals I February 24 th, What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
DMBS Architecture May 15 th, Generic Architecture Query compiler/optimizer Execution engine Index/record mgr. Buffer manager Storage manager storage.
Maximizing Performance – Why is the disk subsystem crucial to console performance and what’s the best disk configuration. Extending Performance – How.
Windows Server 2012R2 is the best platform for mission-critical SQL Server workloads (OLTP, DW, and BI) with better scalability, performance, and availability.
Rick Claus Architect like a PRO for Performance and Availability of your Microsoft Azure VMs ARC43 6.
What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently and safely. Provide.
1 Lecture 16: Data Storage Wednesday, November 6, 2006.
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
Making a Difference with Azure Storage Solutions Dudu Sinai.
Dr Greg Low CEO and Principal Mentor SQL Down Under.
SharePoint 2010 Performance and Capacity Planning Best Practices
A Day in the Life of a Row Eddie Wuerch, mcm
Lecture 16: Data Storage Wednesday, November 6, 2006.
Section 6: SQL Server on IaaS Best Practices
Database Management Systems (CS 564)
SQL Server Internals Overview
Data Warehouse in the Cloud – Marketing or Reality?
Windows Azure Migrating SQL Server Workloads
Design and Implement Cloud Data Platform Solutions
Software Architecture in Practice
Lecture 11: DMBS Internals
Lecture 9: Data Storage and IO Models
CS 140 Lecture Notes: Technology and Operating Systems
HC Hyper-V Module GUI Portal VPS Templates Web Console
TechEd /28/ :16 PM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Cloud computing mechanisms
Persistence: hard disk drive
Troubleshooting Techniques(*)
TrueSight Capacity December 13, 2018 Architecture Review Mike West.
Hybrid Buffer Pool The Good, the Bad and the Ugly
Presentation transcript:

DBI313

MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly writes, requires low latency IO size and patternBetween 8 and 64K, mostly random 1 64KB read per 8 512KB reads, Mostly sequential MB/s a critical metric Highly sequential # usershighlown/a

… Datacenter network … Datacenter 1 Datacenter n Region 1 Region 2 …

Instances Roles Cloud Service is a management, configuration, security, networking and service model boundary Stateless Roles : Web/Worker Role – requires 2 or more instances Persistent Roles : Virtual Machine can work with single instance

Single Public IP Per Cloud Service Endpoint Public Port Local Port Protocol (TCP/UDP) Name Port Forwarding Endpoint Set Public Port Local Port Protocol (TCP/UDP) Name Load Balanced Sets Custom Load Balancer Health Probes -Health check with probe timeouts, HTTP based probing, allowing granular control of health checks

Virtual Machine C:\ OS Disk E:\, F:\, etc. Data Disks D:\ Temporary Disk Dynamic VHD RAM Cache Local Disk Cache Blobs Blob

Virtual Machine Size CPU CoresMemory Disk Space for Virtual Machines Allocated Bandwidth (Mbps) Maximum data disks (1 TB each) Maximum IOPS (500 maximum per disk) ExtraSmallShared768 MB20 GB511x500 Small11.75 GB70 GB10022x500 Medium23.5 GB135 GB20044x500 Large47 GB285 GB40088x500 ExtraLarge814 GB605 GB x500 A6428 GB285 GB1,00088x500 A7856 GB605 GB2, x500

Stream Layer Partition Layer Front-ends LB Stream Layer Partition Layer Front-ends LB Geo-replication Storage Service Locations

Disk typeRead OnlyRead WriteNone (disabled) OS diskSupportedDefault modeNot supported Data diskSupported (up to 4) Default mode Temporary diskImplemented using local attached storage Read Only: All requests cached for future reads. All writes persisted directly to Windows Azure Storage Read Write: Reads cached for future access. Non-write-through writes persisted to local cache first. For SQL Server, writes are persisted to WA storage because it uses Write-through - Lowest disk latency for light workloads None (disabled): Bypasses cache. All disk transfers persisted to Windows Azure Storage -Highest I/O rate for I/O intensive workloads -Also consider TX cost

Random I/O (8KB Pages) Sequential I/O (64KB Extents) Sequential I/O (256KB Blocks) ReadsWritesReadsWritesReadsWrites IOPS Bandwidth4 MB/s 30 MB/s20 MB/s70 MB/s

4 disksRandom I/O (8KB Pages)Sequential I/O (64KB Extents)Sequential I/O (256KB Blocks) ReadsWritesReadsWritesReadsWrites IOPS Bandwidth20 MB/s 120 MB/s80 MB/s170 MB/s270 MB/s 16 disksRandom I/O (8KB Pages)Sequential I/O (64KB Extents)Sequential I/O (256KB Blocks) ReadsWritesReadsWritesReadsWrites IOPS Bandwidth60 MB/s 150 MB/s300 MB/s170 MB/s600 MB/s 8 disksRandom I/O (8KB Pages)Sequential I/O (64KB Extents)Sequential I/O (256KB Blocks) ReadsWritesReadsWritesReadsWrites IOPS Bandwidth30 MB/s 150 MB/s160 MB/s170 MB/s550 MB/s

Typical User/test characteristics Number of concurrent users Average/Max request execution time Number of web servers Ramp up period, test method Start and end time of test

Issue KPIs To MonitorActions to Consider CPU at or near 80% % Processor Time (_Total) SOS_SCHEDULER_YIELD waits Increase instance size Identify top consuming queries and tune Load balance (e.g. move DB to another instance) Near I/O capacity limits or IO Latency Increases Average disk reads per second Average disk writes per second Disk reads per second Disk writes per second io_virtual_file_stats PAGEIOLATCH waits SQL Server: Buffer Manager\Page Life Expectancy Check Page Life Expectancy counter, for mem pressure. Increase instance size Identify which DB and log files have I/O bottleneck Add more data disks and separate data files if near IOPS limits per disk Tune queries to reduce reads and writes Consider enabling row or page compression Memory resource pressure Memory: Available Bytes Memory: Pages per second SQL Server: Buffer Manager\Page Life Expectancy Process: Working Set (for SQL Server) RESOURCE_SEMAPHORE waits Check max server memory setting for SQL Server. Use high memory instance Identify SQL component (such as, CLR, high memory grants for app queries, et.), tune appropriately.

Head to... aka.ms/te