5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data.

5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data Platform Group © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda Microsoft Data Platform SQL Server in Azure Virtual Machine
Performance and Sizing High Availability and Disaster Recovery Storage and Connectivity Deployment Best Practices Seamless database upgrade and migrations © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Most consistent experience across on-premises and cloud
Microsoft Data Platform CONSISTENT DATA PLATFORM FOR POWERFUL HYBRID SCENARIOS Easy migration to cloud Always On Availability Groups in Azure Scale out Business Intelligence Hybrid Business Analytics Backup and Disaster Recovery Most consistent experience across on-premises and cloud

Consistent data platform across on-premises and cloud
Least vulnerable and proven data platform across all environments Develop once and deploy anywhere Common tools for development and management Common T-SQL surface area Simple cloud migration Single vendor for support PaaS Azure SQL Database Azure SQL Data Warehouse IaaS SQL Server (DW) in Azure VM SQL Server in Azure VM On-premises SQL Server SQL Server (DW) Reference Architecture

What is an Azure Virtual Machine
Load balancer routes the incoming connection to your virtual machine The compute (CPU & RAM) are separated from the storage The virtual machine issues operations to the storage

SQL Server in Azure VM – Deployment Options
5/20/2018 5:18 AM SQL Server in Azure VM – Deployment Options Microsoft Gallery Images SQL Server 2008 R2 / 2012 / 2014 / 2016 / 2017 SQL Server Web / Standard / Enterprise / Developer / Express Windows Server 2008 R2 / 2012 R2 / 2016 Linux RHEL / Ubuntu SQL Licensing Based on SQL Edition and # Core (VM Sizes) Pay-per Minute Bring Your Own License Through BYOL Images License Mobility Creates in ~10 Minutes Connect via RDP, ADO .Net, OLEDB, JDBC, PHP, … Manage Via Portal, SSMS, Powershell, CLI, System Center, …. Free Licenses Refreshed for every CU, CTP Release & Critical Hotfixes © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DSv2 has 25% more storage bandwidth
5/20/2018 5:18 AM VM Sizes DSv2 has 25% more storage bandwidth Table here DS v2 , DS & FS Series VM Recommended for SQL production workloads Local SSD storage Premium Storage Portal Optimizes VM for SQL Server workloads GS Series , Ls-Series VM Local SSD Storage Intel® Xeon® processor E5 v3 family. VM Size CPU cores Memory Max Cached IOPs/ MBPs Max Uncached IOPS/MBPs DS1_v2 1 3.5 GB 4,000/32 3,200/48 DS2_v2 2 7 GB 8,000/64 6,400/96 DS3_v2 4 14 GB 16,000/128 12,800/192 DS4_v2 8 28 GB 32,000/256 25,600/384 DS5_v2 16 56 GB 64,000/512 51,200/768 DS11_v2 DS12_v2 DS13_v2 DS14_v2 112 GB DS15_v2 20 140 GB 80,000/640 64,000/960 GS1 2 28 GB 10,000/100 5000/125 GS2 4 56 GB 20,000/200 10,000/250 GS3 8 112 GB 40,000/400 20,000/500 GS4 16 224 GB 80,000/800 40,000/1,000 GS5 32 448 GB 160,000/1,600 80,000/2,000 Highest storage bandwidth in cloud Dedicated host Certified for 16 TB DW © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Memory-optimized VMs 5/20/2018 5:18 AM Ev3–SERIES
2.3 GHZ–BROADWELL PROCESSOR REGIONS: All VM size vCPU’s Memory: GiB Local SSD: GiB Persistent Data Disks Max Network Bandwidth Dedicated GPU? Backend Network? E2_v3 2 16 32 4 High N/A E4_v3 64 8 E8_v3 128 E16_v3 256 Very High E32_v3 512 Extremely High E64_v3 434 868 M–SERIES 2.5 GHZ–HASWELL PROCESSOR REGIONS: US–W2, US–E2, EU–N, EU–W VM size vCPU’s Memory: TB Local SSD: TB Persistent Data Disks Max Network Bandwidth Dedicated GPU? Backend Network? M64ms 64 1.75 2 Extremely high No M128s 128 4 M128ms 3.5 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure VM – Availability
5/20/2018 5:18 AM Azure VM – Availability An Azure Availability Set distributes VMs in different failure domains (racks) and upgrade domains VMs are not impacted at the same time by Rack/Host failures Azure Host upgrades Managed disks Distributes disks of different VMs to different storage stamps Higher isolation for AlwaysOn or SQL HA © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

High Availability Configure Azure load balancer and backend pool
5/20/2018 5:18 AM High Availability Provision a DC replica (separate Availability Set) Relaxing Windows Cluster failure detection for transient network failure Configure Cluster to Ignore Storage Configure Azure load balancer and backend pool IP address of listener Parameter Fast Failover (Default) Relaxed Maximum SameSubnetDelay 1 second 2 seconds SameSubnetThreshold 5 heartbeats 20 heartbeats 120 heartbeats (Get-cluster).SameSubnetThreshold = 20 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server Disaster Recovery
Always On hybrid capabilities Store Database backups in Geo Replicated Readable Storage Restore backups in a remote region (~30 min) Availability Group Options Configure Azure as remote Region for On-premise Configure On-Premise as DR for Azure Replica in Azure Remote Region Failover to Remove in (~30s) Offload remote reads Azure Virtual Network 1 REGION 1 Azure Virtual Network 2 REGION 2 Manual Failover Automatic Failover Secure Tunnel Primary Availability Group Availability Group S1 S2 VM VM Listener Client App

Automated Configuration
5/20/2018 5:18 AM Automated Configuration Optimization to a target workload (OLTP / DW) Automated Patching and Shutdown Automated Backup SQL Server AlwaysOn High Availability Now protects system dbs & provides custom scheduling © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure VM - Storage Options
5/20/2018 5:18 AM Azure VM - Storage Options Locally Redundant Storage (LRS) Zone Redundant Storage (ZRS) Geographically Redundant Storage (GRS) Read-Access Geographically Redundant Storage (RA-GRS) How it works Makes multiple synchronous copies of your data within a single datacenter Stores three copies of data across multiple datacenters within or across regions. For block blobs only. Same as LRS, plus multiple asynchronous copies to a second datacenter hundreds of miles away Same as GRS, plus read access to the secondary datacenter Total copies 3 6 Why use it For economical local storage or data governance compliance An economical, higher durability option for block blob storage For protection against a major datacenter outage or disaster Provides read access to data during an outage, for maximum data availability and durability Availability SLA 99.9% read/write 99.9% write % read © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure VM - Storage Each disk has 3 copies in Azure Storage
5/20/2018 5:18 AM Azure VM - Storage Each disk has 3 copies in Azure Storage An extent is replicated 3 times across different fault and upgrade domains With random selection for where to place replicas for fast MTTR Remote storage connected over high speed network Quorum-write Checksum all stored data Verified on every client read Scrubbed every few days Automated disk verification and decommissioning Re-replicate on disk/node/rack failure or checksum mismatch © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure VM – Premium Storage
5/20/2018 5:18 AM Azure VM – Premium Storage Backup of a 2 TB SQL Server database is 6x faster Premium Storage is high performance Solid State Drive (SSD) based Storage designed to support I/O intensive workloads with significantly high throughput and low latency. Solid-State Drives (SSDs) 5000 IOPs or 200 MB/s per disk Avg Less than 5 ms Support local read cache (SSD) Avg 1m latency Frees VM bandwidth to Azure storage (for Log) Restore of a 2 TB SQL Server database is 30x faster Write throughput 2x more as compared to mid-level SAN © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure VM - Connectivity
5/20/2018 5:18 AM Azure VM - Connectivity Over the Internet Over secure site-to-site tunnel On public connection Dedicated connection (Express Route) - Recommended Apps Transparently connect to Primary via Listener Listeners are supported through Azure Load balancer Internal (VNET) or External (Internet) Hybrid (Vnet to Vnet) © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

ExpressRoute Providers 5/20/2018 5:18 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Azure VM – Many layers of security
5/20/2018 5:18 AM SQL Azure VM – Many layers of security Physical Security Infrastructure Security Many certifications! SQL Security Data centers monitored all the time Microsoft Ops and Support personnel don’t have access to customer storage Virtual Networks – Deployments are isolated in their own private networks Storage – Encrypted Storage and authenticated via strong keys ISO 27001/27002, SOC 1/SSAE 16/ISAE 3402 and SOC 2, Cloud Security Alliance CCM, FISMA, HIPAA, EU Model Clauses, FIPS 140-2, … Auto Patching Encryption of Databases and Backups Encryption of connections Authentication: Windows / SQL Row-level Security & Always Encrypted (SQL Server 2016) Keys can be stored in Azure Key Vault © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Security Center

5/20/2018 5:18 AM VM configuration Use minimum DS3_V2 for SQL Enterprise and DS2_V2 for SQL Standard Make storage decisions Storage account in same region IOPs limit per disk Bytes/sec bandwidth restrictions exist At Minimum use 2 Premium P30 disks for data/log. Estimate the IOP/Bandwidth Needs Storage Pool for more Throughput Do not use System Drive Enable Read caching for Premium Disk for data files and Tempdb 64K NTFS Allocation Unit Size Azure portal optimizes this for you Turn off Geo-Replication on storage account © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

SQL Server configuration
Enable Instant file initialization Enable read caching on data/tempdb drives Enable Locked Pages Enable data page compression If tempdb is very write intensive put it on local SSD Disable auto-shrink for your databases Backup to URL with compressed backups No databases on temporary drive Move all databases to data disks, including system databases (separate data and log) Move SQL Server error log and trace file directories to data disks

Instant File Initialization
5/20/2018 5:18 AM Workload Performance Standard v/s Premium Instant File Initialization © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Seamless database upgrade and migrations
1 Database Migration Guide Database Upgrade and Migration Tools Seamless database upgrade and migrations 2 Data Migration Tools 3 Azure Database Migration Service

Database Migration Guide
One-stop-shop guide for database migrations Step-by-step guidance from by source and target Recommended Partners, Customer case studies

Migration Tools & Services
Microsoft Build 2017 5/20/2018 5:18 AM BRK2213 – Database migration roadmap with Microsoft 11:30 AM - 12:15 PM Hyatt Plaza International H Migration Tools & Services Assess Migrate Data Migration Assistant Rich assessments at scale Feature recommendations Schema conversions Azure Database Migration Service MS and non-MS source support Built for scale and reliability Built with enterprise security and privacy © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Reliable & Seamless migrations to the Cloud
Azure Database Migration Service Fully managed database migration service for both operational databases and data warehouses Supports minimal down time migrations Supports both homogeneous and heterogeneous source-target pairs Assessments via Data Migration Assistant SQL SQL DB SQLDB or SQL VM SQL Server SQL Server Azure SQL VM, Azure SQL Database & Managed Instance MySQL Azure Database for MySQL PostgreSQL Azure Database for PostgreSQL Oracle, … Azure SQL Database & Managed Instance Netezza, … Azure SQL Data Warehouse Oracle MySQL … Note: For more information, contact Reliable & Seamless migrations to the Cloud

Azure Database Migration Service
5/20/2018 5:18 AM Azure Database Migration Service © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Databases on selected VMs
Azure Backup Azure Storage / Vault SQL Login to Azure Portal Discover Databases on selected VMs Configure Backup Policy

Benefits Long Term Retention Freedom from Infrastructure
5/20/2018 5:18 AM Benefits Note: For more information, contact Freedom from Infrastructure Long Term Retention Single Management pane Standard backup policy Cost-Effective Consolidated alerts 15min RPO Custom Reports Point in Time Restore AG Support… © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Enterprise Backup Services

Customers using SQL Server on Azure VMs
Microsoft Consumer Channels and Central Marketing Group 5/20/2018 5:18 AM Customers using SQL Server on Azure VMs © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/20/2018 5:18 AM Session resources Getting Started with SQL Server in Azure Virtual Machines Provisioning a SQL Server Virtual Machine on Azure How to create a SQL Server virtual machine in Azure using the existing on-premises SQL Server virtual machine Performance Best Practices for SQL Server in Azure Virtual Machines High Availability and Disaster Recovery for SQL Server in Azure Virtual Machines Tutorial: AlwaysOn Availability Groups in Azure (GUI) © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session
Tech Ready 15 5/20/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite Phone: download and use the Microsoft Ignite mobile app Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

IAAS vs PAAS SQL Server in Azure VM SQL Server Managed Instance
SQL Database NEW* It’s a VM! Migrate Fleet of Databases Fully managed Database Management of OS and SQL Server Security Isolation with Azure VNet Active Learning and Optimization Select Version, OS, Edition Application Surface Compatibility SQL Agent, Profiler Cross DB querying, CLR, Replication, CDC, Service Broker End to End Integration Single VM availability SLA: 99.9% (<43 min downtime p/month) Multi-VM availability SLA: 99.95% (<21 min downtime p/month) Intelligent Data Protection & Security Database sizes up to 35TB Application & Data Modernization Minimize Migration Downtime Up to 4 TB single Databases > using Elastic Scale Geo-DR Database availability SLA: 99.99%

SQL Server in Azure VM – Monitoring
Microsoft Consumer Channels and Central Marketing Group 5/20/2018 5:18 AM SQL Server in Azure VM – Monitoring Evaluates ~100 best practices Monitor SQL Perf Counters in Azure Portal Operations Insights Portal Plus: - System Center - DMVs, Profiler, XEvents © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Cheat Sheet **Use Storage Spaces on Windows Server 2012 and above and OS striping for Windows Server 2008/R2 Change column count to appropriately for your storage spaces configuration. Premium Storage Disk Type P10 P20 P30 Disk size 128 GiB 512 GiB 1024 GiB (1 TB) IOPS per disk 500 2300 5000 Throughput per disk 100 MB per second * 150 MB per second * 200 MB per second *

Windows Azure Storage Stamps
Access blob storage via the URL: Storage Location Service Data access LB Storage Stamp LB Partition Layer Front-Ends Stream Layer Intra-stamp replication Storage Stamp Front-Ends Partition Layer Inter-stamp (Geo) replication Stream Layer Intra-stamp replication © 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Storage Stamp Architecture – Stream Layer
Append-only distributed file system All data from the Partition Layer is stored into files (extents) in the Stream layer An extent is replicated 3 times across different fault and upgrade domains With random selection for where to place replicas for fast MTTR Checksum all stored data Verified on every client read Scrubbed every few days Re-replicate on disk/node/rack failure or checksum mismatch Stream Layer (Distributed File System) M M Paxos M Extent Nodes (EN)

Storage Stamp Architecture – Partition Layer
Provide transaction semantics and strong consistency for Blobs, Tables and Queues Stores and reads the objects to/from extents in the Stream layer Provides inter-stamp (geo) replication by shipping logs to other stamps Scalable object index via partitioning Partition Master Lock Service Partition Layer Partition Server Partition Server Partition Server Partition Server M Stream Layer M Paxos Extent Nodes (EN) M

Storage Stamp Architecture
Stateless Servers Authentication + authorization Request routing Storage Stamp Architecture Front End Layer FE FE FE FE FE Partition Master Lock Service Partition Layer Partition Server Partition Server Partition Server Partition Server M M Paxos Stream Layer M Extent Nodes (EN)

Storage Stamp Architecture
Incoming Write Request Ack Front End Layer FE FE FE FE FE Partition Master Lock Service Partition Layer Partition Server Partition Server Partition Server Partition Server M M Paxos Stream Layer M Extent Nodes (EN)

5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data.

Similar presentations

Presentation on theme: "5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data.

Similar presentations

Presentation on theme: "5/20/2018 5:18 AM BRK3229 Running Tier 1 workloads on SQL Server on Microsoft Azure Virtual Machines Ajay Jagannathan Principal PM Manager Microsoft Data."— Presentation transcript:

Similar presentations

About project

Feedback