© 2012 House of Brick Technologies, LLC Virtualizing Business Critical SQL Servers Tips, Tricks, and Other Goodies to Ensure Your Success SQL Saturday.

Slides:



Advertisements
Similar presentations
Housekeeping Utilities for VMware. 11 June Housekeeping is preparing meals for oneself and family and the managing of other domestic concerns.
Advertisements

Key Metrics for Effective Storage Performance and Capacity Reporting.
Capacity Planning in a Virtual Environment
2  Industry trends and challenges  Windows Server 2012: Beyond virtualization  Complete virtualization platform  Improved scalability and performance.
Ravi Sankar Technology Evangelist | Microsoft
Ed Duguid with subject: MACE Cloud
Virtualisation From the Bottom Up From storage to application.
VSphere 4 Best Practices/ Common Support Issues Paul Hill Research Engineer, System Management VMware.
© 2010 VMware Inc. All rights reserved Confidential Performance Tuning for Windows Guest OS IT Pro Camp Presented by: Matthew Mitchell.
VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.
High memory instances Monthly SLA : Virtual Machines Validated & supported Microsoft workloads Price reduction: standard Windows (22%) & Linux (29%)
MCITP Guide to Microsoft Windows Server 2008 Server Administration (Exam #70-646) Chapter 11 Windows Server 2008 Virtualization.
Denny Cherry MVP, MCSA, MCDBA, MCTS, MCITP.
VMware Infrastructure Alex Dementsov Tao Yang Clarkson University Feb 28, 2007.
Microsoft Virtual Server 2005 Product Overview Mikael Nyström – TrueSec AB MVP Windows Server – Setup/Deployment Mikael Nyström – TrueSec AB MVP Windows.
VIRTUALIZATION AND YOUR BUSINESS November 18, 2010 | Worksighted.
Virtualization for Cloud Computing
Virtualization 101.
Virtualization Infrastructure Administration Cluster Jakub Yaghob.
Windows Server Virtualization Scenarios And Features Jeff Woolsey Lead Program Manager Windows Virtualization Microsoft Corporation.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Windows Server Virtualization Infrastructure Planning and Design Series.
VMware vCenter Server Module 4.
Virtualization 101.
Scalability Module 6.
Virtualization Performance H. Reza Taheri Senior Staff Eng. VMware.
1 © 2001, Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID 8.6(2) OVAs UCBU Platform Team.
VMware vSphere 4 Introduction. Agenda VMware vSphere Virtualization Technology vMotion Storage vMotion Snapshot High Availability DRS Resource Pools Monitoring.
Tales from the Trenches About
Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.
How to Resolve Bottlenecks and Optimize your Virtual Environment Chris Chesley, Sr. Systems Engineer
SAIGONTECH COPPERATIVE EDUCATION NETWORKING Spring 2010 Seminar #1 VIRTUALIZATION EVERYWHERE.
SAIGONTECH COPPERATIVE EDUCATION NETWORKING Spring 2009 Seminar #1 VIRTUALIZATION EVERYWHERE.
Virtualization. Virtualization  In computing, virtualization is a broad term that refers to the abstraction of computer resources  It is "a technique.
Module 7: Hyper-V. Module Overview List the new features of Hyper-V Configure Hyper-V virtual machines.
Don’t Panic DBAs – Databases On VMware Made Easy Kathy Gibbs Senior Database Administrator, CONFIO Software.
VMware Infrastructure 3 The Next Generation in Virtualization.
Virtualization By Tim Ausburn & James Cantrell. Virtualization: Why? Reduce IT Costs Server consolidation Application Isolation Increase Server Utilization.
Improving Disk Latency and Throughput with VMware Presented by Raxco Software, Inc. March 11, 2011.
COMS E Cloud Computing and Data Center Networking Sambit Sahu
Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.
Never Down? A strategy for Sakai high availability Rob Lowden Director, System Infrastructure 12 June 2007.
Minneapolis / St. Paul Computer Measurement Group – Spring Virtual(ization) Reality Check James (Jim) Vence Technical Solutions Manager IBM Global.
Server Virtualization & Disaster Recovery Ryerson University, Computer & Communication Services (CCS), Technical Support Group Eran Frank Manager, Technical.
Consolidation and Optimization Best Practices: SQL Server 2008 and Hyper-V Dandy Weyn | Microsoft Corp. Antwerp, March
VMware vSphere Configuration and Management v6
© Copyright 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted Module 7.
Cloud Computing Lecture 5-6 Muhammad Ahmad Jan.
Capacity Planning in a Virtual Environment Chris Chesley, Sr. Systems Engineer
1 Best Practices for Monitoring Databases on VMware Dean Richards Senior DBA, Confio Software.
REMINDER Check in on the COLLABORATE mobile app Best Practices for Oracle on VMware - Deep Dive Darryl Smith Chief Database Architect Distinguished Engineer.
Module Objectives At the end of the module, you will be able to:
Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.
1 SQL Server on VMware? Rob Mandeville Senior DBA, Confio Software 1 Virtualizing Our Environment: Lessons Learned Rob Mandeville.
Sql Server Architecture for World Domination Tristan Wilson.
Virtualization Fundamentals for DBAs Joey D’Antoni February 3, 2015 DBA Fundamentals VC.
1 SQL Server on VMware? Rob Mandeville Senior DBA, Confio Software.
vSphere 6 Foundations Beta Question Answer
VSPHERE 6 FOUNDATIONS BETA Study Guide QUESTION ANSWER
Flash Storage 101 Revolutionizing Databases
Don’t Panic, DBAs! Databases on Vmware made easy Janis Griffin Senior DBA, Confio Software 1.
Anything But, Troubleshooting when it’s not SQL Server
Windows Server* 2016 & Intel® Technologies
Software Architecture in Practice
Optimizing SQL Server Performance in a Virtual Environment
Virtualization 101.
Microsoft Virtual Academy
Traditional Virtualized Infrastructure
Successfully Virtualizing SQL Server on vSphere: Straight from the Source M2 technical Deck ( ) Randy Knight SQL Solutions Group Founder.
Presentation transcript:

© 2012 House of Brick Technologies, LLC Virtualizing Business Critical SQL Servers Tips, Tricks, and Other Goodies to Ensure Your Success SQL Saturday Kansas City - August 4, 2012 David Klee – Solutions Architect Andy Galbraith – Technical Consultant

© 2012 House of Brick Technologies, LLC About House of Brick  14 year old Omaha-based company  Leader: Tier-1 VMware, Database Performance  Rock-solid reputation for optimizing the entire system stack to maximize Tier-1 performance  House of Brick key service value components  Hybrid/private cloud architectures for complex Tier-1 workloads  Legacy to virtualization, and private/hybrid cloud system replatforming  SQL Server and Oracle virtualization specialties  Short term assessments and proof-of-concept projects  Long-term project analysis, PM, implementation, & validation

© 2012 House of Brick Technologies, LLC

About Us  SQL Server on VMware team lead  Experience in VMware, Microsoft, Linux, networking, security, application development technologies David  SQL Server Consultant  Experience in SQL Server, clustering, performance tuning Andy

© 2012 House of Brick Technologies, LLC Agenda  Why Virtualize Business Critical SQL Servers?  Physical Stack Fundamentals  VM-Layer Fundamentals  Designing the New Infrastructure  Performance Baselining, Benchmarking, and Monitoring  Disaster Recovery, High Availability

© 2012 House of Brick Technologies, LLC Your Trends  Do you have a virtualization strategy?  Have you tried to virtualize SQL Server?  Was it successful?  Are your production SQL Servers virtual?  Why not?  Do you have a plan for 100% virtual Tier-1?

© 2012 House of Brick Technologies, LLC Six Reasons to Virtualize  Consolidation  Near 100% reliable Disaster Recoverability (DR)  Product release cycle optimization  High Availability (HA)  Cost Reduction, including license optimization  Security

© 2012 House of Brick Technologies, LLC Tier-1 vs. Everything Else Tier-2/3Tier-1 - Business Critical Workloads The Chasm

© 2012 House of Brick Technologies, LLC Myth – Cannot Run Tier-1 Virtualized  Common concerns  Performance  Licensing  Support  Database size  Most problems: I/O  Most Difficult Problem: Environmental, not technical Apples to Apples Proofing Environment?

© 2012 House of Brick Technologies, LLC Performance Concerns  Dev and QA traditionally isolated  Separate servers  Hardware partitioning  Avoid “Noisy Neighbor” problem  The new paradigm  x86 commodity hardware  vSphere DRS  Lower CAPEX  vSphere benchmarks  2008 – 102K IOPs, 1.4% I/O wedge  2010 – 1M IOps, 100 microsecond wedge

© 2012 House of Brick Technologies, LLC Licensing Concerns Dedicated SQL Server vSphere clustervSphere SQL Server Sub-cluster  Maximum consolidation  Maximum SQL Server license optimization  Maximum utilization of vSphere tooling  Frequently reduces SQL Server license requirements  Consolidation ratios tend to be lower than dedicated SQL Server clusters

© 2012 House of Brick Technologies, LLC Support Concerns  Policy for support of VMware published for years  Officially supported via Server Virtualization Validation Program (SVVP)  Known issues support  VMware Customer Support Statement and TSANet   Official support statement  VMware offers full support and total ownership

© 2012 House of Brick Technologies, LLC Database Size Myths  Database size has no impact on performance. Period.  Database performance factors  Execution counts  Concurrent connections  SQL I/O access paths  Large database concerns  Backup/Recovery throughput  DR operations  One-time migration  No distinction between physical and virtual

© 2012 House of Brick Technologies, LLC Licensing (SQL Server 2008)  Consolidation Rules (SQL Server 2008/2008 R2)  Datacenter Edition – Unlimited VMs if all sockets in host are licensed  Enterprise Edition – 4 VMs per license if all sockets in host are licensed

© 2012 House of Brick Technologies, LLC Licensing (SQL Server 2012)  Consolidation Rules (SQL Server 2012)  There is no more Datacenter Edition  Enterprise Edition  Unlimited consolidation if and only if:  All cores (not sockets) in host are licensed  Software assurance (SA)  Without SA, only 1 VM/core license  Minimum of 4 core licenses required per socket, even if only single or dual core  Unlimited VMs with SA if upgrading from SQL Server 2008 EE + SA

© 2012 House of Brick Technologies, LLC Licensing Details  When VMs move, licenses don’t necessarily move with them:  With Standard Edition, licenses can only proactively move once every 90 days in a non-failover situation.  With Enterprise and Datacenter Editions, you have unlimited license mobility rights  2012 also require Software Assurance (SA) for unlimited mobility!  For more details on licensing SQL Server on vSphere, refer to Microsoft.com:  2008R2: SQL2008R2_LicensingQuickReference-updated.pdf  2012: SQL Server 2012 Licensing Quick Reference Guide.pdf  NOTE: Licensing Individual VMs is different!  Still must obey 4 core minimum!

© 2012 House of Brick Technologies, LLC Virtual Storage Presentation  Virtual Machine Disk (VMDK/VMFS)  Preferred for Tier-1  Maximum ESXi-level storage tooling  Raw Device Mapping–Virtual (RDM-V)  More configuration and operations overhead  Reduced ESXi-level storage tooling  RDM-P  Maximizes SAN-level tooling transparency  Even less ESXi-level storage tooling  No snapshots or vMotion  Direct-mounted (In-guest iSCSI)  No ESXi-level storage tooling  vMotion works

© 2012 House of Brick Technologies, LLC Tier-1 Analysis - Profiling Physical  CPU – Count, Speed, Average, and Peak Utilization  Memory – Amount, Utilization, Active  Windows Perfmon – CPU, RAM, Network, Disks statistics  Disk Performance  Storage Benchmarking  Environmental Growth Planning  SQL Server health check

© 2012 House of Brick Technologies, LLC Tier-1 Analysis – Storage  SQLIO – I/O performance and latency benchmark  Throughput metrics:  IOs/sec  MBs/sec  Latency metrics:  Avg. (ms): < 25  Microsoft Download: SQLIO Disk Subsystem Benchmark Tool  tools.davidklee.net – SQLIO Analyzer

© 2012 House of Brick Technologies, LLC Tier-1 Analysis – Storage  IOMeter – I/O Performance Stressor  Source: SQLPASS 2011 DBA-413-M Slide 48

© 2012 House of Brick Technologies, LLC Tier-1 Analysis – Perfmon  Memory: Available Mbytes, Pages / sec, Page Faults / sec  Processor: % Processor Time  Physical Disk: Disk Read Bytes/sec and Disk Write Bytes/sec  System: Processor Queue Length  SQL Server: Databases: Transactions / sec  SQL Server: SQL Statistics: SQL Compilations / sec, SQL Re-Compilations / sec, Batch Requests / sec

© 2012 House of Brick Technologies, LLC Now What?  Design your virtual environment carefully.  Scale Up? More vHardware on less VMs.  Scale Out?  More VMs?  More instances on less VMs?

© 2012 House of Brick Technologies, LLC Atomic Workloads

© 2012 House of Brick Technologies, LLC VMware Hardware Configuration  Disable BIOS “green” settings (power savings, etc.)  Ensure CPUs are set to high performance mode  Enable virtualization extensions (i.e. Intel VT-x)  Disable Automatic Server Recovery (HP)  Enable Hyper-Threading (Intel)  64-bit VMs preferred (32-bit is soon to be extinct)

© 2012 House of Brick Technologies, LLC Tier-1 - vCPU  Start conservative. Do not over-allocate vCPUs.  vCPU Ready Time  300ms average  500ms high water mark CPU measures the amount of time a virtual machine waits in the queue in a ready-to-run state before it can be scheduled on a CPU. Higher wait times result in slower virtual machine performance.

© 2012 House of Brick Technologies, LLC Tier-1 - vMemory  Full RAM reservations for production Tier-1 workloads  Do NOT oversubscribe  Do NOT over-allocate host RAM  No ballooning allowed! (Don’t disable balloon driver)

© 2012 House of Brick Technologies, LLC Tier-1 - vStorage  Performance is top priority  RAID-10 or RAID-5  I’ll repeat. Performance is TOP priority.  Independence Rule. Design for absolute workload object independence  Monitor usage and split workloads if red lines are exceeded  Can go down to one disk group per LUN  Can go down to one LUN per VMware datastore  Can go down to one datastore per virtual hard drive file (VMDK)

© 2012 House of Brick Technologies, LLC Tier-1 - vStorage  Storage performance attributes  <30ms average I/O latency times  <50% average spindle busy  >60MB/s sustained writes (at a bare minimum after piercing cache)

© 2012 House of Brick Technologies, LLC Tier-1 - vStorage  Paravirtual (PVSCSI) Driver  Multipathing Drivers  EMC PowerPath VE  Equallogic MPIO  Profiling with benchmarking tools  SQLIO  IOMeter

© 2012 House of Brick Technologies, LLC Tier-1 - vStorage  Disk block alignment ( not just a Windows 2003 problem )  ( 46% sequential I/O, 24% random I/O performance improvement)  1MB offset usually works great

© 2012 House of Brick Technologies, LLC Installing a SQL Server Instance  Object separation can optimize:  Performance  Disaster recovery  Backup  Licensing

© 2012 House of Brick Technologies, LLC Configuring a SQL Server Instance  Enable Lock Pages in Memory  Enable Instant File Init  Use Large Pages – Trace Flag 834  VM RAM Reservation  Memory Provisioned  SQL Server memory + OS + VM overhead  Set “Max Server Memory” and “Min Server Memory”  Enable Optimize for Ad-hoc Workloads

© 2012 House of Brick Technologies, LLC Monitoring Performance  Perfmon / IOMeter / SQLIO / DVDStore  vCenter Statistics  SQL Server health checks  sqlserverperformance.wordpress.com  brentozar.com/blitz  bradmcgehee.com/healthcheck.zip  Benchmark and compare to baselines (physical and virtual)  Remember to update your baselines when the configuration changes!

© 2012 House of Brick Technologies, LLC MSFC Clustering vs. VMware HA  Four MSFC evaluation criteria:  Less than four minute SLA? then  Rolling maintenance utilized  Cluster-aware middle tier?  Does technical expertise exist to support clustering? Criteria answers = “Yes” Consider clustered SQL Server on VMware HA Otherwise Other options exist

© 2012 House of Brick Technologies, LLC SQL Server 2012  AlwaysOn + VMware = Complementary technologies  Blurs line between HA and DR  Best of MSFC and Mirroring  Current best practices directly apply to 2012  Watch your licensing

© 2012 House of Brick Technologies, LLC Questions

© 2012 House of Brick Technologies, LLC SQL Server Virtualization Tips, Tricks, and Other Goodies to Ensure Your Success SQL Saturday Kansas City – August 4, 2012 David Klee – Solutions Architect Andy Galbraith – Technical Consultant