Denny Cherry twitter.com/mrdenny

Slides:



Advertisements
Similar presentations
Copyright © 2006 Quest Software SQL 2005 Disk I/O Performance By Bryan Oliver SQL Server Domain Expert.
Advertisements

Agenda Speaker bio Fundamentals of Disk Hardware Architecture and Disk Sector Alignment Fundamentals of the Hardware Architecture Basics of IO, or Acronym.
Denny Cherry twitter.com/mrdenny.
RAID: Redundant Array of Inexpensive Disks Supplemental Material not in book.
RAID Redundant Array of Independent Disks
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
© 2009 EMC Corporation. All rights reserved. EMC Proven Professional The #1 Certification Program in the information storage and management industry Data.
1 CSC 486/586 Network Storage. 2 Objectives Familiarization with network data storage technologies Understanding of RAID concepts and RAID levels Discuss.
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
Chapter 3 Presented by: Anupam Mittal.  Data protection: Concept of RAID and its Components Data Protection: RAID - 2.
Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.
Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.
Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.
Denny Cherry twitter.com/mrdenny.
I/O Systems and Storage Systems May 22, 2000 Instructor: Gary Kimura.
Denny Cherry twitter.com/mrdenny.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
SQL SERVER DAYS 2011 Optimizing SQL Server Performance in a Virtual Environment Denny Cherry twitter.com/mrdenny.
BACKUP/MASTER: Immediate Relief with Disk Backup Presented by W. Curtis Preston VP, Service Development GlassHouse Technologies, Inc.
Sponsored by: PASS Summit 2010 Preview Storage for the DBA Denny Cherry MVP, MCSA, MCDBA, MCTS, MCITP.
DISKS IS421. DISK  A disk consists of Read/write head, and arm  A platter is divided into Tracks and sector  The R/W heads can R/W at the same time.
Chapter 10 : Designing a SQL Server 2005 Solution for High Availability MCITP Administrator: Microsoft SQL Server 2005 Database Server Infrastructure Design.
Day 10 Hardware Fault Tolerance RAID. High availability All servers should be on UPSs –2 Types Smart UPS –Serial cable connects from UPS to computer.
SQL Server, Storage and You Part 1: Storage Basics Wes Brown.
Hardware (The part you can kick). Overview  Selection Process  Equipment Categories  Processors  Memory  Storage  Support.
Introducing Snap Server™ 700i Series. 2 Introducing the Snap Server 700i series Hardware −iSCSI storage appliances with mid-market features −1U 19” rack-mount.
N-Tier Client/Server Architectures Chapter 4 Server - RAID Copyright 2002, Dr. Ken Hoganson All rights reserved. OS Kernel Concept RAID – Redundant Array.
RAID REDUNDANT ARRAY OF INEXPENSIVE DISKS. Why RAID?
Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.
Module – 4 Intelligent storage system
IBM System Storage™ DS3000 Series
1 Selecting LAN server (Week 3, Monday 9/8/2003) © Abdou Illia, Fall 2003.
Denny Cherry twitter.com/mrdenny.
Denny Cherry Senior Database Administrator / Architect Awareness Technologies Quest Software SQL Server MVP MCSA, MCDBA, MCTS,
RAID Disk Arrays Hank Levy. 212/5/2015 Basic Problems Disks are improving, but much less fast than CPUs We can use multiple disks for improving performance.
11 Intel Modular Server Understanding the Storage MFSYS25 MFSYS35.
Storage and Backup Overview 15 February 2016TCS Internal.
SQL SERVER DAYS 2011 Indexing Internals Denny Cherry twitter.com/mrdenny.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
RAID Tony Rogerson SQL Server MVP Torver Computer Consultants
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
Optimizing SQL Server Performance in a Virtual Environment Denny Cherry twitter.com/mrdenny.
CS422 Principles of Database Systems Disk Access Chengyu Sun California State University, Los Angeles.
Silberschatz, Galvin and Gagne ©2013 Operating System Concepts – 9 th Edition Chapter 10: Mass-Storage Systems.
Indexing strategies and good physical designs for performance tuning Kenneth Ureña /SpanishPASSVC.
© 2009 EMC Corporation. All rights reserved. Why do we need RAID o Performance limitation of disk drive o An individual drive has a certain life expectancy.
System Storage TM © 2007 IBM Corporation IBM System Storage™ DS3000 Series Jüri Joonsaar Tartu.
Understanding Storage Systems and SQL Server Wes Brown.
Integrating Disk into Backup for Faster Restores
Using non-volatile memory (NVDIMM-N) as block storage in Windows Server 2016 Tobias Klima Program Manager.
Chapter 12: Mass-Storage Structure
Optimizing SQL Server Performance in a Virtual Environment
Database Administration for the Non-DBA
RAID Disk Arrays Hank Levy 1.
RAID RAID Mukesh N Tekwani
Chapter 12: Mass-Storage Systems
CHECO Fall 2013 Conference ERP Storage – What Works, What Does Not Presenter: Rick Beck, Director, IT Application Services September 17, 2013.
RAID Disk Arrays Hank Levy 1.
CSE 451: Operating Systems Winter 2009 Module 13 Redundant Arrays of Inexpensive Disks (RAID) and OS structure Mark Zbikowski Gary Kimura 1.
ظرفیت سنجی دستگاه های ذخیره ساز در مراکز داده
Virtualization and Cloud Computing
Mark Zbikowski and Gary Kimura
CSE 451: Operating Systems Winter 2012 Redundant Arrays of Inexpensive Disks (RAID) and OS structure Mark Zbikowski Gary Kimura 1.
Optimizing SQL Server Performance in a Virtual Environment
Denny Cherry twitter.com/mrdenny
RAID Disk Arrays Hank Levy 1.
RAID RAID Mukesh N Tekwani April 23, 2019
Microsoft Virtual Academy
Presentation transcript:

Denny Cherry mrdenny@mrdenny.com twitter.com/mrdenny Storage for the DBA Denny Cherry mrdenny@mrdenny.com twitter.com/mrdenny

About Me Author or Coauthor of 5 books 8+ SQL Mag articles Dozens of other articles Microsoft MVP Microsoft Certified Master Independent Consultant Founder of SQL Excursions

Agenda Storage Terminology Array Cache Setup RAID Types Tiered Storage Disk Alignment Spindle Types Physical Array Diagram

Storage Terminology LUN = Logical Unit Number Host = The Server or Servers a LUN is presented to SAN = Storage Area Network Fabric = Fibre network which makes up the SAN Array = Box with the Spindles in it

Storage Terminology Disk = How the OS sees a LUN when presented Spindle = Physical disks in the Storage Array IOps = Physical Operation To Disk Sequential IO = Reads or writes which are sequential on the spindle Random IO = Reads or writes which are located at random positions on the spindle

Array Cache Setup OLTP databases make poor use of SAN read cache OLAP databases make good use of SAN read cache Try reducing read cache and increasing write cache OLTP databases with high buffer cache hit ratios may be able to have the read cache disabled There is no one correct setup. Every system is different.

When Write Cache Gets Full? Doesn’t flush to disk until low watermark is hit Force flushes once high watermark is hit Force flushing completely empties write cache Force flushing disables write cache until write cache is disabled If adjustable, set low very low, and high watermark very high (20/90) If cache gets to 100% full – Pray!

Oh crap the power went out! Most arrays have internal batteries Write cache is flushed to disk After flush array powers down On power-up flushed cached is read and committed to LUNs before LUN is made available Make sure SQL is down before the array flushes http://www.flickr.com/photos/robertfrancis/352039299/

RAID 0 Straight Stripe No redundancy Very fast Low cost Any disk failure looses data Can not survive no disks failures Requires 2 or more disks

RAID 1 Full Mirror of data No performance Benefit High Cost Requires 2 disks Can survive 1 disk failure

RAID 0+1 Drives Striped, then Mirrored High Cost High Performance Requires 2 disks Can survive 1 spindle failure Requires even number of disks May survive multiple spindle failure

RAID 10 (1+0) Drives Mirrored, then Striped High Cost High Performance Requires 2 disks Can survive 1 spindle failure Requires even number of disks May survive multiple spindle failure

RAID 5 Low Cost Requires 3+ disks Write Penalty Stripe with Single Parity Can survive a single drive failure Write Penalty Good Performance

Not all RAID 5 is Created Equal RAID 6 can be done this way as well.

RAID 6 Stripe with 2 parity Higher cost per gig than RAID 5 Requires 4+ disks Can survive 2 disk failures Similar penalty as RAID 5

Disk Alignment Can improve SQL disk performance up to 100% (64 1k blocks/64k IO)=100% of IO is impacted Must be done before data is put on the disk Windows 2000 - Diskpar Windows 2003 - Diskpart Windows 2008 - Automatic

Disk Alignment

Tiered Storage Time is Money http://www.flickr.com/photos/21560098@N06/3832712784/

Tiered Storage Tier 0 Enterprise Flash Disks low capacity drives Very high cost Very high speed storage Great for Databases http://commons.wikimedia.org/wiki/File:Speedometer_Odometer.jpg

Tiered Storage Tier 1 15k RPM Fibre Channel low capacity drives High cost, high speed storage Great for Databases, Exchange, Virtual Machines http://commons.wikimedia.org/wiki/File:Speedometer_Odometer.jpg

Tiered Storage Tier 2 10k RPM Fibre Channel medium capacity drives Medium cost, medium speed storage Great for File Servers, Database Archives, Exchange http://commons.wikimedia.org/wiki/File:Speedometer_Odometer.jpg

Tiered Storage Tier 3 7.2/5.4k RPM SATA/SAS high capacity drives Low cost, low speed storage Great for Backups, Archives, Exchange http://commons.wikimedia.org/wiki/File:Speedometer_Odometer.jpg

Spindle Types Fibre Channel (FC) SCSI SATA Fastest Bus Speeds between 2-4 Gigs SCSI Older Technology, slower bus speeds SATA Newer Technology, even slower bus speeds Enterprise Flash Disks (EFDs) Newest Technology, same bus speeds as FC

Array Diagram

mrdenny@mrdenny.com http://itke.techtarget.com/sql-server Denny Cherry mrdenny@mrdenny.com http://itke.techtarget.com/sql-server