DAS Last Update 2012.03.19 1.9.0 Copyright 2000-2012 Kenneth M. Chipps Ph.D. www.chipps.com 1.

Slides:



Advertisements
Similar presentations
Storage Management Lecture 7.
Advertisements

Redundant Array of Independent Disks (RAID) Striping of data across multiple media for expansion, performance and reliability.
Data Storage Solutions Module 1.2. Data Storage Solutions Upon completion of this module, you will be able to: List the common storage media and solutions.
What is RAID Redundant Array of Independent Disks.
1 Lecture 18: RAID n I/O bottleneck n JBOD and SLED n striping and mirroring n classic RAID levels: 1 – 5 n additional RAID levels: 6, 0+1, 10 n RAID usage.
RAID A RRAYS Redundant Array of Inexpensive Discs.
RAID Oh yes Whats RAID? Redundant Array (of) Independent Disks. A scheme involving multiple disks which replicates data across multiple drives. Methods.
RAID: Redundant Array of Inexpensive Disks Supplemental Material not in book.
RAID Redundant Array of Independent Disks
 RAID stands for Redundant Array of Independent Disks  A system of arranging multiple disks for redundancy (or performance)  Term first coined in 1987.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
RAID- Redundant Array of Inexpensive Drives. Purpose Provide faster data access and larger storage Provide data redundancy.
RAID Redundant Arrays of Inexpensive Disks –Using lots of disk drives improves: Performance Reliability –Alternative: Specialized, high-performance hardware.
1 CSC 486/586 Network Storage. 2 Objectives Familiarization with network data storage technologies Understanding of RAID concepts and RAID levels Discuss.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
WHAT IS RAID? Christopher J Dutra Seton Hall University.
Chapter 5: Server Hardware and Availability. Hardware Reliability and LAN The more reliable a component, the more expensive it is. Server hardware is.
Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
Disks CS 416: Operating Systems Design, Spring 2001 Department of Computer Science Rutgers University
CSE 451: Operating Systems Winter 2010 Module 13 Redundant Arrays of Inexpensive Disks (RAID) and OS structure Mark Zbikowski Gary Kimura.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
By : Nabeel Ahmed Superior University Grw Campus.
Storage System: RAID Questions answered in this lecture: What is RAID? How does one trade-off between: performance, capacity, and reliability? What is.
RAID Redundancy is the factor for development of RAID in server environments. This allows for backup of the data in the storage in the event of failure.
Module 3 - Storage MIS5122: Enterprise Architecture for IT Auditors.
D-Link International Private Limited Training and Staff Development Department Module : Network Attached Storage Module : Network Attached Storage.
Configuring File Services Lesson 6. Skills Matrix Technology SkillObjective DomainObjective # Configuring a File ServerConfigure a file server4.1 Using.
Managing Storage Lesson 3.
Redundant Array of Independent Disks
Day 10 Hardware Fault Tolerance RAID. High availability All servers should be on UPSs –2 Types Smart UPS –Serial cable connects from UPS to computer.
Architecture of intelligent Disk subsystem
Servers Last Update Copyright Kenneth M. Chipps Ph.D. 1.
N-Tier Client/Server Architectures Chapter 4 Server - RAID Copyright 2002, Dr. Ken Hoganson All rights reserved. OS Kernel Concept RAID – Redundant Array.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
Redundant Array of Inexpensive Disks aka Redundant Array of Independent Disks (RAID) Modified from CCT slides.
CSI-09 COMMUNICATION TECHNOLOGY FAULT TOLERANCE AUTHOR: V.V. SUBRAHMANYAM.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Guide to Linux Installation and Administration, 2e 1 Chapter 9 Preparing for Emergencies.
Local Area Networks (LAN) are small networks, with a short distance for the cables to run, typically a room, a floor, or a building. - LANs are limited.
Data Storage Methods Last Update Copyright Kenneth M. Chipps Ph.D. 1.
4.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 4: Organizing a Disk for Data.
Mark A. Magumba Storage Management. What is storage An electronic place where computer may store data and instructions for retrieval The objective of.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
Copyright © Curt Hill, RAID What every server wants!
"1"1 Introduction to Managing Data " Describe problems associated with managing large numbers of disks " List requirements for easily managing large amounts.
The concept of RAID in Databases By Junaid Ali Siddiqui.
1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
RAID Presentation Raid is an acronym for “Redundant array of independent Drives”, or Redundant array of inexpensive drives”. The main concept of RAID is.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
RAID TECHNOLOGY RASHMI ACHARYA CSE(A) RG NO
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
Configuring File Services
Multiple Platters.
Vladimir Stojanovic & Nicholas Weaver
Introduction To Computers
Introduction to Networks
Storage Virtualization
RAID RAID Mukesh N Tekwani
TECHNICAL SEMINAR PRESENTATION
UNIT IV RAID.
RAID RAID Mukesh N Tekwani April 23, 2019
Hard Drives & RAID PM Video 10:28
Storage Management Lecture 7.
Presentation transcript:

DAS Last Update Copyright Kenneth M. Chipps Ph.D. 1

Objectives of This Section Learn how to –Recognize what DAS is –Know when to use DAS –Use RAID and the levels of RAID Copyright Kenneth M. Chipps Ph.D. 2

What is DAS DAS – Directly Attached Storage is just another way of talking about hard drives contained inside a server or in a separate box directly attached to the server This distinction is made and the term DAS is used only in relation to the other forms of storage that will be discussed in the next few presentations In other words NAS, SAN, and SSP Copyright Kenneth M. Chipps Ph.D. 3

What is DAS So when you think of DAS, just think of a file server DAS can be one or more drives inside the server using SCSI, SAS – Serial Attached SCSI, SATA, or IDE or in a box directly attached to the server using SCSI, SAS – Serial Attached SCSI, or eSATA In this case these drives can be in one of two configurations Copyright Kenneth M. Chipps Ph.D. 4

What is DAS The first is JBOD – Just a Bunch of Disks –This is a collection of drives of the same or different size that contain the applications and data –This information can be contained on a single drive or it can span drives This method does nothing for fault tolerance, which is the ability to not loose data when a drive dies Copyright Kenneth M. Chipps Ph.D. 5

What is DAS The second way to configure a DAS is to use RAID – Redundant Array of Inexpensive Disks In this case capacity, fault tolerance, or both are increased RAID has been used since 1989 Copyright Kenneth M. Chipps Ph.D. 6

RAID RAID can be done in software or hardware Use the hardware version as discussed below Many server operating systems support software RAID, but using it is a bad idea –First is its reliance on the host CPU –Since software RAID runs on the host processor and uses system memory resources, there is a performance penalty Copyright Kenneth M. Chipps Ph.D. 7

RAID –Every compute cycle used to run software RAID drains bandwidth from the system's host processor and limits it from performing other tasks –Software RAID is also not bootable –Since the RAID functionality is contained within the operating system, it cannot mirror the operating system itself –Software RAID offers no protection from errors within the operating system Copyright Kenneth M. Chipps Ph.D. 8

RAID –Therefore, it cannot provide as high a level of reliability as RAID implemented outside the operating system To provide faster performance and greater fault tolerance drives can be linked together in a RAID array Copyright Kenneth M. Chipps Ph.D. 9

RAID Simple RAID subsystems are just a collection of disk drives in a cabinet that are all connected to a single controller board The RAID controller orchestrates read and write activities in the same way a controller for a single disk drive does, and treats the array as if it were in fact a single drive Copyright Kenneth M. Chipps Ph.D. 10

RAID RAID management software that resides in the host system provides the means to manage data to be stored on the RAID subsystem RAID can be optimized for performance, the highest capacity, fault tolerance or a combination of two or three of the above Copyright Kenneth M. Chipps Ph.D. 11

RAID Several RAID levels have been defined and standardized in accordance with those general optimization parameters Copyright Kenneth M. Chipps Ph.D. 12

RAID 0 An array configured as RAID Level 0 is an array optimized for performance, but at the expense of fault tolerance RAID Level 0 is achieved through a method known as striping The collection of drives in a RAID Level 0 array has data laid down in such a way that it is organized in stripes across all the drives Copyright Kenneth M. Chipps Ph.D. 13

RAID 0 A typical array can contain any number of stripes, usually in multiples of the number of drives present in the array As an example, imagine a four-drive array configured with 12 stripes - four stripes of designated space per drive Stripes 0, 1, 2 and 3 would be located on corresponding hard drives 0, 1, 2 and 3 Copyright Kenneth M. Chipps Ph.D. 14

RAID 0 Stripe 4, however, appears on a segment of drive 0 in a different location than Stripe 0; stripes 5 through 7 appear accordingly on drives 1, 2 and 3 The remaining four stripes are allocated in the same even fashion across the same drives Copyright Kenneth M. Chipps Ph.D. 15

RAID 0 The reason RAID 0 is a performance- enhancing configuration is that striping enables the array to access data from multiple drives at the same time In other words, since the data is spread out across a number of drives in the array, it can be accessed faster because it's not bottled up on a single drive Copyright Kenneth M. Chipps Ph.D. 16

RAID 0 This is especially beneficial for retrieving very large files, since they can be spread out effectively across multiple drives and accessed as if it were the size of any of the fragments it is organized into on the data stripes Copyright Kenneth M. Chipps Ph.D. 17

RAID 0 The downside to RAID Level 0 configurations is that it sacrifices fault tolerance, raising the risk of data loss because no room is made available to store redundant data If one of the drives in the RAID 0 fails for any reason, there is no way of retrieving the lost data Copyright Kenneth M. Chipps Ph.D. 18

RAID 1 The RAID Level 1 configuration employs what is known as disk mirroring, and is done to ensure data reliability or a high degree of fault tolerance RAID 1 also enhances read performance, but the improved performance and fault tolerance come at the expense of available capacity in the drives used Copyright Kenneth M. Chipps Ph.D. 19

RAID 1 In a RAID Level 1 configuration, the RAID management software instructs the controller to store data redundantly across a number of the drives in the array In other words, the same data is copied and stored on different disks or mirrored to ensure that, should a drive fail, the data is available somewhere else within the array Copyright Kenneth M. Chipps Ph.D. 20

RAID 1 In fact, all but one of the drives in a mirrored set could fail and the data would remain intact A read performance gain can be realized if the redundant data is distributed evenly on all of the drives of a mirrored set within the subsystem Copyright Kenneth M. Chipps Ph.D. 21

RAID 1 The number of read requests and total wait times both drop significantly Inversely proportional to the number of hard drives in the RAID For example, three read requests could be made Copyright Kenneth M. Chipps Ph.D. 22

RAID 1 The first request looks for data in the first block of the virtual drive, the second request goes to block 0, and the third seeks from block 2 Each request is then sent to the various drives The RAID management software can assign each read request to an individual drive Copyright Kenneth M. Chipps Ph.D. 23

RAID 1 So that rather than having to handle the flow of each data stream one at a time the controller can send three data streams almost simultaneously, which in turn reduces system overhead Copyright Kenneth M. Chipps Ph.D. 24

RAID 5 This is the last of the most common RAID levels in use, and is probably the most frequently implemented RAID Level 5 provides redundancy by interleaving parity check data with user data throughout the drive array This allows the system to recover any lost data should a single drive fail Copyright Kenneth M. Chipps Ph.D. 25

RAID 5 This is done by using the parity data to recreate any data lost by failure of a single drive Since all drives can be read simultaneously read performance is maximized Copyright Kenneth M. Chipps Ph.D. 26

RAID 5 Writing can be slower because of the need to also write parity information in addition to the data There is loss of storage space due to the need to store the parity information For example in a set of five 18GB hard drives, which totals 90GB of space, only 72GB of actual data can be stored Copyright Kenneth M. Chipps Ph.D. 27

Parity Here is what EMC says about parity from their book titled Information Storage and Management –Parity information can be stored on separate, dedicated HDDs or distributed across all the drives in a RAID set –Figure 3-4 shows a parity RAID Copyright Kenneth M. Chipps Ph.D. 28

Parity Copyright Kenneth M. Chipps Ph.D. 29

Parity –The first four disks, labeled D, contain the data –The fifth disk, labeled P, stores the parity information, which in this case is the sum of the elements in each row –Now, if one of the Ds fails, the missing value can be calculated by subtracting the sum of the rest of the elements from the parity value Copyright Kenneth M. Chipps Ph.D. 30

Other RAID Levels Some other RAID levels have been developed as custom solutions by independent vendors These are not established standards They have the usual risks of any proprietary solution Copyright Kenneth M. Chipps Ph.D. 31

Other RAID Levels RAID Level 6, which emphasizes ultra- high data integrity RAID Level also known as RAID Level 10 - which focuses on high I/O performance and very high data integrity In this method the data is striped, then mirrored Copyright Kenneth M. Chipps Ph.D. 32

Forms of RAID Here is a nice table from Storage magazine from May 2010 that shows all of the different types of RAID Copyright Kenneth M. Chipps Ph.D. 33

Forms of RAID Copyright Kenneth M. Chipps Ph.D. 34

Forms of RAID Copyright Kenneth M. Chipps Ph.D. 35

Other RAID Factors RAID Level 53, which combines RAID Level 0 and 3 for uniform read and write performance The final factor in a RAID system is the amount of cache - memory - on the RAID controller card The more memory the better since this speeds performance Copyright Kenneth M. Chipps Ph.D. 36

Problems with DAS DAS has limitations Primarily it does not scale easily It also cannot be separated very far from the server itself This is why the other methods have been developed Copyright Kenneth M. Chipps Ph.D. 37

Problems with DAS When the needs of the organization outgrow the size of the drive in the server, either a new server must be purchased, a bigger drive must be put in the server, or more drives must be added to the attached box All of this produces downtime and management problems Copyright Kenneth M. Chipps Ph.D. 38

Problems with DAS In particular you must manage the data on each server by its self Each server will require that –Volumes be setup –Rights assigned to files and directories –Data be backup –And so on Copyright Kenneth M. Chipps Ph.D. 39

Lab Let’s find a hot swappable RAID box Copyright Kenneth M. Chipps Ph.D. 40