Hosted by Designing a Backup Architecture That Actually Works W. Curtis Preston President/CEO The Storage Group.

Slides:



Advertisements
Similar presentations
Computing Infrastructure
Advertisements

© 2010 Quest Software, Inc. ALL RIGHTS RESERVED Quest vRanger / Architecture.
Chapter 20 Oracle Secure Backup.
XenData SXL-5000 LTO Archive System Turnkey video archive system with near-line LTO capacities scaling from 210 TB to 1.18 PB, designed for the demanding.
XenData SX-520 LTO Archive Servers A series of archive servers based on IT standards, designed for the demanding requirements of the media and entertainment.
Tag line, tag line Protection Manager 4.0 Customer Strategic Presentation March 2010.
STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES IT Services Storage And Backup Low Cost Central Storage (LCCS) January 9,
1 Advanstor TM. Company Confidential 2 Business issues driving change in data protection Data is growing at 100% per year Weekend backup windows are non-existent.
Data Protection, Availability and Replication Andreas Tsangaris CTO, Performance Technologies.
NetBackup 6.0 What’s New. What’s New in NetBackup 6.0 Management and Reporting Core Product Enhancements Disk Management and Optimization Additional NetApp.
A match made in heaven?. Who am I? Richard Barlow Systems Architect and Engineering Manager for the Virginia Credit Union Worked in IT for almost 20 years.
Windows Azure Conference 2014 Hybrid Cloud Storage: StorSimple and Windows Azure.
Barracuda Backup Service Data Backup and Disaster Recovery.
Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
Backups George Hewitt BCS Teesside - 8 th Feb 2012.
How to Cluster both Servers and Storage W. Curtis Preston President The Storage Group.
1© Copyright 2013 EMC Corporation. All rights reserved. EMC AVAMAR FOR NAS ENVIRONMENTS Backup, recovery, and disaster recovery for network-attached storage.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Transaction log grows unexpectedly
Navigating the Oracle Backup Maze Robert Spurzem Senior Product Marketing Manager
BACKUP/MASTER: Immediate Relief with Disk Backup Presented by W. Curtis Preston VP, Service Development GlassHouse Technologies, Inc.
NovaBACKUP 10 xSP Technical Training By: Nathan Fouarge
IBM TotalStorage ® IBM logo must not be moved, added to, or altered in any way. © 2007 IBM Corporation Break through with IBM TotalStorage Business Continuity.
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 14: Problem Recovery.
Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗
Module 3 - Storage MIS5122: Enterprise Architecture for IT Auditors.
Storage Area Networks The Basics. Storage Area Networks SANS are designed to give you: More disk space Multiple server access to a single disk pool Better.
DBI336. Applications Microsoft Data ONTAP ™ Powershell Toolkit for Integration and Automation FlexClone ® for Rapid Provisioning ApplianceWatch for Health.
Database Storage Considerations Adam Backman White Star Software DB-05:
Backup and Restore CPTE 433 John Beckett. Why Back Up? So you can restore later! SLA Restore Policy Backup Policy Backup Schedule.
Making Reliable and Restorable Backups
Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.
Best Practices for Backup in SAN/NAS Environments Jeff Wells.
Windows Servers.  HP Advanced Model (7.5 Unit) model 3 - $5912  ML 350 Chassis, Tower Form Factor  Dual-Core Intel Xeon 5140 Processor (IA64)  5 Gb.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
Meeting the Data Protection Demands of a 24x7 Economy Steve Morihiro VP, Programs & Technology Quantum Storage Solutions Group
Optimal Storage Architecture and Design for Disaster Avoidance KCCMG Fall 2003 Rob Peglar Chief Architect, XIOtech Corporation
Confidential1 Introducing the Next Generation of Enterprise Protection Storage Enterprise Scalability Enhancements.
4/23/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
1 I 2 S - Allianz plc internal Innovation Award. 2 Allianz plc I 2 S Awards, 2009.
1 U.S. Department of the Interior U.S. Geological Survey Contractor for the USGS at the EROS Data Center EDC CR1 Storage Architecture August 2003 Ken Gacke.
BACKUP/GETTING STARTED: Backup School Presented by: W. Curtis Preston VP, Services Development GlassHouse Technologies.
JLAB Computing Facilities Development Ian Bird Jefferson Lab 2 November 2001.
Hosted by Minimizing the Impact of Storage on Your Network W. Curtis Preston President The Storage Group.
Cosc 4750 Backups Why Backup? In case of failure In case of loss of files –User and system files Because you will regret it, if you don’t. –DUMB = Disasters.
Arcserve ® Backup Enterprise-class protection for small & mid-size+ businesses  File-based backup to disk, tape & cloud (Amazon, Azure, Cloudian, Eucalyptus,
Protecting SharePoint with System Center Data Protection Manager 2007 Chris Whitehead Premier Field Engineer Microsoft UK.
Hosted by Creating RFPs for Tape Libraries Dianne McAdam Senior Analyst and Partner Data Mobility Group.
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
OpenStorage Training Introduction to NetBackup
CDP Competitive analysis of FalconStor CONFIDENTIAL DO NOT REDISTRIBUTE.
19 Copyright © 2004, Oracle. All rights reserved. Database Backups.
What is raid? RAID is the term used to describe a storage systems' resilience to disk failure through the use of multiple disks and by the use of data.
CommVault Architecture
PHD Virtual Technologies “Reader’s Choice” Preferred product.
File-System Management
XenData SX-10 LTO Archive Appliance
Storage Area Networks The Basics.
Integrating Disk into Backup for Faster Restores
Maintaining Windows Server 2008 File Services
2018 Real Dell EMC E Exam Questions Killtest
The Google File System Sanjay Ghemawat, Howard Gobioff and Shun-Tak Leung Google Presented by Jiamin Huang EECS 582 – W16.
XenData SX-550 LTO Archive Servers
CS703 - Advanced Operating Systems
VMware Backup - Free edition
Enterprise Class Virtual Tape Libraries
Improving performance
Presentation transcript:

Hosted by Designing a Backup Architecture That Actually Works W. Curtis Preston President/CEO The Storage Group

Hosted by What will we cover? What are the design options? LAN-based, LAN-free, Client-free, Server-free NDMP Using disk in your backup system What should I do with them? Sizing your server

Hosted by What are the design options?

Hosted by SAN: LAN-free, Client-free, and Server-free backup NAS: NDMP filer to self, filer to filer, filer to server, & server to filer

Hosted by LAN-based backups Standard method Central backup server with network clients backing up across the LAN Simplest, least expensive design

Hosted by LAN-free backups How does this work? SCSI Reserve/Release Third-party queuing system Levels of drive sharing Restores

Hosted by Client-free backups Backup transaction logs to disk Establish backup mirror Split backup mirror and back it up

Hosted by Client-free restores

Hosted by Server-free backups Server directs client to take a copy-on-write snapshot Client and server record block and file associations Server sends XCOPY request to SAN

Hosted by Server-less Restores Changing block locations Image level restores File level restores

Hosted by Backing up a filer: NDMP Filer to self Filer to filer Filer to server Server to filer Similar to server-free backups

Hosted by Using NDMP Level of functionality depends on the DMA and filer vendors Robotic Support Filer to Library Support Filer to Server Support Direct access restore support Image level backup

Hosted by Using disk ATA-based storage arrays as low as $5/GB (disk only, needs filesystem) Special function arrays Quantum DX-30 looks and behaves like a Quantum P1000. Can be used as target for “tape-based” backups (3 usable TB, $55K list, or $18/GB) NetApp R100 looks like other NetApp filer. Target for SnapVault and disk-based backups, source for SnapMirror (9+ usable TB, $175K list, or $18/GB)

Hosted by First Step: Backup to disk Use as a target for all incremental backups. (Full, too, if you can afford it) For off-site storage, duplicate all disk-based backups to tape. Leave disk-based backups on disk.

Hosted by Second Step: Mirror to disk Use “dumb” arrays and smart volume managers and replication software. Use smart arrays with replication built into them. Most valuable methods have built in point-in-time snapshots. Mirror to disk, then backup to tape, or mirror to another disk!

Hosted by Sizing the backup system

Hosted by Give it enough power Not enough tape drives Tape drives that aren’t fast enough Not enough slots in the tape library Not enough bandwidth to the server

Hosted by Don’t give it too much power Streaming tape drives must be streamed If you don’t, you will wear out your tape drives and decrease aggregate performance Must match the speed of the pipe to the speed of the tape You can actually increase your throughput by using fewer tape drives

Hosted by Server Size/Power I/O performance more important than CPU power CPU, memory, I/O expandability paramount Avoid overbuying by testing prospective server under load

Hosted by Catalog/database Size Determine number of files (n) Determine number of days in cycle (d) (A cycle is a full backup and its associated incremental backups) Determine daily incremental size (i = n *.02) Determine number of cycles on-line (c) bytes per file, per backup Use a 1.5 multiplier for growth and error Index Size = (n + (i*d)) * c * 250 * 1.5

Hosted by Number of Tape Drives – All Tape LAN-based Backup Buy twice as many backup drives as your network will support Use only as many drives as the network will support (You will get more with less) Use the other half of the drives for duplicating

Hosted by Number of Drives – Disk/Tape Combo LAN-based Backup Buy disk system large enough to satisfy entire on-site retention period without deletion. Buy enough tape drives to duplicate each night’s backups. Duplicate each night’s backups to tape, then take them out and send them offsite. Library should be large enough to hold three to four days of backups. (Only needs to hold duplicated tapes until they’re sent off-site.)

Hosted by Number of Drives – LAN-Free backup Most large servers have enough I/O bandwidth to back themselves up within a reasonable time Usually a simple matter of mathematics: 8 hr window, 8 TBs = 1 TB/hr = 277 MB/s Mb/s drives, MB/s drives Must have sufficient bandwidth to tape drives Filesystem vs. raw recoveries Allow drives and time for duplicating

Hosted by Library Size - slots (all tape environment) Should hold all onsite tapes On-site tapes automatically expire and get reused Only offsite tapes require phys. mgmt. Should monitor library via a script to ensure that each pool has enough free tapes before you go home Watch for those downed drive messages

Hosted by Library Size - slots (disk/tape environment) Do all backups to disk wherever possible. Library only needs to hold the latest set of copies (three or four days worth). Disk-based backups automatically expire and space gets reused. Only off-site tapes require phys. mgmt. Should monitor library and disk via a script to ensure that each pool has enough free space before you go home Watch for those downed drive messages

Hosted by Configuring your server Backup all drives. Make sure you are streaming your drives. Create an automated monitoring system. Establish standards wherever possible, and use them!

Hosted by Resources

Hosted by Resources Directories of products to help you build a better backup system Send questions to:

Hosted by Thank you! W. Curtis Preston President/CEO The Storage Group