Terabyte IDE RAID-5 Disk Arrays David A. Sanders, Lucien M. Cremaldi, Vance Eschenburg, Romulus Godang, Christopher N. Lawrence, Chris Riley, and Donald.

Slides:

Advertisements

Similar presentations

Hardware Lesson 3 Inside your computer.

Advertisements

Computing Infrastructure

IT Essentials PC Hardware & Software v5.0

Preparing For Server Installation Instructor: Enoch E. Damson.

RAID- Redundant Array of Inexpensive Drives. Purpose Provide faster data access and larger storage Provide data redundancy.

RAIDRAID Rithy Chhay Shari Holstege CMSC 691X: UNIX Systems Administration.

Chapter 5: Server Hardware and Availability. Hardware Reliability and LAN The more reliable a component, the more expensive it is. Server hardware is.

An Overview of RAID Chris Erickson Graduate Student Department of Electrical and Computer Engineering Auburn University, Auburn, AL 36849

Novell Server Linux vs. windows server 2008 By: Gabe Miller.

HELICS Petteri Johansson & Ilkka Uuhiniemi. HELICS COW –AMD Athlon MP 1.4Ghz –512 (2 in same computing node) –35 at top500.org –Linpack Benchmark 825.

Teraserver Darrel Sharpe Matt Todd Rob Neff Mentor: Dr. Palaniappan.

Title US-CMS User Facilities Vivian O’Dell US CMS Physics Meeting May 18, 2001.

Introduction Lecture 1 CSCI 1405, CSCI 1301 Introduction to Computer Science Fall 2009.

Group 11 Pekka Nikula Ossi Hämäläinen Introduction to Parallel Computing Kentucky Linux Athlon Testbed 2

Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.

Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.

Gordon: Using Flash Memory to Build Fast, Power-efficient Clusters for Data-intensive Applications A. Caulfield, L. Grupp, S. Swanson, UCSD, ASPLOS’09.

Cluster Computers. Introduction Cluster computing –Standard PCs or workstations connected by a fast network –Good price/performance ratio –Exploit existing.

Cluster computing facility for CMS simulation work at NPD-BARC Raman Sehgal.

CLUSTER COMPUTING Prepared by: Kalpesh Sindha (ITSNS)

Day 10 Hardware Fault Tolerance RAID. High availability All servers should be on UPSs –2 Types Smart UPS –Serial cable connects from UPS to computer.

RHUL1 Site Report Royal Holloway Sukhbir Johal Simon George Barry Green.

The PC The PC is a standard computing platform, built around a EISA bus (1988) –IBM compatible –“Intel Architecture” from Intel or AMD or other companies.

Online Systems Status Review of requirements System configuration Current acquisitions Next steps... Upgrade Meeting 4-Sep-1997 Stu Fuess.

RAID Redundant Array of Inexpensive Disks. History Single Large Expensive Disk (SLED) Single Large Expensive Disk (SLED) IBM and Berkeley University IBM.

RAID REDUNDANT ARRAY OF INEXPENSIVE DISKS. Why RAID?

Local IBP Use at Vanderbilt University Advanced Computing Center for Research and Education.

Farm Management D. Andreotti 1), A. Crescente 2), A. Dorigo 2), F. Galeazzi 2), M. Marzolla 3), M. Morandin 2), F.

November 2, 2000HEPiX/HEPNT FERMI SAN Effort Lisa Giacchetti Ray Pasetes GFS information contributed by Jim Annis.

Linux Servers with JASMine K. Edwards, A. Kowalski, S. Philpott HEPiX May 21, 2003.

Sys Admin Course Physical Storage and File Systems Fourie Joubert.

00:07 Building Your Own PC Building Your Own PCBy David Palmer.

Inside your computer. Hardware Review Motherboard Processor / CPU Bus Bios chip Memory Hard drive Video Card Sound Card Monitor/printer Ports.

HPCVL High Performance Computing Virtual Laboratory Founded 1998 as a joint HPC lab between –Carleton U. (Comp. Sci.) –Queen’s U. (Engineering) –U. of.

21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.

6/26/01High Throughput Linux Clustering at Fermilab--S. Timm 1 High Throughput Linux Clustering at Fermilab Steven C. Timm--Fermilab.

Computer Basics Terminology - Take Notes. What is a computer? well, what is the technical definition A computer is a machine that changes information.

Experience with the Thumper Wei Yang Stanford Linear Accelerator Center May 27-28, 2008 US ATLAS Tier 2/3 workshop University of Michigan, Ann Arbor.

SLAC Site Report Chuck Boeheim Assistant Director, SLAC Computing Services.

Computer Guts and Operating Systems CSCI 101 Week Two.

CHEP04 Performance Analysis of Cluster File System on Linux Yaodong CHENG IHEP, CAS

O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Facilities and How They Are Used ORNL/Probe Randy Burris Dan Million – facility administrator.

Computer Systems. This Module Components Home PC Inputs Processor Memory Motherboards Auxiliary Storage Outputs.

Jefferson Lab Site Report Sandy Philpott Thomas Jefferson National Accelerator Facility (formerly CEBAF - The Continuous Electron Beam Accelerator Facility)

The Evolution Of Personal Home Computers 1980-Current TRS 80 Model 4P By Joshua Brutzkus.

General Computer Stuff Hardware: physical parts of a computer: CPU, drives, etc. Software: Programs and Data A computer needs both to be useful.

IDE disk servers at CERN Helge Meinhard / CERN-IT CERN OpenLab workshop 17 March 2003.

National HEP Data Grid Project in Korea Kihyeon Cho Center for High Energy Physics (CHEP) Kyungpook National University CDF CAF & Grid Meeting July 12,

RAL Site report John Gordon ITD October 1999

RAL Site Report John Gordon HEPiX/HEPNT Catania 17th April 2002.

TiBS Fermilab – HEPiX-HEPNT Ray Pasetes October 22, 2003.

The Computer System CS 103: Computers and Application Software.

ClinicalSoftwareSolutions Patient focused.Business minded. Slide 1 Opus Server Architecture Fritz Feltner Sept 7, 2007 Director, IT and Systems Integration.

Randy MelenApril 14, Stanford Linear Accelerator Center Site Report April 1999 Randy Melen SLAC Computing Services/Systems HPC Team Leader.

January 30, 2016 RHIC/USATLAS Computing Facility Overview Dantong Yu Brookhaven National Lab.

The 2001 Tier-1 prototype for LHCb-Italy Vincenzo Vagnoni Genève, November 2000.

Linux IDE Disk Servers Andrew Sansum 8 March 2000.

LSST Cluster Chris Cribbs (NCSA). LSST Cluster Power edge 1855 / 1955 Power Edge 1855 (*LSST1 – LSST 4) –Duel Core Xeon 3.6GHz (*LSST1 2XDuel Core Xeon)

1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.

RAID Presentation Raid is an acronym for “Redundant array of independent Drives”, or Redundant array of inexpensive drives”. The main concept of RAID is.

Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.

10/18/01Linux Reconstruction Farms at Fermilab 1 Steven C. Timm--Fermilab.

Bernd Panzer-Steindel CERN/IT/ADC1 Medium Term Issues for the Data Challenges.

Computer Hardware.

Berkeley Cluster Projects

CS111 Computer Programming

הכרת המחשב האישי PC - Personal Computer

Computer Selection - Hardware Components

QMUL Site Report by Dave Kant HEPSYSMAN Meeting /09/2019

Cluster Computers.

Presentation transcript:

Terabyte IDE RAID-5 Disk Arrays David A. Sanders, Lucien M. Cremaldi, Vance Eschenburg, Romulus Godang, Christopher N. Lawrence, Chris Riley, and Donald J. Summers University of Mississippi Donald L. Petravick Fermilab

Introduction $2000 per Terabyte Storage is Available Scalable for use at both Small and Large Institutions — From 1 TB to 250 TB, the same as a $ Million tape silo. Fast Access to Data Redundant — RAID5 Commodity Hardware

Data Storage Cake

Definitions RAID — Redundant Array of Inexpensive Disks RAID level 0 — Concatenation RAID level 1 — Mirroring RAID level 4 — Parity RAID level 5 — Striped-Parity EIDE — Enhanced Integrated Drive Electronics

Why Use Commodity Hardware?

Hardware System Disk — 40 GB Maxtor Eight 160 GB Maxtor Disks 2 Promise Ultra133 PCI cards 24” EIDE Cables CPU — 1.6 GHz AMD Athlon Motherboard — Asus A7M MB DDR memory Second Power Supply (15A at 12V)

RAID5 Box for BABAR

RAID5 Box for CMS

Disks

Software Linux Kernel (with >137 GB patch) (the latest stable kernel is the ) raidtools available with most distributions Journaling File systems (ext3) NFS to mount on other computers (Linux, Sun Solaris, DEC Ultrix, Mac OSX) HDPARM speed test (~95 MB/s) Simple write test (95 MB/s)

High Energy Physics Data Analysis Strategy Use Parallel Processing Split data and store on many RAID5 PCs Analysis for a subset of data takes place locally on the PC where the data resides Network is only used to combine results Or use NFS to mount RAID5 array on many PCs (Less efficient due to network overhead)

High Energy Physics Cluster

NFS Mounted Cluster

Future Plans Hardware: System Disk — 40 GB IBM Twelve 250 GB Maxtor Disks 3 Promise Ultra133 PCI cards CPU — Dual 2.0 GHz AMD Athlon Motherboard — Asus A7M266D Gigabit Ethernet Card Second Power Supply (15A at 12V) Software: Try Stock Linux Kernel Test other Journaling File systems (ReiserFS, xfs)

Commercial Systems *Based on suggested retail prices on February 7, 2003 From Apple document L26325A_XserveRAID_TO.pdf

Summary $2000 per Terabyte RAID5 arrays of EIDE Drives tested, without tape backup. They are Scalable —Cost less/TB than a tape silo, but scalable down to 1 TB. Uses Commodity Hardware. Tested with 160 GB hard disks Supported by the U.S. Department of Energy under DE-FG05-91ER40622 and DE-AC02-76CH03000.