The Mass Storage System at JLAB - Today and Tomorrow Andy Kowalski

Jefferson Lab Farm and Mass Storage Systems 2000 FCAL (100MByte) 100 mbit 1000 mbit SCSI From Hall A,C DAQ From CLAS DAQ Work File Servers Cache File Servers DST/Cache File Servers Tape Servers Batch and Interactive Farm DB Server

Farm Total Batch Farm SPECint Dual Processor Linux Systems 4 - Dual Processor Solaris Systems 5 Interactive Farm Systems 1 - Quad Processor Linux System 2 – Dual Processor Linux Systems 2 – Quad Processor Solaris Systems

Disk Storage MetaStor (Work) File Servers – Qty MB Memory 100mbit Ethernet Ultra Wide SCSI RAID Systems RAID-5 Disk Space – 4TB FS3/FS4 - 1TB FS5/FS6 - 3TB Serving NFS User Managed Disk Space

Disk Storage cont. Linux (Cache) File Servers – Qty. 9 Dual 650/700MHz Systems 512MB ECC Memory Gigabit Ethernet Mylex PCI RAID controller RAID-0 Disk Space – 5.8TB Qty. 4 with 400GB Qty. 5 with 876GB Linux (Red Hat 6.2) pre11-va1.1smp Serving NFS Automatically Managed Disk Space

Tape Storage StorageTek PowderHorn tape mounts per hour Holds 6000 tapes Redwood Tape Drives – Qty. 8 50GB tape capacity 10MB/second 9840 Tape Drives – Qty GB tape capacity 10MB/second

Tape Storage cont. Open Storage Manager Computer Associates dropped support January 2000 Not distributed Two installations – mss1 and mss2 TapeServer Front-End Written in Java Makes two OSM servers act as one Stages data to/from disk from/to tape A user interface

Jefferson Lab Farm and Mass Storage Systems 2001 FCAL (100MByte) 100 mbit 1000 mbit SCSI From Hall A,C DAQ From CLAS DAQ Work File Servers Cache File Servers DST/Cache File Servers Batch and Interactive Farm DB Server Tape Servers

Projects JASMine Replacement for OSM Distributed Data Movers and Cache Managers Scalable to the needs of the experiments Smart scheduling Off-site cache or ftp servers for data exporting

Projects cont. File Exports JASMine Cache Software GRID Aware - PPDG FTP BBFTP WEB Tape

JASMine Logical Storage Organization Store A logical entity made up of libraries, servers, data movers, and a database. Storage Group An object that belongs to a store and is itself a collection of storage groups or volume sets. Volume Set An object that belongs to a storage group and is itself a collection of volumes. Volume A unit of storage media. Bitfile The copy of a file that has been copied into a store.

Storage Group 2 Store Storage Group 1 Volume Set 1 Volume Set 2 Storage Group 3 Storage Group 4 Storage Group 5 Vol Volume Set 3 Volume Set 4 Volume Set 5 Vol Bitfiles

JASMine Physical Storage Organization Store A logical entity made up of libraries, servers, data movers, and a database. Library A set of volumes and drives. Drive A media reader or writer. Volume A unit of storage media.

JASMine Services Request Manager Handles user requests and queries. Scheduler Prioritizes user requests for tape access. priority = share / (.01 + (num_a * ACTIVE_WEIGHT) + (num_c * COMPLETED_WEIGHT) ) Log Manager Writes out log and error files and databases. Sends out notices for failures. Library Manager Mount and dismounts tapes as well as other library related tasks.

JASMine Services 2 Data Mover Dispatcher Keeps track of available local resources and starts requests the local system can work on. Cache Manager Manages a disk or disks for pre-staging data to and from tape. Sends and receives data to and from clients. Volume Manager Manages tapes for availability. Drive Manager Manages tape drives for usage.

Dispatcher Cache Manager Drive Manager DriveDisk Library Manager Volume Manager Client Request Manager Scheduler Data Mover Log Manager Library Manager Database Request Manager

What to Expect in 2001 Work File Servers Additional 5 TB Linux File Servers?? Cache File Servers Additional 5-10TB

2001 cont. Tape Storage JASMine Installed 5-10 Data Movers 10 Additional Tape Drives (9840 or 9940)

The End