Solaris Volume Manager M. Desouky

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 2 Table of Contents 1.RAID Overview 2.Introduction to SDS Software 3.SDS Installation 4.SDS User Interfaces 5.Metadevice State Database 6.Concatenation & Stripes 7.Mirrors & Hot Spares 8.RAID-5 Metadevices 9.File System Operations 10.Disksets

RAID University of California Berkeley 1987

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 4 Discussion Disk Speed Limitations File System Is Full Disk Fault Tolerance 24x7 Systems Multiple Disks: Higher probability of disk failure Higher probability of disk failure MTBF MTBF File System Spanning: (Max: 1 TB) File System Spanning: (Max: 1 TB) Longer reboot times Longer reboot times

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 5 Managing Large No of Disks Decrease the number of file systems Avoid data loss due to disk failure Balance I/O across disks, performance Avoid file systems check at boot Grow file systems online Apply dual-host failover

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 6 Managing Disks Techniques: Concatenation Concatenation Striping Striping Expanding File Systems Expanding File Systems Hot Spares Hot Spares RAID 5 RAID 5 Mirroring Mirroring Disksets Disksets

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 7 RAID Levels 1.RAID 0 2.RAID 1 3.RAID RAID 3 5.RAID 5

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 8 RAID 0, Concatenation FS 1 FS 2 FS 3 RAID Management Software Virtual FS

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 9 RAID 0, Striping FS 1 FS 2 FS 3 RAID Management Software FS 3 FS 2 FS 1

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 10 RAID 1, Mirroring FS 4 FS 3 FS 2 FS 1 FS 4 FS 3 FS 2 FS 1 RAID Management Software FS 4 FS 3 FS 2 FS 1 Mirror Data

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 11 RAID 0+1 RAID Management Software Mirroring RAID Management Software Striping FS 4 FS 3 FS 2 FS 1 FS 8 FS 7 FS 6 FS 5 FS 4 FS 3 FS 2 FS 1 RAID Management Software Striping FS 8 FS 7 FS 6 FS 5 FS 4 FS 3 FS 2 FS 1 FS 8 FS 7 FS 6 FS 5 FS 4 FS 3 FS 2 FS 1 FS 8 FS 7 FS 6 FS 5 FS 4 FS 3 FS 2 FS 1 FS 8 FS 7 FS 6 FS 5

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 12 RAID 3, Striping with Parity RAID Management Software FS 4 FS 1 FS 5 FS 2 FS 6 FS 3 P(5-6) P(2-4) P(1-3) FS 6 FS 5 FS 4 FS 3 FS 2 FS 1

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 13 RAID 5, Distributed Parity P(10-12) FS 7 FS 4 FS 1 FS 10 P(7-9) FS 5 FS 2 FS 11 FS 8 P(4-6) FS 3 FS 12 FS 9 FS 6 P(1-3) RAID Management Software FS 12 FS 11 FS 10 FS 9 FS 8 FS 7 FS 6 FS 5 FS 4 FS 3 FS 2 FS 1

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 14

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 15 Introduction DiskSuite Manage: Large Number of Disks Large Number of Disks Data on Disks Data on Disks DiskSuite Tasks Storage Capacity: metadevices Storage Capacity: metadevices Data Availability: Mirrors, RAID5 metadevices Data Availability: Mirrors, RAID5 metadevices DiskSuite, Virtual Disks Metadevice Metadevice

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 16 Planning DiskSuite Setting Priorities: Performance: Performance: Availability: Mirroring Hardware Cost: Striping Availability: Availability: Performance: Mirroring Hardware Cost: RAID5 Hardware Cost: Hardware Cost: Availability: RAID5 Performance: Striping

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 17 State Database Replicas Replicas Stores: DiskSuite Configuration DiskSuite Configuration State Information State Information Planning Replicas: One Disk: 3 replicas on one slice One Disk: 3 replicas on one slice Two-Four Disks: 2 replicas on each Two-Four Disks: 2 replicas on each Five or more Disks: 1 on each Five or more Disks: 1 on each

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 18 State Database Replicas Creating Replicas: Small slices (520 MB) Small slices (520 MB) Slices should NOT contain data! Slices should NOT contain data! Backup your data! Backup your data! Allocating Space from swap partition! Allocating Space from swap partition! swap -l swap -d swap -a metadb -a -f -c metadb -a -f -c -a Add -a Add -c Number of replicas -c Number of replicas -f Force -f Force

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 19 Creating Replicas Examples: Creating 2 Replicas on 3 Disks: metadb -a -f -c 2 c0t1d0s3 c1t1d0s3 c2t1d0s3 metadb -a -f -c 2 c0t1d0s3 c1t1d0s3 c2t1d0s3 Creating 3 replicas on 1 Disk: metadb -a -f -c 3 c0t0d0s3 metadb -a -f -c 3 c0t0d0s3

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 20 DiskSuite Objects Object: Assigning physical device to a DiskSuite name Assigning physical device to a DiskSuite nameObject: Replicas Replicas Metadevice MetadeviceStripesConcatenationsMirrorsRAID5 Hot Spare Pools Hot Spare Pools Disksets Disksets

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 21 Objects, Replicas Creating Additional Replica: metadb -a c0t2d0s0 metadb -a c0t2d0s0 metadb metadb Creating 2 Additional Replicas: metadb -a -c 2 c0t2d0s0 metadb -a -c 2 c0t2d0s0

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 22 Objects, Stripes One Stripe of 2 slices: metainit d c0t1d0s2 c0t2d0s2 metainit d c0t1d0s2 c0t2d0s2 One Stripe of 3 slices: metainit d c0t1d0s2 c0t2d0s2 c0t3d0s2 metainit d c0t1d0s2 c0t2d0s2 c0t3d0s2 Deleting Meta Devices metaclear -a metaclear -a

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 23 Objects, Concatenation Creating a Concatenation of 2 Slices: metainit d c0t1d0s2 1 c0t2d0s1 metainit d c0t1d0s2 1 c0t2d0s1 Creating a Concatenation of 4 Slices: metainit d c0t1d0s2 1 c0t2d0s2 1 c0t2d0s3 1 c0t2d1s3 metainit d c0t1d0s2 1 c0t2d0s2 1 c0t2d0s3 1 c0t2d1s3

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 24 Objects, Mirrors Mirror: On different disks On different disks Slices should be the same size! Slices should be the same size! Types of Mirrors: One Way One Way Two Way Two Way Three Way Three Way

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 25 Objects, Mirrors Creating Two-Way Mirror: metainit -f d c0t0d0s2 (/home) metainit -f d c0t0d0s2 (/home) metainit d c1t0d0s2 (unmounted) metainit d c1t0d0s2 (unmounted) metainit d50 -m d51 metainit d50 -m d51 umount /home (What if you can’t umount!) umount /home (What if you can’t umount!) vi /etc/vfstab: /dev/md/dsk/d50 vi /etc/vfstab: /dev/md/dsk/d50 newfs /dev/md/dsk/d50 newfs /dev/md/dsk/d50 mount /home (on d50) mount /home (on d50) metattach d50 d52 metattach d50 d52

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 26 Objects, Mirrors Creating a Mirror from root / metainit -f d c0t3d0s0 metainit -f d c0t3d0s0 metainit d c1t3d0s0 metainit d c1t3d0s0 metainit d10 -m d11 metainit d10 -m d11 metattach d10 d12 metattach d10 d12

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 27 Deleting Mirror Metadevice Detaching a Mirror Meta device metadetach d50 d51 metadetach d50 d51 Deleting the Meta Devices metaclear -a

RAID Overview SDS Software SDS Installation SDS User Interfaces MD State Database Concats & Stripes Mirrors Hot Spares RAID-5 MD FS Operations Disksets 28 Objects, RAID5 Creating a RAID5 metadevice of 3 slices metainit d45 -r c2t3d0s2 c3t0d0s2 c4t0d0s2 metainit d45 -r c2t3d0s2 c3t0d0s2 c4t0d0s2