Presentation is loading. Please wait.

Presentation is loading. Please wait.

Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems Upon completion of this module, you should be able to: Define file system.

Similar presentations


Presentation on theme: "Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems Upon completion of this module, you should be able to: Define file system."— Presentation transcript:

1 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems Upon completion of this module, you should be able to: Define file system components and storage pools Describe file system features including file system automatic extension and virtual provisioning Create file systems using Automatic Volume Manager Explain how to manage file systems Configuring File Systems1

2 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems This lesson covers the following topics: UxFS file system Automatic Volume Manager (AVM) Storage pools Lesson 1: UxFS File System Configuring File Systems2

3 Copyright © 2014 EMC Corporation. All Rights Reserved. VNX File System Overview Method of cataloging and managing files and directories on a storage system Configuring File Systems3 VNX for File uses UxFS file system  Groups file data with its metadata for an improved locality of reference VNX file systems can be created automatically or manually

4 Copyright © 2014 EMC Corporation. All Rights Reserved. Creating File Systems Automatically Automatic Volume Manager (AVM) is a feature used to create VNX file systems automatically  The AVM algorithm creates the underlying file system structure * We will be covering file systems via AVM in this module Configuring File Systems4 Automatic Volume Management Manual Provides an easy to use method of creating and managing file systems Maximizes capacity and improves client performance Application requires precise placement of file systems on particular disks Provides more control over storage allocation

5 Copyright © 2014 EMC Corporation. All Rights Reserved. AVM File System Structure File System Metavolume Slice Stripe Disk Volumes (dVol) Configuring File Systems5

6 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Components: dVols The underlying storage for all other volume types Disk volumes are created when LUNs are presented to the VNX for File via:  The file storage provisioning wizard  Adding LUNs to ~filestorage storage group Each dVol maps to a LUN on the storage system  LUNs may come from RAID Groups or Block storage pools Configuring File Systems6 LUN 207 LUN 208 dvol 21 dvol 22

7 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Components: Stripe Volumes Volumes are stripped together and presented as one logical volume Achieve greater performance and higher aggregate throughput AVM decides on the number of dVols to stripe depending on the LUN type  Up to 4 dVols when RAID Group LUNs are used  Up to 5 dVols when Pool LUNs are used Configuring File Systems7 Stripe Volume 80 GB

8 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Components: Slice Volumes Method of making smaller volumes from larger volumes Satisfies a file system request without utilizing the entire stripe volume  Space left over on the stripe volume can be used for other file systems Slicing is the default when creating file systems Configuring File Systems8 Stripe Volume 80 GB Slice Volume 20 GB

9 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Components: Metavolume A metavolume is a concatenation of one or more volumes In order to create a file system, a metavolume must first exist A file system is able to dynamically expand by adding more volumes to the metavolume Configuring File Systems9 Slice 20 GB Slice 30 GB Metavolume File System 20 GB File System 30 GB

10 Copyright © 2014 EMC Corporation. All Rights Reserved. Disk Volume Types Disk volumes are categorized in AVM by the physical disk associated with the LUN and the LUN type * Complete Disk Types listing in Managing Volumes and File Systems with VNX™ AVM product document Configuring File Systems10 Disk TypeDescription CLSASVNX Block SAS drives (including NL-SAS) CLEFDVNX Block Performance and SATA II Flash drives CapacityVNX Block pool LUNs from NL-SAS disks PerformanceVNX Block pool LUNs from SAS disks MixedVNX Block pool LUNs from mixed disk types

11 Copyright © 2014 EMC Corporation. All Rights Reserved. AVM Storage Pools Storage pools are containers that hold stripe volumes ready for use by AVM Storage pools with RAID Group LUNs  System-defined pools  256 KB stripe element size  User-defined pools Storage pools with Pool LUNs  Mapped pools Configuring File Systems11 Storage Pool = 160 GB Stripe 1 80 GB Stripe 2 80 GB Member Volumes

12 Copyright © 2014 EMC Corporation. All Rights Reserved. System-defined Pools Configuring File Systems12 SAS Drives - CLSAS PoolRAID Config clarsas_archive3+1, 4+1, 6+1, 8+1 RAID 5 clarsas_r64+2, 6+2, 12+2 RAID 6 clarsas_r101+1 RAID 1/0 Flash Drives - CLEFD PoolRAID Config clarefd_r54+1, 8+1 RAID 5 clarefd_r101+1 RAID 1/0

13 Copyright © 2014 EMC Corporation. All Rights Reserved. Mapped Pools Configuring File Systems13 When Pool LUNs are presented to the VNX File, a mapped pool is created by AVM  The mapped pool is deleted when all Pool LUNs are removed from the ~filestorage group  Advanced Block storage features such as FAST-VP, Thin LUNs and Compression are supported Mapped Pool 1 : 1

14 Copyright © 2014 EMC Corporation. All Rights Reserved. Striping with Pool LUNs Before striping, AVM will divide available Pool LUNs/dVols in Thick and Thin groups All Thick LUNs will be used first before using any Thin LUNs Up to 5 dVols of the same size, data services, and SP balanced will be striped, with a minimum of two Configuring File Systems14 Stripe First 5 Then 4 Then 3 Then 2

15 Copyright © 2014 EMC Corporation. All Rights Reserved. Concatenating with Pool LUNs Configuring File Systems15 If AVM can’t find available LUNs of the same size for striping, then:  Concatenate enough Thick LUNs to meet size requirements  If no Thick LUNs are available, use Thin LUNs  If not possible, put Thick and Thin together If that is not possible, file system creation/extension fails! LUN1 LUN2 LUN1 LUN 2 LUN 1 LUN 2 LUN1

16 Copyright © 2014 EMC Corporation. All Rights Reserved. AVM Considerations All volumes of a file system must be stored on the same storage system AVM storage pools must contain only one disk type and cannot be mixed, unless if using Pool LUNs When creating Pool LUNs:  Pool LUN count should be divisible by 5 to assist AVM striping  Balance SP ownership If File Thin Provisioning is desired, use a Thin Enabled file system on RAID Group LUNs or Thick LUNs, instead of Thin LUNs Configuring File Systems16

17 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems During this lesson the following topics were covered: UxFS file system Automatic Volume Manager (AVM) Storage pools Lesson 1: Summary Configuring File Systems17

18 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems This lesson covers the following topics: VNX automatic file system extension feature VNX file system thin provisioning feature File system deduplication Provisioning Monitoring Lesson 2: File System Features Configuring File Systems18

19 Copyright © 2014 EMC Corporation. All Rights Reserved. Auto Extend Overview AVM automatically extends a file system based on High Water Mark  Enabled at creation time or at a later time via the file system properties page Configuring File Systems19

20 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Extension Process Another slice is taken from the same stripe volume, if possible, to create another metavolume Configuring File Systems20 s69 20 GB slice v GB meta v GB stripe s71 20 GB slice v GB meta File System

21 Copyright © 2014 EMC Corporation. All Rights Reserved. Auto Extend Considerations All file system commands are blocked until file system extension is complete Auto extend options may only be modified if file system is mounted read/write on the Data Mover Enabling automatic file system extension does not reserve space in the storage pool  Administrators need to ensure there is enough space in the pool for file system extension Configuring File Systems21

22 Copyright © 2014 EMC Corporation. All Rights Reserved. Thin Provisioning Overview Allocate file system storage on a need basis  File system grows on demand as data is being written Auto Extend must be enabled to use thin provisioning on a file system  Max Capacity must be specified NFS/CIFS clients and applications will see the virtual maximum size instead of the actual allocated size Configuring File Systems22

23 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring Thin Provisioning Configuring File Systems23

24 Copyright © 2014 EMC Corporation. All Rights Reserved. File Deduplication Overview Deduplicate and compress redundant data at the file-level  If two or more files are identical, only one instance of the file will be used  Increased storage efficiency File system must have at least 1 MB of free space Active files will not be deduplicated Configuring File Systems24 File A File B Active File File C File B File A File C File A File C File B

25 Copyright © 2014 EMC Corporation. All Rights Reserved. File Deduplication Policy Engine The File Data Deduplication policy engine specifies which data to be processed based on the file’s:  Modification time - at least 15 days  Last access time - at least 15 days  Size - 24KB to 8TB  File extension None of the file’s metadata (attributes, name, timestamps) is affected by the deduplication process Configuring File Systems25

26 Copyright © 2014 EMC Corporation. All Rights Reserved. Deduplication Walkthrough Configuring File Systems26 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Write hash, erase file, leave stub. YES Production File System PP1FED81 Hidden Store Hash Table NO PP1FED81 Policy Engine

27 Copyright © 2014 EMC Corporation. All Rights Reserved. Deduplication Walkthrough (continued) Configuring File Systems27 PP1FED81 Hidden Store Hash Table HG3FEF23 PP1FED81 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Write hash, erase file, leave stub. NO YES HG3FEF23 Policy Engine Production File System

28 Copyright © 2014 EMC Corporation. All Rights Reserved. Deduplication Walkthrough (continued) Configuring File Systems28 PP1FED81 Hidden Store Hash Table HG3FEF23 PP1FED81 HG3FEF23 1.Eligible? (policy check) Size is too small NO Policy Engine Production File System

29 Copyright © 2014 EMC Corporation. All Rights Reserved. Deduplication Walkthrough (continued) Configuring File Systems29 PP1FED81 Hidden Store Hash Table HG3FEF23 PP1FED81 HG3FEF23 1.Eligible? (policy check) Access time check did not pass, this is an active file NO Policy Engine Production File System

30 Copyright © 2014 EMC Corporation. All Rights Reserved. Deduplication Walkthrough (continued) Configuring File Systems30 PP1FED81 Hidden Store Hash Table HG3FEF23 PP1FED81 HG3FEF23 1. Eligible? (policy check) 2. Copy, compress, and hash. 3. Redundant? (hash check) 4. Erase file, leave stub. YES Policy Engine Production File System

31 Copyright © 2014 EMC Corporation. All Rights Reserved. File Deduplication Considerations Increase storage efficiency by running File Deduplication on:  Secondary or archival data if the primary storage has a short retention period  Both primary and secondary data if there is a longer primary storage retention period Heavy utilized Data Movers will take longer to deduplicate files  Use file extension to limit the deduplication on non-compressible, non-duplicate files A deduplicated file system may be backed up and restored using NDMP Volume Based Backup without any re-duplication of files Configuring File Systems31

32 Copyright © 2014 EMC Corporation. All Rights Reserved. Provisioning Monitoring Configuring File Systems32 System > Monitoring and Alerts > Statistics for File Three weeks worth of data Able to export or print data

33 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems During this lesson the following topics were covered: VNX automatic file system extension feature VNX file system thin provisioning feature File system deduplication Provisioning Monitoring Lesson 2: Summary Configuring File Systems33

34 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems This lesson covers the following topics: File system size considerations File system creation with AVM View existing file systems Extending a file system manually Renaming an existing file system Delete a file system Lesson 3: Creating File Systems Configuring File Systems34

35 Copyright © 2014 EMC Corporation. All Rights Reserved. Size Considerations Configuring File Systems35 New and existing file systems can be extended up to 16 TB file system size Minimum size of 2 MB per file system File System size 2048 per Data Mover 4096 per cabinet Maximum number of File Systems

36 Copyright © 2014 EMC Corporation. All Rights Reserved. Viewing Existing File Systems Storage > Storage Configuration > File Systems Configuring File Systems36

37 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Creation Configuring File Systems37

38 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Properties Configuring File Systems38

39 Copyright © 2014 EMC Corporation. All Rights Reserved. File System Volumes Configuring File Systems39

40 Copyright © 2014 EMC Corporation. All Rights Reserved. VNX File System Wizard Configuring File Systems40

41 Copyright © 2014 EMC Corporation. All Rights Reserved. Extending File Systems Configuring File Systems41

42 Copyright © 2014 EMC Corporation. All Rights Reserved. Extending File Systems (continued) A new metavolume was created (v117) and concatenated to the original v110 metavolume Configuring File Systems42

43 Copyright © 2014 EMC Corporation. All Rights Reserved. Renaming a File System A file system may be renamed after it has been created, mounted, or exported  Renaming is done from the Properties page  File system mountpoint and export will still need to be renamed Configuring File Systems43 filesystem_8

44 Copyright © 2014 EMC Corporation. All Rights Reserved. Deleting a File System After an AVM file system is deleted, underlying volume structure is also deleted and storage is returned to the pool Configuring File Systems44

45 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems During this lesson the following topics were covered: File system size considerations File system creation with AVM View existing file systems Extending a file system manually Renaming an existing file system Delete a file system Lesson 3: Summary Configuring File Systems45

46 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems This lesson covers the following topics: Obtain status on a file system File system capacity management Evaluating file systems status Lesson 4: File System Administration 46Configuring File Systems

47 Copyright © 2014 EMC Corporation. All Rights Reserved. VNX File System Statistics 47Configuring File Systems

48 Copyright © 2014 EMC Corporation. All Rights Reserved. Capacity Management weeks of historical usage data Graph and properties can be printed Graph usage data can be exported as CSV file Configuring File Systems

49 Copyright © 2014 EMC Corporation. All Rights Reserved. server_stats Overview Provides real-time performance statistics for a specified Data Mover, including file systems  CLI only Displayed in a time-series style  Statistics are displayed at the end of each polling interval 49 -monitor basic-std -monitor cifs-std -monitor nfs-std -monitor caches-std -monitor netDevices-std -monitor diskVolumes-std -monitor metaVolumes-std -monitor cifsOps-std -monitor nfsOps-std Configuring File Systems

50 Copyright © 2014 EMC Corporation. All Rights Reserved. server_stats Command Syntax 50 ~]$ server_stats USAGE: server_stats -list | -info [-all| [,...]] | -service { -start [-port ] | -stop | -delete | -status } | -monitor -action {status|enable|disable} |[ [{ -monitor {statpath_name|statgroup_name}[,...] | -monitor {statpath_name|statgroup_name} [-sort ] [-order {asc|desc}] [-lines ] }...] [-count ] [-interval ] [-terminationsummary {no|yes|only}] [-format {text [-titles {never|once| }]|csv}] [-type {rate|diff|accu}] [-file [-overwrite]] ] ~]$ server_stats USAGE: server_stats -list | -info [-all| [,...]] | -service { -start [-port ] | -stop | -delete | -status } | -monitor -action {status|enable|disable} |[ [{ -monitor {statpath_name|statgroup_name}[,...] | -monitor {statpath_name|statgroup_name} [-sort ] [-order {asc|desc}] [-lines ] }...] [-count ] [-interval ] [-terminationsummary {no|yes|only}] [-format {text [-titles {never|once| }]|csv}] [-type {rate|diff|accu}] [-file [-overwrite]] ] Configuring File Systems

51 Copyright © 2014 EMC Corporation. All Rights Reserved. server_stats Example: Disk Volume Analysis 51 server_5 dVol Queue Read Read Avg Read Write Write Avg Write Timestamp Depth KiB/s Ops/s Size KiB/s Ops/s Size Bytes Bytes Average NBS root_ldisk NBS NBS d d d d d d d d d d d d d server_5 dVol Queue Read Read Avg Read Write Write Avg Write Timestamp Depth KiB/s Ops/s Size KiB/s Ops/s Size Bytes Bytes Average NBS root_ldisk NBS NBS d d d d d d d d d d d d d $ server_stats server_5 -m diskVolumes-std -i 10 -c 6 Configuring File Systems

52 Copyright © 2014 EMC Corporation. All Rights Reserved. Storage Pool Reporting 52 $ nas_pool -info id=48 id = 48 name = File Pool description = Mapped Pool File Pool on FNM acl = 0 in_use = True clients = fs15,fs16,vpfs15,root_fs_vdm_VDM01,fs12 members = v107,v111 storage_system(s) = FNM default_slice_flag = True is_user_defined = False thin = False tiering_policy = Auto-Tier/Highest Available Tier compressed = False mirrored = False disk_type = Mixed server_visibility = server_2,server_3 volume_profile = File Pool_vp is_dynamic = True is_greedy = N/A num_stripe_members = 5 stripe_size = ~]$ $ nas_pool -info id=48 id = 48 name = File Pool description = Mapped Pool File Pool on FNM acl = 0 in_use = True clients = fs15,fs16,vpfs15,root_fs_vdm_VDM01,fs12 members = v107,v111 storage_system(s) = FNM default_slice_flag = True is_user_defined = False thin = False tiering_policy = Auto-Tier/Highest Available Tier compressed = False mirrored = False disk_type = Mixed server_visibility = server_2,server_3 volume_profile = File Pool_vp is_dynamic = True is_greedy = N/A num_stripe_members = 5 stripe_size = ~]$ $ nas_pool -size id=48 id = 48 name = File Pool used_mb = avail_mb = total_mb = potential_mb = 0 ~]$ $ nas_pool -size id=48 id = 48 name = File Pool used_mb = avail_mb = total_mb = potential_mb = 0 ~]$ Configuring File Systems

53 Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems During this lesson the following topics were covered: Obtain status on a file system File system capacity management Evaluating file systems status Lesson 4: Summary 53Configuring File Systems

54 Copyright © 2014 EMC Corporation. All Rights Reserved. Summary Key points covered in this module: File Systems can be created with Automatic Volume Manager The types of VNX volumes that can be created are slice, stripe and metavolumes Storage Pools are containers that holds storage ready for use by file systems Auto-extend feature allows the size of the file system to increase automatically Virtual Provisioning grows the file system gradually on an as-needed basis File system deduplication increases storage efficiency VNX File statistics and server_stats may be used to monitor file systems 54Configuring File Systems


Download ppt "Copyright © 2014 EMC Corporation. All Rights Reserved. Configuring File Systems Upon completion of this module, you should be able to: Define file system."

Similar presentations


Ads by Google