1. Georgi Matev Program Manager Microsoft Corporation georgim@microsoft.com Efficient Storage Management Tools in R2

2. Agenda Storage Management Scope File Server Resource Manager Capacity management Policy management Quota management Simplifying SAN Solutions Bringing SANs to SMBs Partnering Storage Manager for SANs Disk provisioning Disk management Q&A

3. Storage & File Systems in Windows Physical Disk Volume Files & Folders Network & Distribution DFS Namespaces DFS Replication Access-Based Enumeration File Server Management SAN management (VDS) Quotas, Policies, and Reports Shadow copies (VSS)

4. Storage Management Scope Component Windows Tool Asset Management Manage, track and maintain physical (hardware) and logical (volumes, files, I/O etc) storage information Fibre Channel (FC) Information Tool Fibre Channel (FC) Information Tool Virtual Disk Service (VDS) Virtual Disk Service (VDS) Capacity Management Disk and volume space information File Services Resource Manager (FSRM) File Services Resource Manager (FSRM) Charge-Backs Provides customer billing for storage costs Indirect support through FSRM Indirect support through FSRM Configuration Management Configures physical storage systems VDS VDS Storage Manager for SAN Storage Manager for SAN Storage tracing Storage tracing Data and Media Migration Allows data movement from different media types File Server Migration Toolkit File Server Migration Toolkit Event Management Administrator notification of storage problems Microsoft Operations Manager (MOM)* Microsoft Operations Manager (MOM)* FC Information Tool FC Information Tool Performance & Availability Management Application, server, & subsystem information MOM* MOM* Policy Management Sets and enforces policies for systems and users FSRM (file screening) FSRM (file screening) Quota Management Manages storage usage FSRM FSRM Media Management Provides information about removable media storage -- * Through hardware vendor pack.

5. File Server Resource Manager (FSRM) Vision FSRM provides a suite of tools that allows IT administrators to understand and control the type and quantity of data stored on their servers. A new Windows storage management component that integrates: Capacity management Policy management Quota management

6. FSRM: Capacity Management Administrator Challenges Determining existing storage capacity usage across the organization Determining whether usage effectively supports organizational goals Defining and implementing storage policies Adjusting the policies as capacity needs grow and as organization needs change

7. FSRM: Capacity Management User Scenarios and Benefits Identify where storage capacity is used inefficiently Identify mechanisms to prevent future capacity misuse Monitor usage patterns and utilization levels

8. FSRM: Capacity Management Reporting Functionality Predefined and configurable storage capacity reporting Predefined reports for ease of use Configurable reports for fine tuning to specific server environments Predefined Large files Large files Most/least recently used Most/least recently used Files by owner Files by owner Files by file group Files by file group Duplicate files Duplicate files Quota usage Quota usage File screen audit File screen audit Export report Export report Configurable Multiple volumes Multiple volumes Report filtering parameters Report filtering parameters Multiple folders or shares Multiple folders or shares

9. FSRM: Capacity Management Reporting Functionality (cont’d) Multiple report formats Generate reports at scheduled intervals (e.g., off-hours) on-demand (e.g., troubleshooting during a storage crisis, can trace problem to source) Save reports locally or send to users via e-mail Support for clustered configurations

10. FSRM: Reporting

11. FSRM: Quota Management Administrator Challenges User home directories often grow quickly causing servers to run out of space Departmental shares can also grow unexpectedly Administrators are only aware of storage crises when the server is already out of space

12. FSRM: Quota Management User Scenarios and Benefits Control the amount of space used for a folder or share and limit its impact on server utilization Monitor disk space usage growth per: VolumeFolderShare Slow down storage growth

13. FSRM: Quota Management Why not NTFS quotas? NTFS quotas since Windows 2000 Per volume Per user Based on logical file size NTFS quotas lack Scoping to a specific directory Accounting based on disk size Rich notification mechanisms

14. FSRM: Quota Management Quota Functionality Quotas limit the size of a directory tree or a volume Quota applies to all users files in directory Limit can be soft or hard File system interoperability Only NTFS volumes are supported Usage is tracked in real time, failing I/Os at hard limit Only volumes with quota configuration are monitored Quota usage is charged based on disk size Support for special files Compressed, sparse, named streams, hard links, reparse points

15. FSRM: Quota Management Quota Functionality (cont’d) Multiple notification thresholds at configurable quota utilization levels E-mail, Event log, Command/Script, Report Ease of deployment through templates Auto apply templates Templates is associated with a parent folder Quotas are auto created for existing and future child folders Template tracking Quotas keep track of source template Track differences between quota and template settings Enables policy driven quota configuration Self-consistent volume configuration Quota settings travel with volume (SAN, hot-pluggable disks) Cluster support

16. FSRM: Quotas

17. FSRM: Policy Management Administrator Challenges No easy way to control the type of data stored on file servers Unwanted content must be identified manually

18. FSRM: Policy Management User Scenarios and Benefits Eliminate non-business files and improve storage utilization while reducing management costs Implement policies to restrict unauthorized files in order to limit legal exposure Promote a culture of accountability

19. FSRM: Policy Management File Screen Functionality Applies to a folder tree or volume Screening rules: Based on file groups Apply to all user files in the folder File screening settings can be saved in template Passive and active screening supported Screening events recorded in audit log Same set of notification as quotas

20. FSRM: Policy Management File Screen Functionality (cont’d) File system interoperability Only NTFS volumes are supported Usage is tracked in real time Only volumes with screening configuration are monitored Screening is based on file name patterns (*.mp3, FY04*) Self-consistent volume configuration Cluster support

21. FSRM: Policy Management File screen exceptions for fine-tuning Screening configurations can be nested Semantics similar to ACL permissions (subfolders inherit policies) File screen exceptions Explicitly allow files which match a set of file groups to be stored in a folder tree Usually configured on a subfolder under a more restrictive screening policy No notifications are raised when a file matches an allowed file group

22. FSRM: File Screening

23. SMfS: SAN Provisioning Administrator challenges Small-midsize market want SAN benefits, but: Existing tools are complex and expensive Sophisticated performance monitoring not required in the SMB market (usually only 10-15 servers) Hardware support for tens of thousands of storage devices unnecessary Administrators have limited experience with SAN technologies Want basic functionality enabling the administrator to easily share storage among servers

24. Simplifying SAN Solutions Bringing SANs to SMBs Storage area networks (SANs) provide many benefits, including centralized, shared storage SAN adoption in SMBs has been low because of complexity, expense, and poor solution component interoperability

25. Simplifying SAN Solutions Bringing SANs to SMBs (cont’d) Microsoft is committed to helping to bring SANs to a wider range of customers through a number of approaches, including: iSCSI SANs Enable SAN solutions by using existing IP infrastructure and knowledge base VDS Integration Partner applications are using the VDS framework for both iSCSI and Fibre Channel simplified SAN solutions Simple SANs

26. Simplifying SAN Solutions iSCSI & Fibre Channel partnering Working with iSCSI and Fibre Channel vendors in all storage categories Building solutions that integrate with VDS, VSS, MPIO, iSCSI, Storport Developing management applications that make deployment simple and easy

27. Storage Manager for SANs (SMfS) A SAN application: Storage resource provisioning Disk configuration

28. SMfS: SAN Provisioning User scenarios and benefits Offers “just the basics” SAN management functionality, including: Device discovery LUN creation Storage allocation Enables Shared storage solutions Clustering

29. Leverages Virtual Disk Service (VDS) infrastructure Allows Windows administrators to perform basic array and LUN management Target audience: small-scale SANs built from simplified hardware SMfS is a MMC snap-in Storage Manager for SANs Basics

30. Storage Manager for SANs Features Configure all SAN storage in one UI Focus on simplicity Auto-discover subsystems (arrays) Auto-discover servers on SAN (no 16-digit hex #s) Simple wizard to provision storage Reduce complexity via easy tasks Grow volumes and underlying LUNs Move storage from server to server Configure iSCSI security Link with local storage management

31. Storage Manager for SANs Virtual Disk Service 1.1 Interface for storage management (Windows Server 2003) Local storage (volume management) External (SAN) storage via “hardware providers” from hardware vendors VDS 1.1 (post-SP1 Hotfix) adds support for MPIO and iSCSI New WHQL logo program Ties in with Simple SAN program

32. Storage Manager for SANs Technical details Leverages VDS API to manage storage (hardware providers) Fibre Channel iSCSI “PCI” RAID (DAS) Also iSCSI and HBA API connectivity and MPIO for path management Storage Manager for SANs VDS iSCSIMPIO HBA API Provider Storage Hardware (managed via VDS)

33. Storage Manager for SANs

34. © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY. Thank You Questions?

35. Resources Windows Storage: http://www.microsoft.com/windowsserversyst em/storage/default.mspx http://www.microsoft.com/windowsserversyst em/storage/default.mspx Windows Server 2003 R2 Customer Preview Program: http://www.microsoft.com/windowsserver200 3/r2/default.mspx http://www.microsoft.com/windowsserver200 3/r2/default.mspx Direct questions and comments to: georgim@microsoft.com