1. Continuously Available File Server: Under the Hood Claus Joergensen Principal Program Manager Microsoft Corporation WSV410

3. File Server Shared Storage Shared Storage Hyper-V Server App Server Web Server DB Server SQL Server IIS

4. Clustered File Server Application Servers Single File System Namespace Cluster Shared Volumes Single Logical File Server (\\fs\share) Data Center Network (Ethernet, InfiniBand or combination) *) Capabilities highlighted in orange are unique to Scale-Out File Server

5. title Setup and Configuration

8. title Cluster Shared Volumes

12. title Anatomy of a Scale-Out File Server

13. Get-ClusterGroup | ? {$_.GroupType -eq "ScaleoutFileServer"} | FL Name, OwnerNode, State, GroupType Name : smbsofs33 OwnerNode : FSF-260403-07 State : Online GroupType : ScaleoutFileServer Get-ClusterGroup | ? {$_.GroupType -eq "ScaleoutFileServer"} | Get-ClusterResource Name State OwnerGroup ResourceType ---- ----- ---------- ------------ Scale-Out File Server Online smbsofs33 Scale Out File Server smbsofs33 Online smbsofs33 Distributed Network Name

14. > smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: smbsofs33.ntdev.corp.microsoft.com Name: smbsofs33.ntdev.corp.microsoft.com Addresses: 2001:4898:0:fff:0:5efe:10.217.108.49 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 10.217.108.148 10.217.108.49 10.217.108.103

15. > smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: Name: smbsofs33.ntdev.corp.microsoft.com 2001:4898:0:fff:0:5efe:10.217.108.49 Addresses: 2001:4898:0:fff:0:5efe:10.217.108.49 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 10.217.108.148 10.217.108.148 10.217.108.49 10.217.108.103 > smbsofs33 Server: stb-red-dc-01.stbtest.microsoft.com Address: 10.200.81.201 Non-authoritative answer: Name: smbsofs33.ntdev.corp.microsoft.com 2001:4898:0:fff:0:5efe:10.217.108.103 Addresses: 2001:4898:0:fff:0:5efe:10.217.108.103 2001:4898:0:fff:0:5efe:10.217.108.148 2001:4898:0:fff:0:5efe:10.217.108.49 10.217.108.49 10.217.108.49 10.217.108.148 10.217.108.103

18. Scale-Out File Server Cluster Node A Node B SQL Server Node C Get-SmbWitnessClient | FL ClientName, FileServerNodeName, WitnessNodeName ClientName : SQLServer FileServerNodeName : A WitnessNodeName : B Move-SmbWitnessClient –ClientName SQLServer –DestinationNode C

19. Scale-Out File Server Cluster Node A Node B SQL Server Node C

20. Storage IO (FC, iSCSI, SAS) Metadata Mirrored Spaces Storage Link Failures SMB Client To SMB Server

21. title Scale-Out File Server Scalability and Performance

22. 2x10Gbps

23. LocalRemote Overall throughput (MiBps)6,1006,000 Delta from local~2% LocalRemote  ~2%  Bottlenecked on 2x4Gbps FC

24. Individual VM Boot Time (in seconds) LocalRemote Minimum1819 Maximum3436 Average2325 Individual VM Boot Time (in seconds) EnabledDisabled Minimum1918 Maximum611141 Average29211 With CSV cache enabled, 90% booted in <40s

25. title SMB Transparent Failover

26. File Server Cluster Node A Node B \\fs1\share SQL Server

27. File Server Cluster Node A Node B \\fs1\share SQL Server

28. SMB Server SMB Client SMB Server User Kernel User Kernel Witness Service Witness Client Witness Protocol SMB Redirector File System Resume Key Filter SMB Server SMB 3.0 Operation replay State persistence User Kernel

29. SMB Server SMB Client SMB Server User Kernel User Kernel Witness Service Witness Client Witness Protocol SMB Redirector File System Resume Key Filter SMB Server SMB 3.0 Operation replay State persistence User Kernel

34. Volume Protection Database is being loaded from store All creates are held until complete (<3s) Namespace protection Local handles are being established All rename and create operations are blocked until complete (<60s) Create Protection Remote handles are being resumed All new creates are blocked until all handles are resumed or cancelled (<60s) Handles Cancelled Unclaimed handles are cancelled to release file create blackout

36. File Server Cluster Node A Node B \\fs1\share SQL Server

37. File Server Cluster Node A Node B \\fs1\share SQL Server

39. demo Claus Joergensen Principal Program Manager Windows File Server Team Scale-Out File Server

40. Cluster in a Box prototypes Quanta Wistron LSI HA-DAS MegaRAID ® and SAS controllers Quanta application servers, JBOD expansion, and 10GbE switch Mellanox IB FDR NICs and switch OCZ SAS SSDs Infrastructure Domain Controller server Power distribution unit 1GbE switch Keyboard & monitor MegaRAID ® is a registered trademark of LSI Corporation

41. File Server Shared Storage Shared Storage Hyper-V Server App Server Web Server DB Server SQL Server IIS

42. Breakout Sessions VIR306 Hyper-V over SMB2: Remote File Storage Support in Windows Server 2012 Hyper-V WSV303 Windows Server 2012 High-Performance, Highly-Available Storage Using SMB WSV310 Windows Server 2012: Cluster-in-a-Box, RDMA, and More WSV314 Windows Server 2012 NIC Teaming and Multichannel Solutions WSV322 Update Management in Windows Server 2012: Revealing Cluster- Aware Updating WSV330 How to increase SQL availability and performance using Window Server 2012 SMB 3.0 solutions WSV334 Windows Server 2012 File and Storage Services Management

43. Talk to our Experts at the TLC #TE(sessioncode) DOWNLOAD Windows Server 2012 Release Candidate microsoft.com/windowsserver Hands-On Labs DOWNLOAD Windows Azure Windowsazure.com/ teched

44. Connect. Share. Discuss. http://northamerica.msteched.com Learning Microsoft Certification & Training Resources www.microsoft.com/learning TechNet Resources for IT Professionals http://microsoft.com/technet Resources for Developers http://microsoft.com/msdn

45. Required Slide Complete an evaluation on CommNet and enter to win!

49. title Appendix

50. Server State PreservationState AffectedComments Preserved (for persistent handle timeout interval) – for transient/permanent network disconnects, server failovers In progress CREATEsReplay, duplicate resolved via GUID Opened file handlesFenced until client replays the open with same GUID. Includes support for Desired Access, Share modes Read/Write I/OsMust ensure all writes prior to failover are flushed before processing replay of reads or writes In-progress byte range locksReplay, duplicate resolved via sequence numbers Established byte range locksServer preserves, client does not replay Sticky timestampsOffice interop SMB2 FIDs describing open handlesOnly the persistent portion of SMB2 FID is needed Not preserved (client replays, etc) Enumeration of dir & EAsClient restarts enumeration (Win32 API compliant) CloseClient replays Change notification queue/blockClient handles this Oplock stateNot Continuously Available – only used by down- level SMB clients, which don’t use CA MixedIn progress lease breaksReplay if reconnect to same node. More complex if new node. Renegotiated on reconnect File and directory lease stateRenegotiated on open re-establishment. Write+Handle leases are preserved. SMB 3.0 Server User Kernel User Kernel SMB2 Redirector File System Resume Key Filter SMB2 Server SMB 3.0 Operation replay State persistence

51. State Preservation Action State AffectedComments Simple Replay of operation (requires server state to ensure correct operation) CREATE (file or directory)Using prior Create GUID, issue “re-open”. Read or Write I/OsReplay (after Create is reconnected). Rename/set DELETE_DISPOSITIONSMB2 FID or GUID used for open data handles, lease handles, opened for delete/rename handles. In progress byte range lock requestsReplay - duplicates resolved via sequence numbers FSCTLsReplay after re-open CloseReplay (re-open, then close), but re-open fails, is okay Attempt to replay, potentially renegotiate Directory Lease stateRenegotiation can cause directory cache flush. File Lease stateWrite+Handle leases preserved, all else could be renegotiated Cached file data & metadataWrite-Back data cache is preserved. May cause flush of metadata and/or read caches. Other ActionGranted byte range locksNo replay – server preserves. Enumeration State (dir and EAs)Start enumeration over, skip entries already returned. Change notification queue/blockComplete to app with error code to force re- enumeration/requeue. SMB 3.0 Server User Kernel User Kernel SMB2 Redirector File System Resume Key Filter SMB2 Server SMB 3.0 Operation replay State persistence

52. AreaFeature / capability Clustered File Server “Classic”Scale-Out Data management BranchCache  Data de-duplication  DFS Namespaces - Root  DFS Namespaces - Leaf  DFS Replication  FSRM (Quota, Screening, Reporting)  FSRM Classification  File Server VSS Agent  Folder Redirection  Client Side Caching  Apps Information Worker  Not recommended Hyper-v  SQL Server  AreaFeature / capability Clustered File Server “Classic”Scale-Out SMB Capabilities SMB Transparent Failover  SMB Scale-Out  SMB Multichannel  SMB Direct  SMB Encryption  File System NTFS  ReFS  CSVFS 