2. Microsoft Ignite 2015
4/16/2017 2:37 PM
BRK3496
Deploying Private Cloud Storage with Dell PowerEdge Servers and Windows Server vNext
Syama Poluri, Claus Joergensen , Shai Ofek
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. Agenda Brief History Microsoft SDS : Past , Present and Future
Microsoft Ignite 2015
4/16/2017 2:37 PM
Agenda
Brief History
Microsoft SDS : Past , Present and Future
Dell’s Journey with Storage Spaces
Learnings from field and Cloud Platform System (CPS)
Dell Storage with Microsoft Storage Spaces
Storage Spaces Direct Technology Overview
Physical View
Logical View
I/O Stack
ReFS
Storage Spaces Direct Deployment
PowerEdge R730xd Platform Details
Managing , Monitoring and Troubleshooting
Dell & Microsoft Partnership
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. Microsoft SDS : Past , Present and Future
Microsoft Ignite 2015
4/16/2017 2:37 PM
Microsoft SDS : Past , Present and Future
Pre Windows 2012
Windows 2012
Windows 2012 R2
Windows 2016
Dependent on Traditional Storage
Relied on 3rd party SAN vendors
1st wave SDS
Introduction to Storage Spaces
“Remote File solution for Hyper-V using shared JBOD
Introducied Scale Out File Server ( SOFS)
RDMA and Multichannel
SAN independence
2nd wave SDS
Storage Tiering
WriteBack Cache (WBC)
Scale Out File Server improvements
SMB Direct Improvements
Volume Rebalancing
Multiple instances
JBOD monitoring
Storage Spaces Direct
Remote File solution for Hyper-V using shared nothing hardware
Unlock use of DAS
Reduce Cost
 Software Storage Bus
SATA and NVMe
Node Fault Tolerance
Health Services
Storage Spaces Enhancements
Scalable pools
Data Rebalancing
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. Dell’s Journey With Storage Spaces
Microsoft Ignite 2015
4/16/2017 2:37 PM
Dell’s Journey With Storage Spaces
May 2014:
Support Storage Spaces using PowerVault MD3060e
End-End VDI solution using PowerVault MD1220
Sept 2012: Windows 2012 Release:
Understanding the technology and feedback to Microsoft
Oct 2014:
Launch Cloud Platform System (CPS) Powered by Dell
Nov 2013:
Worked closely with Microsoft in developing JBOD monitoring feature
Oct 2013: Windows 2012 R2 Release
Internal testing and active feedback to Microsoft
Feb 2014:
Support Storage Spaces using PowerVault MD1200 and MD1220
Sept 2014:
Additional Hardware Support with 12Gbps SAS . Select PowerEdge servers , PowerVault MD1400 and MD1420
Journey Continues…
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Microsoft Cloud Platform System
4/16/2017
Visit Microsoft Cloud Platform booth to see full demo and hardware
Microsoft Cloud Platform System
Azure-consistent Cloud in a Box
Windows Server 2012 R2, System Center 2012 R2, Windows Azure Pack
Microsoft-designed architecture based on Public Cloud learning
Optimized run-books for Microsoft applications
Dell PowerEdge servers
Dell Storage dense enclosures
Dell Networking switches
Optimized racking & cabling for high density, servicing, reliability & redundancy
Microsoft-led support & orchestrated updates
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Learnings from the field and CPS
Planning real world deployments
Capacity planning
Performance planning
Need guidance more than simple deployment guides
Selecting the correct hardware
Some HDD scale better than others
HBA firmware , Network cards and driver information that are tested and qualified at scale
Configuration complexities
How many columns, HDDs and SSDs
SAS and network cabling
Pool configuration and RDMA configurations
Validation with Windows features
Optimal configuration of windows features
Latest Hotfix / QFE information
Change management for Storage Spaces clusters

8. Dell Storage with Microsoft Storage Spaces
Microsoft Ignite 2015
4/16/2017 2:37 PM
Announcing
Dell Storage with Microsoft Storage Spaces
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Dell Storage with Microsoft Storage Spaces (DSMS)
Supported Client Servers Any Dell PowerEdge Server
6 Supported Dell Switches (S4810, S5000, N4064, N4064F, N4032, N4023F)
10Gb iWARP or ROCE RDMA Client Communication
2, 3 or 4 Storage Nodes R630 or R730
SAS Direct Attach (HA cabling)
2 to 4 Storage Enclosures (MD1400, MD1420, MD3060e)
Compute
Networking
Client I/O
Controllers
Storage I/O
Storage
More information at
o   Unable to generate color coded feedback. It would require additional programs/libraries to be installed on end user system. Still investigating solution. Work around is stating (X/X) systems are the same and present a warning when something is different.
o   For validating specific version numbers, OS, KB, etc. when going to from release to release the scripts will either need to be hard coded (not ideal) or be able to take in a config file of some sort to check against (better solution but would require lifecycle control from release to release).
·         Current and future plans
o   Improve the content gathered in the StorageInventory.ps1
§  Gather details on tiering configuration
§  Develop python script to examine details of content gathered
o   The end goal is to expand and improve the content created by each PowerShell Script and have a corresponding python module for each set of output files.
o   As each module gets more robust, the plan is to unify them into one or pass them on to create an actual GUI tool developed in Java/C++ (most likely done by someone full time).

10. Launching June 2015 Dell Storage with Microsoft Storage Spaces (DSMS)
Hyper-V
Validated and tested solution blocks for reliable SOFS operation
Pre-defined SKUs for 2x2, 2x3, 2x4, 3x3 and 4x4 SOFS configurations
Award winning, industry standard 13th Generation Dell Enterprise PowerEdge servers and PowerVault JBODs
Low cost compute and networking with C-servers, FX, Blades, PowerConnect & Force 10
RDMA solutions using iWarp and RoCE
Workload optimized turnkey solutions & Reference Architectures (Private Cloud & VDI)
Private Cloud
Backup & archival
VDI
Launching
June 2015
SQL
Standard management with MS System Center, iDRAC, OpenManage
Validated & tested solution blocks
SMB3 & RDMA
Worldwide installation services and total solution support
Sizing & performance guidance

11. Dell Storage with Microsoft Storage Spaces Advantage
Visit Dell booth on Expo floor for demo and solution details
Dell Storage with Microsoft Storage Spaces Advantage
Pre-Sales engagement & sizing for workload
Fulfillment & Deployment Worldwide
On Premise Management & Support
Sizing
Performance and Capacity sizing
SKUs for pre-defined configurations
Optimized solution SKUs using standard Dell servers and JBODs
Deployment
Installation and deployment option Dell services
Validation assistance for deployment on-site
Comprehensive Deployment Guide
Management
Leverages Dell & Microsoft management tools
Solution updates with single payload for storage nodes and JBODs through Microsoft Cluster Aware Updating (CAU)
Support
Full solution-level support for all components
Dell worldwide support services
End-to-End Dell Engagement for lifecycle of entire solution

12. DSMS as a Building Block for Storage Solutions
Customer- a la carte
Partner & Dell Services
Reference Architectures
Fast Track Solutions
Verified configuration
Deployment guide
Scalable & Customizable
Validated configuration
Simple setup
High availability
Easy scalability
Sizing guidance & Best Practices
Deployment Guide
Best-in-class components
System Center integration
Best-in-class components
Professional expertise and custom solution development
Microsoft compatibility
System Center integration
Dell Storage with Microsoft Storage Spaces

13. Introducing Storage Spaces Direct

14. SMB3 Storage Network Fabric
Storage Spaces Direct
Enabling cloud hardware designs
Support for DAS (shared nothing) storage hardware
Prescriptive configurations
Scale for Technical Preview 2
Minimum of four servers
Maximum of twelve servers
Maximum of 240 disk devices in a single pool
Fault tolerance
Fault tolerance to disk, enclosure and node failures
3-copy mirror and dual parity
Resilient up to two node failures
Management
System Center and PowerShell
Simple expansion
Add node(s) and expand pool
Rebalance for capacity
Hyper-V Clusters
SMB3 Storage Network Fabric
Scale-Out File Server
Internal
Disks
Shared JBOD Storage

15. Spaces Direct Logical View
Storage Access (Scale-Out File Server)
Remote data access for Hyper-V
Data access resiliency
File System (CSVFS/ReFS)
System-wide data access
Fast VHDX creation, grow and merge
Data Repair
Storage Spaces
Storage pooling
Virtual disks
Data storage resiliency
Software Storage Bus
Spans all storage nodes
Virtualizes physical disks
Leverages SMB3 and SMB Direct
Storage nodes with internal disks
SATA, NVMe, SAS
SMB3 Storage Network Fabric
Software Defined Storage System
Scale-Out File Server \\FileServer\Share
Cluster Shared Volumes C:\ClusterStorage
Storage Space Virtual Disks
Storage Pool
Software Storage Bus
Storage Node
Storage Node
Storage Node
Storage Node

16. Spaces Direct I/O Stack
Server 1
Server 2
Write arrives from compute node
SMB sends it downstream
File Server
\\fileserver\share1
C:\clusterstorage\volume1
CSVFS
File System
File System
Access Layer
VolMgr
VolMgr
PartMgr
PartMgr
Disk
Disk
Spaceport sends write to each copy on disk
Virtualization Layer
SpacePort
SpacePort
Virtual Disks
SBL forwards write to block target on destination node with shortest queue
ClusBT Volume Mgr
Clusport Virtual HBA
Clusport Virtual HBA
ClusBT Volume Mgr
Storage Bus Layer
SBL Disks
SBL on each node sends data to physical stack
PartMgr
PartMgr
Physical Layer
Disk
Disk
Physical Disks
HBA Miniport
HBA Miniport

17. ReFS is the Primary File System
Does not need to pre-fill new files and growing files with zeros
Quickly creates large fixed VHDs
Quickly grows dynamic VHDs
Accelerated
VHD creation and growth
VM checkpoints have parent-child VHDs
After backup completes, Hyper-V historically moved all data from child to parent (slow VHD “merge”)
Using ReFS, Hyper-V now quickly reassigns blocks from the child to the parent
Efficient
VM checkpoint clean-up after backup
HDDs are optimized for capacity
SSDs are optimized for performance
ReFS keeps hot data in SSDs and cold data in HDDs, providing both performance and capacity
Affordable
Performance of SSDs, capacity of HDDs
SSD
Available per-file integrity streams validate file contents
Upon error detection, ReFS retrieves a correct copy from Storage Spaces, if available
ReFS uses the correct copy to automatically repair the corruption
Resilient
Optional automatic error correction

18. BRK3474: Enabling Private Cloud Storage Using Servers with Local Disks
ReFS: Resiliency
Metadata Checksums
Checksums protect all filesystem metadata
User Data Checksums
Optional checksums protect file data
Checksum Verification
Occurs on every read of checksum-protected data
And during background scrubbing
Healing of Detected Corruption
Healing occurs as soon as corruption is detected
Healthy version searched for in Spaces alternate copies (i.e. mirrors or parity data)
Corrupt version overwritten by healthy version
Spaces 3-Way Mirror with ReFS
Disk 1
Disk 2
Disk 3
Reads striped across all three disks
Checksums verified on reads
On checksum mismatch, mirrors are consulted
Good copies used to heal bad mirror

19. Storage Spaces Direct Hardware Deployment Options
Visit Microsoft Cloud Platform booth to see full demo and hardware
Storage Spaces Direct Hardware Deployment Options

20. PowerEdge R730xd Up to 2 Intel Xeon E5- 2600 v3 (18 core) CPUs
24DIMM slots (DDR4, 2133)
Up to 16x3.5 “+2 x2.5“ Drive Slots
64 TB for Data with 4TB disk
96 TB for Data with 6TB disk
Internal Storage ( SAS , SATA, NVMe
2U Height
Up to 6 PCIe slots
Network Select Adapter (choice of onboard NIC)
Storage Spaces Certified HBA

21. PowerEdge R730xd Overview (Rear)
Full Length, Full Height Slots PCIe3 x16 (x16 connector)
Half Length, Low Profile Slots PCIe3 x8 (x16 connector)
vFlash Media Card Slot
Full Length, Full Height Slot PCIe3 x8 (x16 connector)
2 x 2.5” Drive Bays
USB 3.0 / Ports
Dedicated Management Port
Video Connector
Up to 2 x Redundant Power Supplies – 495W, 750W and 1100W (AC or DC) options
Network Daughter Card (choice of 4 x 1GbE or 2 x 10GbE + 2 x 1GbE); SFP+ Option Available
Serial Connector

22. PowerEdge R730xd Overview (Internal Bay)

23. Exceptional performance and versatility for dynamic workloads Dell PowerEdge R730xd and R730 industry reviews
Intel Technology Innovation Accelerated Award
“The results are in, and the Dell PowerEdge R730 kicks some serious butt.”
PowerEdge R730xd offers an “incredible range of configurability.”
“The storage-centric R730xd offers new degrees of flexibility… to keep storage as close as possible to the compute layer.”
“Dell has hit a long home run with the PowerEdge R730xd, delivering a powerful 2U server with lots of room to grow.”

24. DEMO @ Microsoft Cloud Platform Booth
Dell S4810 Networking Switch
PowerEdge R630 Hyper-V Cluster
PowerEdge R730xd Spaces Direct Cluster
Storage : 13x 4TB HDD+4x900 GB SSD
Network : Intel GB+i350 GB
RDMA : Mellanox Connectx-3 10GB SPF

25. Deployment Process TechEd 2013 4/16/2017 2:37 PM
Install H/W
Validate H/W (validation tests)
Install OS, Configure Roles, Features and Network, Cluster, Set Cluster Property
Validate Cluster Storage & File Share
Run workload
Ongoing Monitoring & Troubleshooting
© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

26. Simple deployment using PowerShell
#Create cluster
New-Cluster –Name cluster01 –Node machine1, machines2, machine3 –NoStorage
# Enable Storage Spaces Shared Nothing
(Get-Cluster).DASModeEnabled = 1
#Create file server
Add-ClusterScaleOutFileServerRole -Name sofs1
#Create storage pool and define storage tiers
New-StoragePool -StorageSubSystemFriendlyName *clustered* -FriendlyName DAS -ProvisioningTypeDefault Fixed -ResiliencySettingNameDefault Mirror -PhysicalDisk (Get-PhysicalDisk | ? CanPool -eq $true)
#Create virtual disk
New-Volume -StoragePoolFriendlyName DAS -FriendlyName vdisk01 -PhysicalDiskRedundancy 2 -FileSystem CSVFS_REFS –Size 4000GB
#Create file share
md c:\clusterstorage\volume1\share1
new-smbshare -name share1 -path c:\clusterstorage\volume1\share1 -fullaccess HyperV01, Hyper-V02
set-smbpathacl -sharename share1
<-New

27. Monitoring and Troubleshooting
4/16/2017
Monitoring and Troubleshooting
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

28. Dell OpenManage Integration Suite for Microsoft System Center
Deploy
Update
Monitor
Virtual Management
Dell Server and Client Deployment Packs
Dell Server and Client Update Catalogs
Dell Hardware Management Pack Suites
Dell Server PRO Management Pack
Dell Lifecycle Controller Integration

29. Storage Diagnostic Logs Cmdlets
4/16/2017
Storage Diagnostic Logs Cmdlets
#Starts storage tracing sessions in the given subsystem
Start-StorageDiagnosticLog -StorageSubSystemFriendlyName “RemoteSQLCluster”
#Repro the issue
#Stops currently running storage tracing sessions in the given subsystem
Stop-StorageDiagnosticLog -StorageSubSystemFriendlyName “RemoteSQLCluster”
#Gathers storage event logs, trace logs & live dumps from each node in the cluster
Get-StorageDiagnosticInfo -StorageSubSystemFriendlyName “RemoteSQLCluster” –DestinationPath D:\StorageLogs\
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

30. SCOM Storage Monitoring
Microsoft Ignite 2015
4/16/2017 2:37 PM
SCOM Storage Monitoring
Storage subsystem determines health
Focus on relevant objects
Storage subsystem, volumes and file shares
Automatic remediation when possible
Actionable alerts
Alert specifies urgency
Alert specifies remediation action
Alerts automatically resolve when issue is addressed
Easy to determine affected objects
Consumable through PowerShell or 3rd parties
SMAPI
System Center vNext
Operations Manager
Virtual Machine Manager
User notifications
Dashboard
Actions
Discovery
3rd Party
Monitoring
Actions
Storage System
Health Logic
PowerShell
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

31. Dell & Microsoft Key Value
Dell-Microsoft End –End Solutions (VDI,Private Cloud)
Hyper-V clusters
Dell Management Software and Plug-ins for System Center
Dell PowerEdge Servers
Tested and Validated for Scalable and Reliable Deployment
Dell Network Switches
Data Center Networking
Scale-out file server clusters
Storage Space
Dell PowerEdge Servers
Dell PowerVault JBOD Storage

32. Dell and Microsoft Partnership Continuous and Co-Engineering
4/16/2017 2:37 PM
Dell and Microsoft Partnership Continuous and Co-Engineering
Storage Spaces (Windows Server 2012 R2)
Microsoft and Dell validated Hardware and solutions
Dell Storage with Microsoft Storage Spaces
Cloud Platform System
Built on Dell Hardware
Best Practices, Driver optimization, etc.
Storage Spaces Direct (Windows Server vNext)
Co-Engineer Solution
Joined TAP
Dedicated Engineering teams: Microsoft and Dell
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

33. Leverage the power of Dell and Microsoft alliance
US Windows Deployment Partner of the Year
US Windows Partner of the Year
Most complete
Full, end-to-end capabilities – from tablets to the data center
2 years running
2013
Single Point of Contact
Dell provides a single contact for total solution
Global Solutions Centers
Joint IP/development
TAP participation
Broad participation in Technology Adoption Programs
Demonstrate the full Microsoft stack
running on Dell
Engineering labs, technology centers, centers of excellence

34. “Dell is Microsoft’s largest OEM partner to have implemented support for Storage Spaces. Dell provides the most complete Storage Spaces implementation – server, controller, JBOD and disks form an end-to-end solution, and this support includes new features such as JBOD monitoring.”
Microsoft Server and Cloud Platform Team
TechNet Server & Cloud Blog

35. Summary Storage Spaces (Windows Server 2012 R2)
4/16/2017 2:37 PM
Summary
Storage Spaces (Windows Server 2012 R2)
Scalable , Resilient and Efficient SDS solution
Dell and Microsoft collaborate , innovate and optimize for real worked deployments
For today’s Storage Spaces needs deploy Dell DSMS solutions
Visit Dell’s Booth on Expo Floor
Storage Spaces Direct (Windows Server vNext)
Join TAP
Visit Microsoft Cloud Platform Dell Booth in Expo Floor
Visit for updated information
Leverage the power of Dell and Microsoft alliance
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

36. Q & A

37. Please evaluate this session
4/16/2017 2:37 PM
Please evaluate this session
Your feedback is important to us!
Visit Myignite at or download and use the Ignite Mobile App with the QR code above.
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

38. 4/16/2017 2:37 PM
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.