1. 9/11/2018 8:37 PM
SESSION CODE: WSV320
Managing and Deploying High Performance Computing Clusters Using Windows HPC Server 2008 R2
Saptak Sen
Senior Product Manager
Technical Computing
Microsoft Corporation
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Session Objectives and Takeaways
9/11/2018
Session Objectives and Takeaways
Session Objective(s): First glance at System Management features for Windows Server 2008 R2, HPC pack.
Key Takeaways
WHPC2K8R2 will enable diskless compute nodes, via iSCSI boot
New Heatmap, allows the cluster admin to view cluster state at a glance.
Diagnostic extensibility allows the ISVs and administrators to author custom tests for windows HPC.
Reporting extensibility will allow cluster administrators to create custom reports.
WHPC2K8R2 will enable customers to expand the capacity of HPC clusters by utilizing desktop cycles
© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. HPC Server Mission and Vision
Make Windows Server the mainstream way to solve scaled-out business, engineering and scientific computational problems.
Enable personal supercomputing
Scale to divisional sized clusters, enable new categories of interactive HPC applications, and interoperate with existing IT infrastructure.
Integrate well with existing HPC and IT infrastructure.
Highly performant and scalable parallel applications.
Deploy, manage, and troubleshoot clusters of up to 1000s of nodes.

4. System Management Vision
Deployment
Monitoring
Diagnostics
Reporting
Provide reliable and consistent system management and “excellent manageability” at departmental and divisional scale (1000s of nodes).
MONITORING: Ability to see at a glance current/recent changes to the system across the whole stack( that affect my app)

5. Windows HPC Server 2008 R2 Platform
Head Node
Windows Server 2008 R2
SQL Server 2008
Powershell 2.0
Compute Nodes
Windows Server 2008 and/or
Client support back to XP
Flexible setup
Database configuration: Files and location
WS2K8
WS2K8 R2
SQL
2008 V3 V2
WS2K8 R2
WS2K8
WS2K8 R2
WS2K8 …
WS2K8 V3 V2 V3 V2 V3 V2

6. Backward Compatibility
System Management
Side-by-side support for Admin Console on same workstation
V2 node.xml file works on V3 cluster without changes.
Upgraded V2 Node Templates work on V3.
User Console and Job Scheduler API Compatibility  more details in the Job Scheduler Presentation
Admin Workstation + - :
Search: s
V2 Head node
V3 Head node
Node.xml
Node Templates
Images

7. Deployment in Windows HPC 2008
We deploy 250 nodes, from bare metal in under an hour.
Built on Windows Deployment Services Transport
Uses PXE and TFTP servers.
Image based Deployment
Custom Window Deployment Services provider to orchestrate the deployment process.
OS image is multicast by default.
Support five basic network topologies
Offline Driver injection via Admin console
One step driver ( INF ) injection/removal
Including IB drivers!

8. Patching in Windows HPC 2008
Ability to patch compute nodes via node deployment templates
Integrated with Microsoft Update.
Provide a patching level - Critical, All or None.
Provide specific patch IDs to be applied to the compute nodes.
Cluster wide Patching reports via Diagnostics
Determine the current patch level across the cluster.
Determine which nodes have patches pending.

9. Deployment Goals for V3 Scale support for 1000 compute nodes.
Support for Wk28 and Wk28 R2 compute nodes.
Upgrade HN from HPC v2 to HPC v3
Support for Remote DB on HN
Support for Diskless Compute Nodes

10. Deployment Scale 1000s of node support. Better troubleshooting
Deployment Progress columns to spot outliers.
Leverage Extensible Diagnostic framework
Investments in higher resilience and better failure recovery.
Remote Database.
Move to asynchronous communication model.

11. Upgrade … Upgrade Head Node to Windows Server 2008 R2
Install HPC Server R2 on Head Node
Upgrade HPC Databases to SQL Server 2008 and HPC V3 Schema
Reimage Compute Nodes
Windows Server 2008 and/or
Windows Server 2008 R2
WS2K8 R2
WS2K8
SQL
Express
2005
SQL
Express
2008 V3 V2
WS2K8
WS2K8 R2
WS2K8 R2
WS2K8 …
WS2K8 V3 V2 V3 V2 V3 V2

12. Remote Database Management and Scheduler Database can be ‘remote’.
Data Center
Management and Scheduler Database can be ‘remote’.
Cannot upgrade from local DB to remote DB.
Any SQL SKU
Cluster Admin needs permissions on Remote DB
WS2K8 R2
WS2K8
SQL
2008 V3 V2
WS2K8
WS2K8 R2
WS2K8 R2
WS2K8 …
WS2K8 V3 V2 V2 V3 V2 V3

13. Diskless HPC Cluster
Support diskless compute nodes at scale, by allowing compute nodes to boot from Storage Array on the network via iSCSI.

14. Diskless Compute Nodes
Enable diskless compute nodes via iSCSI boot.
Compute nodes use volumes(LUNs) on Remote Storage as system disk.
Use DHCP reservations to provide Storage Server information to the diskless compute nodes.
Leverage Storage vendor provided differencing capacity to store Differencing Disks per compute node.

15. New in HPC Server 2008 R2
DHCP reservations
New Patching Wizard
Deployment Progress
Capture Golden Image
Use Excel to edit node list XML

16. Monitoring Goals
Manage and Monitor the cluster at scale.
Manage all resources from a single console.

17. Diagnostics in WHPC 2008 Integrated diagnostics experience
Starting
Select nodes and tests
Start test run
Running
View Progress
Cancel Test
Completed
View test result history
View detailed results
Pivot to failed nodes
View and clear alerts
Export result to Excel

18. New features in Diagnostics
Extensible diagnostics platform
Customizable parameters
Additional in-the-box test

19. Diagnostics Extensibility - Workflow
Each step is defined by a command line.
This allows test to be developed in any coding/scripting language.

20. Reporting in V2 Four categories of built-in reports
Node Availability Report
Job Resource Usage Report
Job Throughput Report
Job Turnaround Report

21. Reporting Data Extensibility in V3
Data Warehouse
DATA
DATA
DATA
Other Authoring Tools
Windows HPC Server
Customer Data Analysis

22. Where are data generated and used?
Data Presentation
Historical Reports
Monitoring Charts
Scalability, Reliability
Data Store
Reporting Data Extensibility
Data Collection
Data Collector
Heat Map
Data Sources
Management
Job Scheduler
Performance Metrics
Event Logs

23. Data Behind the Reports
Node Attributes
Node Event History
Node Data
Job Configurations
Job Task Summary
Job State and Statistics
Job Allocation History
Job Data
Performance Metrics History
Performance Metrics

24. Cluster of Workstations (CoW)
Expand the capacity of HPC clusters while increasing the return on your existing technology investments by utilizing desktop cycles as part of your over HPC infrastructure.
Feature Summary
The ability to add Windows 7 workstations as compute nodes
View and monitor workstations the same as dedicate compute nodes
Time of day scheduling for Workstation availability
Draining interval for graceful preemption
Requirements
Windows 7 Professional or Enterprise, 32 or 64-bit (requires Active Directory support)
Desktops and cluster in same AD Domain
Desktops, head nodes, compute nodes, and broker nodes need to be on the same physical, public, network (topology 5)
Security policy prevents unintentional deployment of an OS to desktop nodes

25. CoW Deployment Desktop Nodes Head Node Compute Nodes Public Network
9/11/2018 8:37 PM
CoW Deployment
Desktop Nodes
Windows 7
HPC Pack 2008 R2 Desktop
Head Node
Compute Nodes
Windows HPC Server
Head node
Windows HPC Server
Public Network
Broker Nodes
Windows HPC Server
Database Server
(Optional)
SQL Server
Windows Server 2008 R2
© 2004 Microsoft Corporation. All rights reserved.
This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

26. Additional Resources
Windows HPC Server 2008 R2 Technical Library -
Windows HPC Server 2008 R2 Beta site on Microsoft Connect -
Diagnostics Extensibility in Windows HPC Server 2008 R2 CTP2 Step-by-Step Guide -
Test Focus Guide for Windows HPC Server 2008 R2 Beta 2 -
Twitter

27. Resources Learning Required Slide www.microsoft.com/teched
Tech Ed North America 2010
9/11/2018 8:37 PM
Required Slide
Resources
Learning
Sessions On-Demand & Community
Microsoft Certification & Training Resources
Resources for IT Professionals
Resources for Developers
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

28. Complete an evaluation on CommNet and enter to win!
Tech Ed North America 2010
9/11/2018 8:37 PM
Required Slide
Complete an evaluation on CommNet and enter to win!
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

29. Sign up for Tech·Ed 2011 and save $500 starting June 8 – June 31st
You can also register at the North America 2011 kiosk located at registration Join us in Atlanta next year

30. Tech Ed North America 2010 9/11/2018 8:37 PM
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
© 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.