Download presentation
Presentation is loading. Please wait.
Published byMegan Welch Modified over 9 years ago
1
Windows HPC Server 2008 R2 – An Introduction Vinoo Srinivas Solutions Specialist
2
Trends Impacting HPC Landscape Data Proliferation Management Data Explosion Managing data Control & Align Costs Enmeshing of Enterprise IT and HPC System Management Costs Accelerate Innovation Multi-core platforms Heterogeneous systems Make HPC Broadly Accessible Upgrade IT skills Easy access for end users
3
What we’re hearing Parallel development is too hard Too much time mired in technology Deployment, maintenance, and trouble shooting is cumbersome Easier programming models for multi-core and multi-server. Better workflow Easier to get started with HPC Better end to end integration Windows and Office Familiarity Utilize existing Windows skillsets Transparent, integrated solution Enable developers to more easily express parallelism Simplify the process of designing and testing Integrated Solutions Interoperable Solutions Better Admin Tools Integrated Offering Linux interoperability Take better advantage of your existing infrastructure Challenges Needs Microsoft Approach
4
Free Lunch Is Over For Traditional Software Operations per second for serial code Additional operations per second if code can take advantage of concurrency
5
“ Provide the platform, tools and broad ecosystem to reduce the complexity of HPC by making parallelism more accessible to address future computational needs.” Ease deployment for larger scale clusters Simplify management for clusters of all scale Integrate with existing infrastructure Address needs of traditional supercomputing Address emerging cross-industry computation trends Enable non-technical users to harness the power of HPC Increase number of parallel applications and codes Offer choice of parallel development tools, languages and libraries Drive larger universe of end-users, developers, and system administrators
6
Personal Super Computing Built on Windows Server 2003 Microsoft Entry into HPC Addressing Personal And Workgroup Needs End User Applications available for Windows Parallel and HPC Development Tools Ease of Management and Deployment
7
Broad Reaching HPC Built on Windows Server 2008 Support Traditional & Emerging HPC Larger Cluster support & Top500 Range Better integration for Windows-based Users Broader Developer support with tools and SOA Improved Management and Deployment
8
Complete, integrated platform for HPC Clustering Built on top Windows Server 2008 64-bit Operating System Addresses the needs of traditional and emerging HPC Windows Server 2008 HPC Edition Secure, Reliable, Tested Support for high performance hardware (x64, high-speed interconnects) Microsoft HPC Pack 2008 Job Scheduler Resource Manager Cluster Management Message Passing Interface Microsoft Windows HPC Server 2008 Integrated Solution out-of-the-box Leverages investment in Windows administration and tools Makes cluster operation easy and secure as a single system
9
Systems Management Job Scheduling Networking & MPI Storage New System Center UI PowerShell for CLI Management High Availability for Head Nodes Windows Deployment Services Diagnostics/Reporting Support for Operations Manager Support for SOA and WCF Granular resource scheduling Improved scalability for larger clusters New Job scheduling policies Interoperability via HPC Profile NetworkDirect (RDMA) for MPI Improved Network Configuration Wizard Shared Memory MS-MPI for multi-core MS-MPI integrated with Windows Event Tracing Improved iSCSI SAN & parallel file system Support in Win2008 Improved Server Message Block ( SMB v2) New 3 rd party parallel file system support for Windows New Memory Cache Vendors
10
Focus on Performance Windows CCS 2003 Targeted small workgroup clusters. Performance numbers on CCS weren’t adequate November 2005 top500 HLP run: 43% efficiency Performance became a perennial focus after the release of Windows CCS 2003. Windows HPC Server 2008 Includes only the necessary OS components for HPC Introduces MPI over NetworkDirect (RDMA on Windows) SMB 2 improves I/O performance Introduction of Microsoft Performance Lab 43% 77%
11
Apps perform better on v2 0 2 4 6 8 10 12 5.00 4.50 4.00 3.50 3.00 2.50 2.00 1.50 1.00 Number of Cores Elapsed Time Speed – BMD-6 CCS W R11 HPCS W R12 ANSYS Mechanical Comparison of Windows Compute Cluster Server 2003 (v1) with ANSYS R11 Windows HPC Server 2008 (v2) with ANSYS R12 © 2008 ANSYS, Inc. All Rights reserved ANSYS, Inc. Proprietary Latency in OS Application not tuned for Windows Greatly improved performance when OS & Application Tuned
12
Windows delivers high performance on standard benchmarks Memory throughput performance on Intel Xeon® Processor X5550: Function Rate (MB/s) Copy: 38710.5347 Scale: 38722.8032 Add: 37164.4369 Triad: 37180.2195 MPI PingPong Bandwidth on a QDR IB fabric: ~3GB/s** MPI PingPong Latency on a QDR IB fabric: Under 2us** Latest HPL results from www.top500.org: Memory Throughput (Measured by Stream Triad, in GB/s)* Results are based on STREAM benchmark (http://www.cs.virginia.edu/stream). Windows Benchmarks quoted from http://blogs.technet.com/eec/archive/2009/07/15/3264921.aspx. Linux data quoted from http://www.advancedclustering.com/company-blog/stream-benchmarking.html. ** Measured with Windows HPC Server 2008 MPI Diagnostics. Through a single switch, additional switch hop may reduce the network throughput and increase the network latency. Site Umea University University of Stuttgart NCSA Shanghai SC Rmax (Tflops)4650.768.4180 Efficiency85.64%84.35%76.44%77.35%
13
Windows Matches Linux Performance on LSTC LS-DYNA® Courtesy of LSTC Reference: Dataset is car2car, public benchmark. LSTC LS-DYNA data to be posted at http://www.topcrunch.org. LS-DYNA version mpp971.R3.2.1. Similar hardware configuration was used for both Windows HPC Server 2008 and Linux runs: Windows HPC: 2.66GHz Intel® Xeon® Processor X5550, 24GB DDR3 memory per node, QDR InfiniBand Linux: 2.8GHz Intel® Xeon® Processor X5560, 18GB DDR3 memory per node, QDR InfiniBand
15
Single pack with HPL 1.0a + Intel math Kernel Lib
18
Highly Scalable, Efficient HPC Built on Windows Server 2008 R2 Scalable HPC Infrastructure for 1000+ nodes Customizable management elements for superior control Evolved SOA support for scale and programmability Ease parallel development with VS 2010 &.NET 4.0 HPC Services for Excel ® 2010 Expanded capacity through Clusters of Workstations
19
Windows HPC Server 2008 R2 provides a comprehensive and cost-effective solution for harnessing the power of supercomputing through a unique combination of performance, ease of use, and the ability to leverage existing technology investments. SystemsManagement JobScheduler SOA Model Scalability Ease of Use Efficiency Reliable deployment at scale Admin tool experience at scale Support for enterprise databases Clusters of Workstations (CoW) High volume job & task scheduling Dynamic parametric tasks Duplex Message Exchange Pattern Message persistence Automated broker restart or failover Heat map customization Updated node template and software patching wizard Filter by node location Job progress tracking Node prep and release tasks Streamlined job troubleshooting Improved password management Fire & Recollect SOA jobs Out-of-the-box setup for broker Unified WCF configuration SOA job monitoring HPC Services for Excel 2010 iSCSI boot for diskless compute nodes Saved views and filtering Extensible diagnostics Support for custom reporting Service job resource balancing Activate GPGPU jobs Enhanced environment diagnostics Service list and configuration Graceful service shutdown
20
Support for Workstation nodes (COW)* Deployment Environment Validator * iSCSI deployment Capture node image* Deployment at scale Remote database configuration Support for Workstation nodes (COW)* Deployment Environment Validator * iSCSI deployment Capture node image* Deployment at scale Remote database configuration DeploymentDeployment New wizard for software updates* Dynamic node groups* Enhanced node state and node health view * Location-based node Heat map enhancements for large clusters Tabbed views Diagnostics extensibility Reporting extensibility New wizard for software updates* Dynamic node groups* Enhanced node state and node health view * Location-based node Heat map enhancements for large clusters Tabbed views Diagnostics extensibility Reporting extensibility ManagementManagement Diagnostic tests for Microsoft Excel 2010* Expanded macros* Support for UDFs Diagnostic tests for Microsoft Excel 2010* Expanded macros* Support for UDFs HPC Services for Excel 2010 More granular priority levels for jobs* E-mail notifications* Enhanced activation filters* Node exclusion listing* Service-balanced scheduling Dynamic parametric tasks Job progress viewing and reporting Improved job and task troubleshooting Task cancellation grace period New node preparation and node release tasks for jobs Scheduling at scale and better task throughput at scale Update user credentials once for all queued jobs More granular priority levels for jobs* E-mail notifications* Enhanced activation filters* Node exclusion listing* Service-balanced scheduling Dynamic parametric tasks Job progress viewing and reporting Improved job and task troubleshooting Task cancellation grace period New node preparation and node release tasks for jobs Scheduling at scale and better task throughput at scale Update user credentials once for all queued jobs Job scheduling and runtime Ability to cancel running SOA requests* Cleanup interface for SOA* Exclusion of compute nodes that have failed SOA* Improved broker node* SOA Service Loading Test* Enhanced tracing* Support for multiple clients in SOA sessions Fire and recollect programming model Single-job SOA sessions Built-in flow control Better Java interoperability Ability to cancel running SOA requests* Cleanup interface for SOA* Exclusion of compute nodes that have failed SOA* Improved broker node* SOA Service Loading Test* Enhanced tracing* Support for multiple clients in SOA sessions Fire and recollect programming model Single-job SOA sessions Built-in flow control Better Java interoperability SOA scheduling and runtime *New in since Beta 1 Windows HPC Server 2008 R2 provides a comprehensive and cost-effective solution for harnessing the power of supercomputing through a unique combination of performance, ease of use, and the ability to leverage existing technology investments.
21
Make better business decisions by running larger, more sophisticated models Respond to market trends faster and compete more effectively by reducing total time to results Manage risk better by increasing accuracy and visibility into the models and datasets Life Insurance Actuarial workbook examples 1700 records that took 14 hours now take 2.5 minutes 1 million records that took 7.5 days now take 2 hours Increase business agility and accelerate time to results by easily transitioning desktop calculations to Windows HPC computations
22
Run multiple instances of Excel 2010 on Windows HPC Cluster Transition the business logic from desktop to cluster Requires workbook conversion and Excel on compute nodes Excel workbooks on the Cluster New UI built in Excel 2010 for running UDFs on Windows HPC Easy to develop on a desktop and then deploy to a cluster Requires Excel 2010 or Office 2010 Professional Plus on client Excel UDF on the Cluster Run Excel as a SOA (Service Oriented Architecture) client VSTO code in workbook calls out to SOA Service Requires brand new development efforts Excel SOA Client Windows HPC Server 2008 R2 Provides two new mechanisms to distribute Excel calculations to an Windows HPC Cluster NEW
23
Compute Nodes Spreadsheet Head Node Brokers Request Session Broker Assignment Job Submission Task Assignment Results
24
Feature Summary The ability to add Windows 7 workstations as compute nodes View and monitor workstations the same as dedicate compute nodes Time of day scheduling for Workstation availability Draining interval for graceful preemption Expand the capacity of HPC clusters while increasing the return on your existing technology investments by utilizing desktop cycles as part of your over HPC infrastructure. Requirements – Windows 7 Professional or Enterprise, 32 or 64-bit (requires Active Directory support) – Desktops and cluster in same AD Domain – Desktops, head nodes, compute nodes, and broker nodes need to be on the same physical, public, network (topology 5) Security policy prevents unintentional deployment of an OS to desktop nodes
25
Desktop Nodes Windows 7 HPC Pack 2008 R2 Desktop Compute Nodes Windows HPC Server Database Server (Optional) Windows Server 2008 R2 SQL Server Head Node Head node Broker Nodes Windows HPC Server Public Network
26
Windows HPC Pack 2008 - SharePoint Integration Sample provides: Easy to use Web based interface to manage Windows HPC Server jobs integrated into a SharePoint based enterprise portal Source code of the solution allowing developers to further customize the solution Ability to centrally manage, secure, support, and enhance the experience of the Windows HPC Server 2008 users Fuelling productivity and innovation with integration between SharePoint and Windows HPC Server
27
Microsoft collaborates with industry-leading HPC management companies to enable hybrid solutions, helping organizations get more out of HPC investments and provide broader access to HPC resources
28
28 Dual Boot HPC Clusters Dynamic HPC Clusters
29
Monitors performance and health of HPC environments, Linux & Windows! Monitors the service status of the head and cluster nodes Windows Head node monitors include Job Scheduler, Management, SDM, and Database Compute node monitors include Node Manager, Management, and MPI Rich reporting on collected information Provides reports such as CPU utilization, most common alerts, and more Increased Efficiency and Control Integration with Active Directory Hardware Provisioning Virtual Workload Provisioning Deploy, Patching and State Mgmt Performance and Health Monitoring Disaster Recovery Backup Managing Windows & Linux HPC with System Center
30
Release Schedule MayMayJuneJuneJulyJulyAugAugSeptSeptOctOctNovNovDecDecJanJanFebFebMarMar Q2 2009 Q3 2009 Q4 2009 Q1 2010 Community Technical Preview May 2009 Community Technical Preview May 2009 CTP 2 Sept 2009 CTP 2 Sept 2009 Beta Nov 2009 Beta Nov 2009 RTM Summer 2010 English, Chinese, Japanese Beta 2 March 2010 Beta 2 March 2010 RTM Summer 2010 RTM Summer 2010 Mid 2010 Windows HPC Server 2008 SP1
31
Seamless Parallelism Tackling scalable applications from workstation to cluster to cloud Dynamic and elastic virtualized clusters Uniform programming model for scalable applications Easily deploy and manage scalable applications Capacity without limitations for users of those applications Addressing the explosion of data
32
© 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
33
800 600 400 200 0 FLUENT Performance Improvement on Windows HPC Server 2008 32 2416 8 0 Number of Core Rating FLUENT 12.0.0 – HPC Server 2008 FLUENT 6.3 – Windows CCS 2003 Combined OS & applications improvements yielded a 24% improvement at 32cores ANSYS, Inc. Proprietary © 2008 ANSYS, Inc. All Rights reserved Exterior flow around a passenger sedan, 3.6M cells turbulence, pressure-based coupled solver
34
Storage High speed networking Clusters/super computers Financial analysts EngineersScientists Compilers Specialized languages Debuggers
35
Simplified parallel development HPC and IT data centers merge, streamlined cluster management Users with broad access to multiple cores and servers
Similar presentations
© 2025 SlidePlayer.com Inc.
All rights reserved.