Grid Computing at Intel c urrent Status and Outlook Ralf Ratering Senior Software Engineer Intel Parallel and Distributed Solutions Division (PDSD)

2 Agenda  What is the Grid?  Overview of Grid Community  A real-world example: UNICORE  Outlook on Grid Programming Environment

3 What is the Grid? The Grid is a new infrastructure that addresses the industry`s need for computing power and data storage. security sharing distributed resources hardware & software reliability open standards load balancin g single sign-on

4 The Grid Community *Other names and brands may be claimed as the property of others Grid Solutions Enterprise Grid Alliance (EGA), Globus Alliance, IBM, HP, Platform, etc. Grid End Users Grid Standards Global Grid Forum (GGF), W3C, IETF, OASIS, etc. Grid Building Blocks Intel, Globus Toolkit, UNICORE, Platform, Oracle, DataSynapse, IBM, HP, Dell, etc.

5 Grid Software Taxonomy *Names and brands may be claimed as the property of others Grid Software DevelopmentApplications MiddlewareToolsUserwareScienceEnterpriseCollaboration Globus UNICORE Legion Cactus LSF PBSPro SGE Condor... Web Services HPC Grid Tools CA Tools... Web Portals Client Apps... HE Physics Biology Chemistry Meteorology CFD FEA... Oracle 10g United Devices DataSynapse Avaki Platform... Access Grid

6 Service Oriented Architecture (SOA) Virtualization (aggregation, and physical:logical mgnt) Grid Computing (scheduling and coordinating multiple/diverse compute and information resources) Web Services (std app interaction, publish, discover, invoke) Utility Computing (metering, accounting, billing) Autonomic Computing (self-aware, self-optimizing, self- healing, self-managing) SOA P2P (Internet edge- resource interaction) “The Insight Research Corporation, Grid Computing: a Vertical Market Perspective ” SOA is the Grand Synthesis

7 OGSA enabled Server Components Web Services WS Resource Framework WSRF Open Grid Service Architecture OGSA Applications Grid Standards The Grid will not succeed without open standards defined by the community Wrappers around existing applications or completely new Grid applications Mechanisms to manage Grid Services Interface to different servers, storages or networks Define which Grid Services and functionalities are needed Messaging, security, transport, tooling

8 UNICORE  UNICORE connects Supercomputers and Clusters to a Computing Grid  Developed in German research projects by Pallas (now Intel PDSD) and Fujitsu  Heavily used in European and Asian Grid projects  Available as Open Source from UNICORE Forum ( Grid Computing is real and available now!

9 INTERNET UNICORE Architecture in a Nutshell Client Firewall INTRANET Gateway Firewall SSL Network Job Supervisor (NJS) Target System Interface User Database Incarnation Database XML File Gateway Adresses INTRANET Gateway Firewall... Specify platform- independent job signed with user certificate Certificate- Login Mapping Platform-specific information Run platform specific script

10 Intel PDSD Grid Cologne, Germany 2 Node Xeon™ Cluster 4 x Itanium® 2 Nizhny Novgorod, Russia Champaign, Illinois DEMO 4 Node Xeon™ Cluster 4 Node Xeon™ Cluster 4 Node Xeon™ Cluster

11 OGSA enabled Server Components Web Services WS Resource Framework WSRF Open Grid Service Architecture OGSA Applications Grid Programming Language Bringing applications to the Grid... Visual Grid SDK GridBeans Client Framework The next step: Grid Programming Environment (GPE) GPE High Level Grid API Java reference implementation Language independent definition

12 Use Case: Expert User Application Grid Service User Keystore Grid Client  Run multiple applications in complex workflows  Get all information from the Grid Application GS Broker GS Information GS Application GS Database GS WSRF Fully-fledged Java Application

13 Use Case: Application User Application Grid Service User Certificate Application Client WSRF  Only one application  Get only application specific information  Run lightweight client on mobile devices Lightweight Java Application

14 Use Case: Unaware User  What is a "Grid"?  Service provider offers a service on the web Server Server Certificate Service Provider User Web Browser User DB Authenticate using server certificate Request/ Response JSP Application Grid Service WSRF Presentation oriented user interface Register

15 Web Client Application Client Grid Client The Grid Developer Visual Grid SDK  GridBean=Grid Service+Client Plug-in  Wrap existing applications  Write new Grid applications  Plug-in for Eclipse Application GS Broker GS Database GS Information GS Application GS Deploy WSRF G-API Application Plug-in Deploy

16 Grid Service Backends  GPE will provide Grid services to wrap different server types Application GS UNICORE GS Globus GS DRMAA GS Globus Job Manager UNICORE Network Job Supervisor Condor WSRF Sun Grid Engine Native Protocols

17 GPE: The Big Picture G-API Application Client Plug-In User Certificate Mobile Device Web Client Web Browser JSP User Workstation Grid Client Plugins Plug-Ins Keystore G-API Service Provider Application Service Service Certificate Plug-In G-API Application GS Broker GS Information GS Application GS Database GS WSRF Developer Workstation Visual Grid SDK Eclipse Plugin Deploy Plug-Ins Deploy GS DRMAA UNICORE Globus

18 Intel Development Tools Level of Parallelism Serial/Node Level Medium Grain SMP/Cluster Level Coarse Grain Job Parallel-Grid Level Programming Model Compilers OpenMP MPI-2.0 Cluster OMP UNICORE DRMAA G-API Development Tools Performance Analysis VTune Thread Profiler Trace Collector Trace Analyzer Debugging IDB Thread checker IDB-MPP Intel already has industry leading node tools Enhancing here Engage here GPE

19 Summary  The Grid is a new infrastructure that addresses the industries need for computing power and interoperability  It will not succeed without open standards defined by the community  Grid Computing is real and available now! –Download at  The Grid Programming Environment (GPE) enables developers to deploy applications on the Grid

20 BACKUP

21 OGSI Using Grid Services in UNICORE UNICORE Server Service Factory Registry GSFactory Handles Register Service Factory Gateway Service Create Gateway Service Handle XML File Registry Handle HTTPS Request UNICOR E Job Passes through firewalls Client