1. GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena 2002, Limerick, Ireland June 5, 2002 - Session 7A

2. June 5, 2002Terena 20022 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGAContents

3. June 5, 2002Terena 20023 GRIP: GRid Interoperability Project Funded in part by EU grant IST 2001-32257 Duration: January 2002 – December 2003 Budget: 1.9 Mio URL: www.interoperability-project.org

4. June 5, 2002Terena 20024 Forschungszentrum Jülich, D (Coordinator) Pallas GmbH, D University of Manchester, UK University of Warsaw, PL Deutscher Wetterdienst, D University Southampton, UK Fecit, UK Argonne National Laboratory, US Foils created by partners of the GRIP projectPartners

5. June 5, 2002Terena 20025 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

6. June 5, 2002Terena 20026 UNICORE: UNiform Interface to COmputing Resources conceived prior to the invention of the GRID UNICORE has both a modest and an ambitious goal: Create – –Seamless – –Secure – –Intuitive access to distributed German HPC resources Create a system that can be used in production at the German HPC centers UNICORE Goals

7. June 5, 2002Terena 20027 LRZ: SR 8000, VPP RUS: Hitachi, SX-5 FZJ: 2xT3E, T90, SV1 ZIB: T3E, SGI DWD: T3E, IBM SP RUKA: IBM SP PC²: hpcLine TUD: SGI Pallas: Sun fecit: VPP, Sun FZJ PC² ZIB TUD LRZ RUS DWD Pallas RUKa

8. June 5, 2002Terena 20028 Creation of system-independent jobs Execution at different sites Creation of complex interdependent multi-system and multi-site jobs Monitoring and control of jobs Dependencies Workflow UNICORE Functions

9. June 5, 2002Terena 20029 Transfer of data to and from the workstation Automatic data transfer between systems and sites Access to data in Unix file systems and archives Application support No changes to third party applications Support for legacy job scripts Support for Metacomputing Performance analysis using VAMPIR UNICORE Functions

10. June 5, 2002Terena 200210 Single sign-on No changes to local user management and naming conventions Secure communication over the Internet Support for all platforms, operating systems, and batch systems at partner sites Retaining of administrative autonomy and security policies of participating sites UNICORE Functions

11. June 5, 2002Terena 200211 Continued development and support after the end of the project Basis for additional national and international projects Production quality prototype Objects will be achieved by year end 2002 URL: www.unicore.de UNICORE Functions

12. June 5, 2002Terena 200212 European Grid Testbed Based on UNICORE technology Development of additional UNICORE functions Funded in part by EU grant IST-1999-29247 Duration: November 2000 - October 2003 URL: www.eurogrid.orgEUROGRID

13. June 5, 2002Terena 200213 Geography

14. June 5, 2002Terena 200214 –Forschungszentrum Jülich, D –Pallas GmbH, D (Project Coordinator) –Parallab - University of Bergen, N –CNRS - IDRIS, F –Warsaw University - ICM, PL –Victoria University of Manchester, UK –Deutscher Wetterdienst, D –GIE EADS CCR, F –ETH Zürich (CSCS Manno), CH –Fecit, UK –T-Systems, D EUROGRID Partner

15. June 5, 2002Terena 200215 Development by Argonne National Laboratory and other US partners Defines Protocols and APIs for GRIDs Toolbox to enable development of GRID aware applications Basis for many international Grid projectsGlobus

16. June 5, 2002Terena 200216 Application Layer Collective Layer Resource Layer Fabric Layer Grid Architecture Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices

17. June 5, 2002Terena 200217 Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices Globus Grid Architecture

18. June 5, 2002Terena 200218 Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices Legion Grid Architecture

19. June 5, 2002Terena 200219 Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices UNICORE Grid Architecture

20. June 5, 2002Terena 200220 Globus Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices UNICORE Grid Architecture

21. June 5, 2002Terena 200221 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

22. June 5, 2002Terena 200222 Develop software to facilitate interoperation between UNICORE and Globus combining the unique strength of each system (Pallas, fecit, UoM, FZJ, ANL) Build and demonstrate biomolecular (MD & QC codes) and meteorological (RLM) inter-grid applications (ICM, DWD, SOTON) Create wrappers to support commercial applications in a Grid (no code changes) Contribute to and influence international Grid standards through the Global Grid Forum GRIP Objectives

23. June 5, 2002Terena 200223 Run a UNICORE job on Globus resources Run Jobs using Globus and UNICORE resources together Prototype proposed standards in future versions of UNICORE GRIP Objectives

24. June 5, 2002Terena 200224 Key UNICORE Technologies Seamless Computing Model –Job abstraction –Incarnation –File staging and transfer support Security Model –X509 certificate based security model –Consigner plus endorser model –Several CA policies –Fully flexible firewall support Generic Client –No changes to application needed –Handy GUI environment Portable Server –Java + Perl

25. June 5, 2002Terena 200225 Parallels and Contrasts Resource Description –UNICORE:Same model for discovery and request –Globus:Different models for discovery and request Jobs vs Applications –UNICORE:Workflow environment –Globus:Application APIs and toolkit Security –UNICORE:End-to-End security model –Globus:Requires transitive trust Incarnation and Grounding –UNICORE:Incarnation of abstractions at server –Globus:Client side grounding (substitution to normal form)? Protocol Complexities –UNICORE:Polling (request/response) –Globus:Call back

26. June 5, 2002Terena 200226 Missing Technologies Missing Models in UNICORE –Distributed directory services –Multi-language Implementations –Application level message passing –Event management –Synchronized job start Implementation to be completed in UNICORE –Resource reservation –Interactive processing –Dynamic support for new Vsites on the fly

27. June 5, 2002Terena 200227 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

28. June 5, 2002Terena 200228 User Workstation UNICORE GUI UNICORE Server Gateway UNICORE Site 1 UNICORE Server Gateway UNICORE Site n SSL TCP/IP Site List HTTP SSL Batchsystem Target System Interface Batch SubSystem Batchsystem Target System Interface Batch SubSystem Network Job Supervisor UNICORE Architecture

29. June 5, 2002Terena 200229 Server@Usite X.509 User Certificate Job Preparation Agent (JPA) Job Monitor Controller (JMC) User@Workstation UNICORE Client hosts in a Vsite system 1 TS Interface batch subsystem a system n TS Interface batch subsystem x batch jobs, status requests, data Abstract jobs, status requests Authentication UNICORE Login Gateway User validation Site-specific authentication optional firewall Local user DB Network Job Supervisor (NJS) (Incarnation/Scheduling) Network Job Supervisor a (NJS) (Incarnation/Scheduling) Incarnation DB UNICORE Architecture

30. June 5, 2002Terena 200230 Proposed Architecture Client grid-proxy-init plugin (Logical) Globus Usite Gateway Vsite A NJS Vsite B NJS Generic Globus IDB Globus JM Host A Globus JM Host B Globus TSI Globus GIIS IDB Maker IDB Host A IDB Host B GRIS

31. June 5, 2002Terena 200231 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

32. June 5, 2002Terena 200232 Enhanced Target System Interface Creation Request GRAM job request Callback Data Batch Job Data

33. June 5, 2002Terena 200233 Simplified Architecture implemented by M. Rambadt as part of his Master thesis: No changes to UNICORE or Globus Fixed Globus resource as a Visite Extended TSI interfaces UNICORE and Globus: – –To create proxy certificates – –To map AJO to RSL – –To acts as Globus client – –To return results and status from Globus to NJS and Client Proof of concept Experience

34. June 5, 2002Terena 200234 GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

35. June 5, 2002Terena 200235 First GRIP deliverable (end 2002) will interface UNICORE and Globus 2.0 Project partners work with GGF on future developments OGSA is an important topic OSGA will be considered by GRIP project for 2003 (requires agreement by EU) Outlook

36. June 5, 2002Terena 200236 Architecturally OGSA and UNICORE are very compatible WDSL service types for AJO classes – –Semi-automatic translation for Web Services – –More work for OGSA extension – –Demonstrated by Dave Snelling in Manchester Authorization and Security – –Not yet fully defined in OGSA – –UNICORE expects X.509 to Unix login mapping Outlook

37. June 5, 2002Terena 200237 UNICORE will continue to contribute to Grid developments Grid development will benefit from experience gained at UNICORE Test and Production sites Accepted standards with proven implementations are essential Outlook

38. June 5, 2002Terena 200238 Web addresses: http://www.unicore.de Information about the project http://www.fz-juelich.de/unicore-test Free UNICORE Client Software http://www.unicore.org Download for Software + Sources http://www.eurogrid.org Information about EUROGRID http://www.grid-interoperability.org Information about GRIP

39. June 5, 2002Terena 200239 ? http://www.unicore.de http://www.fz-juelich.de/unicore-test http://www.eurogrid.org http://www.grid-interoperability.org