Presentation is loading. Please wait.

Presentation is loading. Please wait.

GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena.

Similar presentations


Presentation on theme: "GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena."— Presentation transcript:

1 GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena 2002, Limerick, Ireland June 5, Session 7A

2 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGAContents

3 June 5, 2002Terena GRIP: GRid Interoperability Project Funded in part by EU grant IST Duration: January 2002 – December 2003 Budget: 1.9 Mio URL:

4 June 5, 2002Terena Forschungszentrum Jülich, D (Coordinator) Pallas GmbH, D University of Manchester, UK University of Warsaw, PL Deutscher Wetterdienst, D University Southampton, UK Fecit, UK Argonne National Laboratory, US Foils created by partners of the GRIP projectPartners

5 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

6 June 5, 2002Terena UNICORE: UNiform Interface to COmputing Resources conceived prior to the invention of the GRID UNICORE has both a modest and an ambitious goal: Create – –Seamless – –Secure – –Intuitive access to distributed German HPC resources Create a system that can be used in production at the German HPC centers UNICORE Goals

7 June 5, 2002Terena LRZ: SR 8000, VPP RUS: Hitachi, SX-5 FZJ: 2xT3E, T90, SV1 ZIB: T3E, SGI DWD: T3E, IBM SP RUKA: IBM SP PC²: hpcLine TUD: SGI Pallas: Sun fecit: VPP, Sun FZJ PC² ZIB TUD LRZ RUS DWD Pallas RUKa

8 June 5, 2002Terena Creation of system-independent jobs Execution at different sites Creation of complex interdependent multi-system and multi-site jobs Monitoring and control of jobs Dependencies Workflow UNICORE Functions

9 June 5, 2002Terena Transfer of data to and from the workstation Automatic data transfer between systems and sites Access to data in Unix file systems and archives Application support No changes to third party applications Support for legacy job scripts Support for Metacomputing Performance analysis using VAMPIR UNICORE Functions

10 June 5, 2002Terena Single sign-on No changes to local user management and naming conventions Secure communication over the Internet Support for all platforms, operating systems, and batch systems at partner sites Retaining of administrative autonomy and security policies of participating sites UNICORE Functions

11 June 5, 2002Terena Continued development and support after the end of the project Basis for additional national and international projects Production quality prototype Objects will be achieved by year end 2002 URL: UNICORE Functions

12 June 5, 2002Terena European Grid Testbed Based on UNICORE technology Development of additional UNICORE functions Funded in part by EU grant IST Duration: November October 2003 URL:

13 June 5, 2002Terena Geography

14 June 5, 2002Terena –Forschungszentrum Jülich, D –Pallas GmbH, D (Project Coordinator) –Parallab - University of Bergen, N –CNRS - IDRIS, F –Warsaw University - ICM, PL –Victoria University of Manchester, UK –Deutscher Wetterdienst, D –GIE EADS CCR, F –ETH Zürich (CSCS Manno), CH –Fecit, UK –T-Systems, D EUROGRID Partner

15 June 5, 2002Terena Development by Argonne National Laboratory and other US partners Defines Protocols and APIs for GRIDs Toolbox to enable development of GRID aware applications Basis for many international Grid projectsGlobus

16 June 5, 2002Terena Application Layer Collective Layer Resource Layer Fabric Layer Grid Architecture Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices

17 June 5, 2002Terena Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices Globus Grid Architecture

18 June 5, 2002Terena Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices Legion Grid Architecture

19 June 5, 2002Terena Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices UNICORE Grid Architecture

20 June 5, 2002Terena Globus Application Layer Collective Layer Resource Layer Fabric Layer Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices UNICORE Grid Architecture

21 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

22 June 5, 2002Terena Develop software to facilitate interoperation between UNICORE and Globus combining the unique strength of each system (Pallas, fecit, UoM, FZJ, ANL) Build and demonstrate biomolecular (MD & QC codes) and meteorological (RLM) inter-grid applications (ICM, DWD, SOTON) Create wrappers to support commercial applications in a Grid (no code changes) Contribute to and influence international Grid standards through the Global Grid Forum GRIP Objectives

23 June 5, 2002Terena Run a UNICORE job on Globus resources Run Jobs using Globus and UNICORE resources together Prototype proposed standards in future versions of UNICORE GRIP Objectives

24 June 5, 2002Terena Key UNICORE Technologies Seamless Computing Model –Job abstraction –Incarnation –File staging and transfer support Security Model –X509 certificate based security model –Consigner plus endorser model –Several CA policies –Fully flexible firewall support Generic Client –No changes to application needed –Handy GUI environment Portable Server –Java + Perl

25 June 5, 2002Terena Parallels and Contrasts Resource Description –UNICORE:Same model for discovery and request –Globus:Different models for discovery and request Jobs vs Applications –UNICORE:Workflow environment –Globus:Application APIs and toolkit Security –UNICORE:End-to-End security model –Globus:Requires transitive trust Incarnation and Grounding –UNICORE:Incarnation of abstractions at server –Globus:Client side grounding (substitution to normal form)? Protocol Complexities –UNICORE:Polling (request/response) –Globus:Call back

26 June 5, 2002Terena Missing Technologies Missing Models in UNICORE –Distributed directory services –Multi-language Implementations –Application level message passing –Event management –Synchronized job start Implementation to be completed in UNICORE –Resource reservation –Interactive processing –Dynamic support for new Vsites on the fly

27 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

28 June 5, 2002Terena User Workstation UNICORE GUI UNICORE Server Gateway UNICORE Site 1 UNICORE Server Gateway UNICORE Site n SSL TCP/IP Site List HTTP SSL Batchsystem Target System Interface Batch SubSystem Batchsystem Target System Interface Batch SubSystem Network Job Supervisor UNICORE Architecture

29 June 5, 2002Terena X.509 User Certificate Job Preparation Agent (JPA) Job Monitor Controller (JMC) UNICORE Client hosts in a Vsite system 1 TS Interface batch subsystem a system n TS Interface batch subsystem x batch jobs, status requests, data Abstract jobs, status requests Authentication UNICORE Login Gateway User validation Site-specific authentication optional firewall Local user DB Network Job Supervisor (NJS) (Incarnation/Scheduling) Network Job Supervisor a (NJS) (Incarnation/Scheduling) Incarnation DB UNICORE Architecture

30 June 5, 2002Terena Proposed Architecture Client grid-proxy-init plugin (Logical) Globus Usite Gateway Vsite A NJS Vsite B NJS Generic Globus IDB Globus JM Host A Globus JM Host B Globus TSI Globus GIIS IDB Maker IDB Host A IDB Host B GRIS

31 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

32 June 5, 2002Terena Enhanced Target System Interface Creation Request GRAM job request Callback Data Batch Job Data

33 June 5, 2002Terena Simplified Architecture implemented by M. Rambadt as part of his Master thesis: No changes to UNICORE or Globus Fixed Globus resource as a Visite Extended TSI interfaces UNICORE and Globus: – –To create proxy certificates – –To map AJO to RSL – –To acts as Globus client – –To return results and status from Globus to NJS and Client Proof of concept Experience

34 June 5, 2002Terena GRIP Partners UNICORE and Globus GRIP Objectives The GRIP Architecture Experience with an early prototype GRIP and OSGA

35 June 5, 2002Terena First GRIP deliverable (end 2002) will interface UNICORE and Globus 2.0 Project partners work with GGF on future developments OGSA is an important topic OSGA will be considered by GRIP project for 2003 (requires agreement by EU) Outlook

36 June 5, 2002Terena Architecturally OGSA and UNICORE are very compatible WDSL service types for AJO classes – –Semi-automatic translation for Web Services – –More work for OGSA extension – –Demonstrated by Dave Snelling in Manchester Authorization and Security – –Not yet fully defined in OGSA – –UNICORE expects X.509 to Unix login mapping Outlook

37 June 5, 2002Terena UNICORE will continue to contribute to Grid developments Grid development will benefit from experience gained at UNICORE Test and Production sites Accepted standards with proven implementations are essential Outlook

38 June 5, 2002Terena Web addresses: Information about the project Free UNICORE Client Software Download for Software + Sources Information about EUROGRID Information about GRIP

39 June 5, 2002Terena ?


Download ppt "GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena."

Similar presentations


Ads by Google