Forschungszentrum Jülich in der Helmholtz-Gemeinschaft UNICORE and Grid Computing in Europe Dietmar Erwin Forschungszentrum Jülich August 27, 2003

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG2 Contents Introduction to FZJ Objectives and Status of UNICORE Grid Projects in Europe Eurogrid, GRIP and OGSA

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG3 “The Future is Our Mission” M atter E nergy I nformation L ife E nvironment Source FZJ

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG4 Forschungszentrum Jülich at a Glance Founded: Dec Area: 2.2 km 2 Legal Form: PLC Operator: Federal Republic of Germany (90 %) State of North Rhine-Westphalia (10 %) Bodies: Partners Meeting Supervisory Board Board of Directors Scientific and Technical Council Scientific/Technical Structure: 10 Departments (39 Institutes) 7 Central Departments 2 Programme Groups 3 Project Management Groups Budget:Institutional:€ 236 Mio/year Non-institutional:€ 52 Mio /year Staff:4200 Including: 1000 Scientists 400 Postgraduate Students 150 Undergraduate Students 300 Trainees Visiting Scientists: more than 700 annually from more than 30 countries Source FZJ

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG5 UNICORE: Uniform Interface to Computing Resources Developed software for a seamless, secure, and intuitive access to distributed computing resources Funded by BMBF, grant: 01 IR 001 Objectives

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG6 UNICORE Highlights UNICORE Highlights Intuitive, system-independent creation and control of jobs Support for multi-system and multi-site jobs Dynamic flow control Integrated security through X.509 certificates Access to remote file stores and archives Extensible support for scientific & commercial applications Minimal intrusion into site autonomy

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG7 UNICORE Screenshot

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG8 Batch Subsystem AJO User Certificate Job Preparation Agent (JPA) Job Monitor Controller (JMC) Abstract status request User authentication List of Sites UNICORE Client Target System Interface (TSI) Incarnated job Commands User mapping, Resources info Site-specific authorization TSI Batch Subsystem FZJLRZ... TSI Batch Subsystem Preparation and Control of jobs Network Job Superviser (NJS) Unsafe Internet (SSL/https) Safe Intranet (TCP/http) IDB Job incarnation Sending jobs to other gateways, data transfer Status request SV1 T3E SR8000 files UUDB IDB UUDBIDB NJS UNICORE Gateway optional firewall UNICORE Gateway NJS UNICORE Architecture

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG9 CPMD Application support

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG10 Ad hoc weather prediction C: EUROGRID Projekt Source DWD

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG11 UNICORE Status Project UNICORE Plus successfully completed Report at: http: // UNICORE basis for a German HPC Grid (LRZ, HLRS, FZJ) Software available as Open Source for R&D projects http: // UNICORE commercially supported and marketed by Pallas UNICORE used in European Grid projects UNICORE selected by Japanese NAREGI project

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG12 LRZ: SR 8000, VPP, LC* RUS: SX-5, 2xLC* FZJ: 2xT3E,SV1, LC* ZIB: T3E, Sun DWD: IBM SP, SGI RUKA: IBM SP PC²: LC* TUD: T3E, SGI Pallas: Sun Fujitsu: VPP, Sun *LC = Linux Cluster UNICORE Deployment FZJ ZIB PC 2 TUD LRZ DWD RUKA RUS

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG13 European Projects Source EC

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG14 First actions launched in IST-FP5 Grid research is a strategic objective in FP FP5 FP6 125M€ 58M€ From FP5 to FP6 Grid research funding more than doubles IST-FP6 commitment to Grid research FP6 Grid Funding Source EC

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG Forschungszentrum Jülich, D Parallab - University of Bergen, N CNRS - IDRIS, F Pallas GmbH, D debis Systemhaus,D Warsaw University - ICM, P Victoria University of Manchester, UK Deutscher Wetterdienst, D GIE EADS CCR, F Fujitsu European Centre for Information Technology, UK ETH Zürich, CH

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG16 Objectives Establish a European GRID network of leading European HPC centres Enhance UNICORE through: –Resource broker –Standard based File Transfer (gridFTP) Demonstrate Grid solution in –Bio molecular simulations, –Weather prediction, –Coupled CAE simulations, –Structural analysis. Funded by EU, grant: IST

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG17 Globus Application Layer Collective Layer Resource Layer Fabric Layer Grid Architecture Applications, Portals, Environments Higher Services, APIs, Protocols APIs, Protocols, SDKs Computers, Networks, Devices UNICORE

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG18 GRIP Objectives 1.To develop interoperability software between UNICORE and Globus based Grid systems 2.To develop and demonstrate techniques for inter-Grid applications in meteorology and bio-molecular science 3.To influence creation of international Grid standards through the Global Grid Forum (GGF) 1.To develop interoperability software between UNICORE and Globus based Grid systems 2.To develop and demonstrate techniques for inter-Grid applications in meteorology and bio-molecular science 3.To influence creation of international Grid standards through the Global Grid Forum (GGF) Grid Interoperability: Creation of virtual organizations using different technologies based on common standards Seamless, secure, intuitive access to different systems and sites to solve complex problems GRIP partners - lead GGF working/ research groups - work on the definition of OGSA, the Open Grid Service Architecture

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG19 GRIP Partners Forschungszentrum Jülich (FZJ) Pallas University of Manchester (UoM) ICM Warsaw (ICM) Deutscher Wetterdienst (DWD) University of Southampton (Soton) Fujitsu European Laboratories Argonne National Laboratories (ANL)

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG20 GRIP Status UNICORE Interoperability Software implemented (FZJ) Interoperability UNICORE – Globus demonstrated Development of OGSA interfaces in 2003

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG21 Batch Subsystem AJO User Certificate Job Preparation Agent (JPA) Job Monitor Controller (JMC) Abstract status request User authentication List of Sites UNICORE Client Target System Interface (TSI) Incarnated job Commands User mapping, Resources info Site-specific authorization TSI Batch Subsystem FZJ... Globus TSI Globus Preparation and Control of jobs Network Job Superviser (NJS) Unsafe Internet (SSL/https) Safe Intranet (TCP/http) IDB Job incarnation Sending jobs to other gateways, data transfer Status request SV1 T3E files UUDB IDB UUDBIDB NJS UNICORE Gateway optional firewall UNICORE Gateway NJS UNICORE Architecture

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG22 UNICORE & OGSI Unicore Gateway Unicore Client Network Job Supervisor Resource Database User Database Organic Server PrimePower OGSA Service Resource Broker Work to be completed in 2003 –Integrate Grid Service Hosting into Gateway –UPL portType Vsite Discovery Consign Job Retrieve Outcome –Add Grid Service interface to Client –Broker Interfaces and Ontology User certificate security domain User proxy certificate security domain Fujitsu Laboratories of Europe © 2003

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG23 Unicore Gateway Unicore Client Network Job Supervisor Resource Database User Database Organic Server PrimePower OGSA Service Resource Broker User certificate security domain User proxy certificate security domain Future Work Full OGSA compliant UNICORE Implementation Fujitsu Laboratories of Europe © 2003

Forschungszentrum Jülich in der Helmholtz-Gemeinschaft HPN Workshop via AG24 Further Information