We think you have liked this presentation. If you wish to download it, please recommend it to your friends in any social system. Share buttons are a little bit lower. Thank you!
Presentation is loading. Please wait.
Published byMakayla Bryant
Modified over 2 years ago
UNICORE – The Seamless GRID Solution Hans–Christian Hoppe A Member of the ExperTeam Group Pallas GmbH Hermülheimer Straße 10 D–50321 Brühl, Germany TERENA Networking Conference 2002, Limerick
© Pallas GmbH Outline UNICORE approach UNICORE architecture and implementation UNICORE projects Availability and outlook
© Pallas GmbH Approach Provide a uniform work environment for end–users –access and authentication mechanisms (client, certificates, …) –platform details (commands, data archives, batch systems, …) –user–level resource and job model (task graph, …) –job monitoring and controlling Intended UNICORE users –end–users in a specific domain –general HPC end–users –NOT application developers Intended usage modes –batch execution –interactive steering –NOT general purpose interactive
© Pallas GmbH Approach Degree of seamlessness –access and authentication –job model –resource model –job control and monitoring Security mechanisms –user authentication by X.509 certificates –authorization handled by the sites –data integrity and confidentiality by reliance on SSL/https Implementation technique –emphasize portability, rely on standards –use Java for client and server components –build protocols on top of SSL/https –use of XML for storing jobs
© Pallas GmbH Approach System integration and deployment –fit into common firewall configurations –integrate into existing system administration procedures –preserve site autonomy (authorization, quotas, billing, …) Extensibility –provide GUIs for particular applications (plugin mechanism) –extend set of supported resources, incarnation rules –configure third–party file transfers
© Pallas GmbH FZ Jülich LRZ Munich Resource Model UNICORE site(s) Virtual site(s) User submits jobs to a Vsite –soon: automatic resource identification Resources –capacity –capability Resources are advertised to the client –pseudo–dynamic mode T90 T3E–1200 T3E–600 Zampano Processors 256 CPU Time sec Memory Mbyte Permanent disk Mbyte MPI version 1.2 CPMD version 4.1 UNICORE Client SR8000 VPP 700
© Pallas GmbH Job Model Directed acyclic graph of –tasks (computational or data transfer) –sub–jobs (to be executed at another Vsite) –temporal dependencies Attach resource requests to tasks –capacity (CPU time, disk, …) –capability (MPI–2, profiling, …) –can do static tests of jobs –can do resource brokering … If Success Execute LM Model Import Model Data LM–Job T3E–1200 Process–LM Zampano Postprocess Export Data Notify user Transfer Data
© Pallas GmbH UNICORE Network Job Supervisor Architecture Client can run anywhere Gateway as single point of entry NJS incarnates and schedules jobs UDB (User Database) contains user login information IDB (Incarnation Database) contains resource information and job incarnation rules TSI (Target System Interface) interfaces to local batch system Cray NQEPBSPro TSI Network Job Supervisor Gateway Client(s) Insecure Internet IDB TSI IDB UDB FZ Jülich
© Pallas GmbH Security Model Authentication –Gateway requires user certificate to initiate SSL communication –pass (permanent) user certificate along with job description Authorization –Vsite maps certificate to local userid –authorization based on local userid –accommodate site–specific procedures Job and request integrity –each DAG is signed with the users private key –the Vsite executing a sub–job can verify authenticity Required trust –the user protects his/her private key –the CA is not compromised –NO transitive trust between Usites
© Pallas GmbH Technology Client and server components implemented in Java–2 Authentication using X.509 certificates –UNICORE Plus project uses own public key infrastructure (PKI) –software can work with any other PKI Coexistence with firewalls –gateway as single point of entry –can run outside firewall, in DMZ or inside firewall –user authentication at that point: rogue users cant go further Secure data transmission using SSL –additional data encryption considered in EUROGRID Modeling of computational jobs and resources as Java objects (AJO)
© Pallas GmbH Look&Feel See the demonstration at the UNICORE booth (exhibition area)
© Pallas GmbH Application Front–end Create GUIs that support important applications –UNICORE client has a plugin interface –GUI simplifies data entry for application –GUI can support application–specific resources –GUI constructs (complicated) job chains automatically GUI will use UNICORE client to –submit the application job –monitor and control the application job Helpful features –end–users concentrate on applications –extended consistency checks Existing front–ends –CPMD molecular dynamics code –Fluent, Gaussian, …
© Pallas GmbH UNICORE Projects UNICORE = GRID system for seamless access to (High Performance) computing systems ProjectObjectivesDurationFunded by UNICORE PlusSW development, deployment at HPC centers 01/2000– 12/2002 German govt. (BMBF) EUROGRIDEuropean HPC centers, scientific applications, industrial involvement 11/2000 – 10/2003 EU FP5 GRIPInteroperability of UNICORE and Globus 01/2002 – 12/2003 EU FP5 Application and deployment of UNICORE in new FP 5 projects Interest in participating in FP 6 IP and NoE –applications and deployment –extensions –integration into OGSA framework
© Pallas GmbH Availability and Outlook Current version: UNICORE 3.6 –available for project partners and on request –starting June 2002: access to full sources via UNICORE Forum web pages Upcoming production version: UNICORE 4.0 –supports control tasks (If, Repeat, …) –many improvements to the user interface –release in July/August timeframe –partners and source repository will be updated Results from EUROGRID and GRIP to be made available in a similar manner …
© Pallas GmbH Further Information Leaflets (see exhibition booth) WWW pages Plus project Forum project project UNICORE test GRID
GRIP: Interoperability between UNICORE and Globus D. Erwin, M. Rambadt, Ph. Wieder Zentralinstitut für Angewandte Mathematik Forschungszentrum Jülich Terena.
Forschungszentrum Jülich in der Helmholtz-Gesellschaft December 2006 A European Grid Middleware Achim Streit
March 6 th, 2009 OGF 25 Unicore 6 and IPv6 readiness and IPv6 readiness
2010 FutureGrid User Advisory Meeting Architecture Roadmap Long term vision 10:00-10:45, Monday, August 2, 2010 Pittsburgh, PA Gregor von Laszewski Representing.
From Info to Enterprise Implementation Case Study: SBC Corporation Presented to the Crystal Decisions Regional Users Group for the Bay Area on July 24,
The PLANETS Testbed DPE, PLANETS and CASPAR 2nd Annual Conference Lisbon, 5–6 September, 2007 Max Kaiser, Austrian National Library
Windows Clusters Asma Ounnas, Bilel Remmache, Tom Davis and Toby Weiss.
Tecnologia dei Servizi Grid e cloud computing - Lezione 002a 0 Lezione 2a - 14 ottobre 2009 Il materiale didattico usato in questo corso è stato mutuato.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Adoption Status of the OGSA-BES interface Morris Riedel, Mohammad Shahbaz Memon … and many others from the UNICORE community Jülich.
The Anatomy of the Grid Enabling Scalable Virtual Organizations Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department.
Grid Security Alvaro Arenas e-Science Centre, RAL, UK CoreGRID Summer School 2006.
Access Grid Update Robert Olson Argonne National Laboratory SURA/ViDe 5 th Annual Digital Video Workshop.
© 2006 IBM Corporation Introduction to z/OS Security Lesson 4: There’s more to it than RACF.
Interoperability and Usability of Grid Infrastructures Alistair Dunlop Achim Streit University of SouthamptonForschungszentrum Jülich.
RMS and Scheduling for Future Generation Grids Ramin Yahyapour University Dortmund Leader CoreGRID Institute on Resource Management and Scheduling CoreGRID.
1 A Cloud Reference Framework … for discussion only … Please send comments and suggestions to Bhumip Khasnabish Friday,
System Software Overview of China National Grid VEGA R&D Team, Research Centre for Grid and Service Computing, ICT, CAS.
Tecnologia dei Servizi Grid e cloud computing - Lezione 005b 0 Lezione 5B - 18 Novembre 2009 Il materiale didattico usato in questo corso è stato mutuato.
ViPNt ViPNet Product Presentation Infotecs GmbH 2008.
Branch Repeater 5.6, 5.7 & VPX Technical Presentation.
Page 1 LAITS Laboratory for Advanced Information Technology and Standards Duh 7/10/03 The GMU Geospatial Grid Technology Development and Application Project.
Grid Interoperability Through Standards Dr. Alistair Dunlop Project Manager.
Spotlight On Active Directory Interoperability Kim Saunders Director, Interoperability Programs Andreas Luther Group Program Management, Microsoft Identity.
PCTI Limited - A Unique Name For Quality Education CS-75 INTRANET ADMINISTRATION By: Vinay Aggarwal.
Enhanced Middleware Architecture for the Remote Instrumentation e-Infrastructure OGF28 Alexey Cheptsov High Performace Computing Center.
/ 1 N. Williams Grid Middleware Experiences Nadya Williams OCI Grid Computing, University of Zurich
GRIDS Center G rid R esearch I ntegration D evelopment & S upport Copyright Thomas Garritano, This work is the intellectual.
© 2017 SlidePlayer.com Inc. All rights reserved.