1. www.epikh.eu The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber (salma_saber@eri.sci.eg) Electronic Research Institute (ERI) Cairo, Egypt Africa 4 2010 - Joint EUMEDGRID-Support/EPIKH School for Application Porting Cairo, Egypt, 24.10.2010

2. o Grid Computing Introduction. o Introduction to gLite Middleware. 2 Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 Outline

3. Grid Computing Introduction 3 Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

4. 4 What is the Grid Computing?

5. o Collection of geographically distributed heterogeneous resources. o The Grid computing can share computing and storage resources, also software applications. o These Resources are owned by diverse organizations. o While one computer may take days to complete a complex calculation, the Grid will make available hundreds of collaborative computers to get the same result faster and more efficiently. 5 Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 What is the Grid Computing?

6. Integrate Virtualize Manage RESOURCEs and SERVICEs across different VOs o VO (Virtual Organization)– dynamic collection of multiple organizations providing coordinated resource sharing. 6 Grid Systems & Applications aims to Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

7. o Members of the grid can dynamically be organized into multiple virtual organizations. o Each of these VOs may have different policies and administrative control. o All the VOs are part of a large grid and can share resources accordingly to several policies. o The resources shared among VOs may be data, special hardware, processing capability, Software and licenses. o Members of a grid can be part of multiple VOs at the same time. 7 Grid Computing overview Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

8. 8 Grid User Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

9. 9 Grid User Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 The user sees the Grid as one large computer system, providing computer power.

10. 10 Grid Layers Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

11. 11 Grid Middleware Definition Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 o Grid Middleware: layer between user applications and grid resources. o Grid Middleware should: o Find convenient places for applications to be run. o Optimize use of resources. o Organize efficient access to data. o Deal with authentication to the different sites that are used. o Run the job & monitor progress. o Recover from problems. o Transfer the result back to the users.

12. 12 Grid Standards and Implementations Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 o Standard defined by the Open Grid Forum (OGF) o Current middleware are trying to implement the standards but extra work is required. o Main Grid middleware implementations:

13. Introduction to gLite Middleware 13 Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

14. o The middleware for grid computing developed by EGEE. o Provides a framework for building grid applications tapping into the power of distributed computing and storage resources across the internet. o gLite follows a Service Oriented Architecture.  Facilitate the interoperability among Grid services.  Allow easier compliance with upcoming standards.  The services work together in a concerted way but can also be deployed and used independently allowing their exploitation in different contexts. o Lightweight (existing) services.  Easily and quickly deployable. o Open source license. 14 What is gLite? Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

15. o Computational Resource o Physical machines on which users wants to run their programs and store (or access) data files, without worrying about their physical location o Job o A computational task (a binary application or script) that a user wants to run on the Grid, and retrieve the results o Job Submission o It is the action of delegating the application to the Grid middleware for its execution. 15 gLite Terminology Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

16. 16 Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 gLite Main components services Physical Resources Information Services BDII Computing Element (CE) Worker Node (WN) Storage Element (SE) Security Services Virtual Organization Management System (VOMS) General Services AMGA LHC File Catalogue (LFC) Logging & Bookkeeping (LB) Workload Management System (WMS) User Access User Interface

17. o The User Interface (UI) is the user entry point. o The Workload Management System (WMS) is a set of services which are in charge of finding the suitable resources for the submitted jobs and schedule the jobs. o The Logging and bookkeeping service (LB) keep track of user job execution in terms of statuses: Ready, Scheduled, Waiting, Running, Done. o The Computing element (CE) is the access system to a computational resource. 17 gLite Main components services Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

18. o The Worker Nodes (WNs) are the machines where jobs are really executed. o The Information System and Monitoring (IS and MON now deprecated) maintain data related to available grid resources and their health statuses. o The Virtual Organization Management service (VOMS) is the way gLite improves the management of authentication and authorization to the Grid resources. The VOMS allows to their own members to define different access rights to VO’s resources. o The Storage element (SE) and the File catalogue (LFC) allow to manage Grid files and offer a mechanism to locate them easily for users and jobs. 18 gLite Main components services Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

19. o AMGA – Arda Metadata Grid Application o Metadata is data about data.On the Grid: information about files:  Describe files.  Locate files based on their contents through queries 19 gLite Main components services Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

20. o The official gLite Interface is a Linux Shell Command Line o A complete set of API is available to develop custom interfaces o Language supported: C++, Java, Python o Several additional Interfaces have been developed on top of gLite o GridPortals: provides a customizable interface allowing users to perform a variety of grid operations like remote program submission. o GUIs 20 gLite User Interface Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

21. 21 gLite Security Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

22. 22 gLite Security Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010 o When users register for an account, they get a user name and a password. Using this information, an authorized user can ask for a year-long X.509 digital certificate that is saved in the home directory of the user. o Upon receiving this certificate, users are now ready to carry out jobs on the grid under the Grid Security Infrastructure (GSI). o However, before going onto the grid, users have to log in to the grid. This is done through the creation of temporary proxy certificates using the user certificate. The proxy certificate lasts for 12 hours. o The duration of 12 hours is designed to reduce the impact of an eventual security compromise, e.g., theft of a proxy certificate.

23. 23 gLite Overview Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010

24. 24 Questions Cairo, Joint EPIKH/EUMEDGRID Support Application Porting Tutorial 24.10.2010