1. www.eu-eela.org E-science grid facility for Europe and Latin America gLite Overview User and Site Admin Tutorial Riccardo Bruno – INFN Sez. Catania Dublin (Ireland), 15-18 September 2008

2. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu Grid Aim 2 Grid Systems & Applications aim is to: Integrate Virtualise Manage RESOURCEs and SERVICEs across different VOs. VO – Individuals and/or Institutions having direct access to resources.

3. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu Grid Requirements 3 Heterogeneous (OSes, Devs, Apps.) VO Resource Sharing (Management, Security and Accounting) Resource Utilisation (Reservation, Metering, Monitoring and Logging) Job Execution (VO access, QoS, LCM, WFM, SLA) Data Services (Integration, Provisioning, Cataloguing, Metadata) Security (Authentication, Authorisation and Auditing) Administrative Costs (Provisioning, Deployment and Configuration) Scalability Availability (Disaster Recovery, Fault Management) Specific Requirements: (EGEE: HEP, BioMed) https://savannah.cern.ch/support/?group=egeeptf https://savannah.cern.ch/support/?group=egeeptf

4. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 4 Many VOs need sharing of resources through services Access Allocate Monitor Use Grid Requirements gLite Middleware: Layer between services and resources gLite - Lightweight Middleware for Grid Computing www.glite.org

5. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 5 Other Grid Projects Global Grid Forum - GGF Open Grid Services Architecture – OGSA EU DataGrid AliEn Globus Condor … LCG GTK2Web services based gLite-2gLite-1LCG-2LCG-1gLite-3 GTK4 Behind gLite

6. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 6 Available Pending gLite Services Overview Job repository

7. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 7 Security Service Job Management Monitoring and Discovery Data Management High-level Applications and Tools gLite - simplest view

8. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 8 Two possibilities: APIs and CLI. API+CLI used to build High Level Grid Access UIs Advanced GUIs (Grid2Win) and Web based portals (GENIUS, P-GRADE…)

9. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 9

10. Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 10 Identify entities (users, systems and services) when establishing a context for message exchange (Who are you?). Aim - Provide a Credential having a universal value that works for many purposes across many infrastructures, communities, VOs and projects. gLite uses: PKI (X.509) infrastructure using CAs as thrusted third parties. MyProxy (http://grid.ncsa.uiuc.edu/myproxy/) extended by VOMS.http://grid.ncsa.uiuc.edu/myproxy/ 2 Important features: Single sign on, Delegation mechanism CA and Trust domain: The set of all EGEE CAs is our Trust Domain. Revocation: Identities must be revocated timely Credential Storage: Local or delegated credential (Services or Users) Privacy Preservation: Preserve the use of personal data by mutual AutH Security Consideration: Trusted computing env. Do not serve a whole VO. Authentication

11. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 11 Authorization Allows or denies access to services, based on policies. Agent: The user interacts with a centralized Authorization Server Push: Authorization Services issue Tokens. Pull: The resource asks to the Authorization Services. Authorization Sources (VOMS) : Attribute Authority (AA): User Set of Attibutes. Policy Assertions: Third party policies. (CAS) VOMS – Virtual Organization Membership Serivce Attribute Certificate FQAN

12. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 12 To change: View -> Header and Footer Information services are vital low level component of Grids.

13. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 13 To change: View -> Header and Footer Modeling of Grid Information GLUE Schema (Open Grid Forum) –Abstract modeling for Grid resources –Mapping to concrete schema  RDBMS  LDAP  XML  Others More information … –http://glueschema.forge.cnaf.infn.it/Main/HomePage

14. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 14 To change: View -> Header and Footer Berkeley Database Information Index (BDII) The information hierarchically stored via tree modeling (The LDAP implementation of GLUE) GRISStores information at resource level GIISStores information at site level BDIIStores information at VO level VO Level Site Level Resource Level Information & Monitoring (BDII)

15. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 15

16. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 16 Accumulates information about the resource usage done by users or groups of users (VOs). Information on Grid Services/Resources needs sensors (Resource Metering, Metering Abstraction Layer, Usage Records). Records are collected by the Accounting System (Queries: Users, Groups, Resource) Grid services should register themselves with a pricing service when accounting for billing purposes. INFN enanced the Accounting System also to Data Storage (SAGE) http://sage.gilda-forge.ct.infn.it Accounting

17. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 17 WMS set of middleware components responsible of distribution and management of jobs across Grid resources. Two core components of WMS: WM: accepts and satisfy requests for job management. Matchmaking is the process of assigning the best available resource. Logging & Bookeeping : keeps track of job execution in term of events: (Submitted, Running, Done,...) Workload Management

18. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 18 Service that represents the computing resource that is responsible of the job management: (submission, control, etc.) The CE may be used by a Generic Client: an end-user interacting directly with the Computing Element, or the Workload Manager, which submits a given job to an appropriate CE found by a matchmaking process. Two job submission models (accordingly to user requests and site policies) : PUSH (Eager Scheduling) (jobs pushed to CE), PULL (Lazy Scheduling) ( jobs coming from WMS when CE has free slots ) CE responsible to collect accounting information. Computing Element

19. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 19

20. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 20 SE Services are at least: Storage back-end (Drivers and Hardware) SRM Interface ( Storage Specific: dpm, rfio, …) Transfer service ( Protocols: GridFTP ( gsiftp ), glubus-url-copy, … ) Native POSIX like file I/O API (GFAL) Auxiliary Accounting and Logging services ( accounting: SAGE) Storage Element Data are stored on Disk Pool Servers or Mass Storage Systems

21. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 21 OS like file access metaphor. LFN (Logical file name) GUID (Grid unique identifier) SimLinks SURL (Site URL) TURL (Transfer URL) Catalog

22. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 22 Data Scheduler (DS) Keeps track of user/service transfer requests File Transfer/Placement Service (FTS/FPS) Transfer Queue (Table) Transfer Agent (Network) Data Movement

23. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu AMGA – Arda Metadata Grid Application 23 Metadata Metadata is data about data On the Grid: information about files  Describe files  Locate files based on their contents But also makes DB access a simple task on the Grid  Many Grid applications need structured data  Many applications require only simple schemas  Can be modelled as metadata  Main advantage: better integration with the Grid environment  Metadata Service is a Grid component  Grid security  Hide DB heterogeneity

24. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 24 Configuration and Instrumentation Service – Queries service state. Agreement Service – Implements a communication protocol for the SLAs. Bandwidth Allocation & Reservation service (BAR) – Controlling, Balancing and Manage Network flows.

25. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 25 Grid Access – User Iinterface – Info system – Security MyProxy (Normal, Long term) VOMS Job submission – WMS – Computing Element – Worker Node Data management – Catalogs – Storage elements BDII Grid Services Interaction

26. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu gLite Home Page –www.glite.orgwww.glite.org gLite Architecture –https://edms.cern.ch/file/476451/1.0/architecture.pdfhttps://edms.cern.ch/file/476451/1.0/architecture.pdf gLite Architecture Design v 1.5 –https://edms.cern.ch/file/606574/1.0/design.pdfhttps://edms.cern.ch/file/606574/1.0/design.pdf 26 Grid Services Interaction

27. www.eu-eela.eu Dublin (Ireland), Tutorial for User and Site Admin., 15.09.2008 – 18.09.2008 www.eu-eela.eu 27