EGEE is a project funded by the European Union under contract IST-2003-508833 Middleware components in EGEE Mike Mineter NeSC Training team

Slides:



Advertisements
Similar presentations
Workload Management David Colling Imperial College London.
Advertisements

Data Management Expert Panel - WP2. WP2 Overview.
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Hands on Job Services.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Workload management Owen Maroney, Imperial College London (with a little help from David Colling)
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
The Grid Constantinos Kourouyiannis Ξ Architecture Group.
Job Submission The European DataGrid Project Team
A Computation Management Agent for Multi-Institutional Grids
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
EGEE is a project funded by the European Union under contract IST Grid developments and middleware components Mike Mineter EGEE Training team.
The EDG Workload Management System – n° 1 The EDG Workload Management System.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
Grid Infrastructure.
INFSO-RI Enabling Grids for E-sciencE Grid Infrastructure & Related Projects Eddie Aronovich Tel-Aviv University, School of CS
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Computational grids and grids projects DSS,
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – M. Sgaravatto – n° 1 The EU DataGrid Workload Management System: towards.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
M. Sgaravatto – n° 1 The EDG Workload Management System: release 2 Massimo Sgaravatto INFN Padova - DataGrid WP1
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Training and the NGS Mike Mineter
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
EGEE-II INFSO-RI Enabling Grids for E-sciencE An Introduction to the EGEE Project Presented by Min Tsai ISGC 2007, Taipei With thanks.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
EGEE is a project funded by the European Union under contract IST Job Description Language - more control over your Job Assaf Gottlieb University.
TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.
EGEE is a project funded by the European Union under contract IST EGEE Tutorial Turin, January Job Services Emidio.
M. Sgaravatto – n° 1 Overview of release 2 of the EDG WP1 Workload Management System deployed in the INFN production Grid Massimo Sgaravatto INFN Padova.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
EGEE-0 / LCG-2 middleware Practical.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
Workload Management System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Induction: General components of Grid middleware and User Interfaces –April 26-28, General components of Grid middleware and User Interfaces Roberto.
EGEE-II INFSO-RI Enabling Grids for E-sciencE An overview of the EGEE project and middleware Mike Mineter
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Further aspects of EGEE middleware components INFN, Catania EGEE is funded by the European Union under contract IST
EGEE is a project funded by the European Union under contract IST Job Description Language – How to control your Job Nadav Grossaug IsraGrid.
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto INFN Padova.
Job Submission The European DataGrid Project Team
Biomed tutorial 1 Enabling Grids for E-sciencE INFSO-RI EGEE is a project funded by the European Union under contract IST JDL Flavia.
User Interface UI TP: UI User Interface installation & configuration.
13th EELA Tutorial, La Antigua, 18-19, October E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
Introduction to Computing Element HsiKai Wang Academia Sinica Grid Computing Center, Taiwan.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
Workload Management System ( WMS )
EGEE tutorial, Job Description Language - more control over your Job Assaf Gottlieb Tel-Aviv University EGEE is a project.
Job Submission in the DataGrid Workload Management System
Introduction to Grid Technology
Workload Management System
Grid Services Ouafa Bentaleb CERIST, Algeria
5. Job Submission Grid Computing.
Job Submission M. Jouvin (LAL-Orsay)
Presentation transcript:

EGEE is a project funded by the European Union under contract IST Middleware components in EGEE Mike Mineter NeSC Training team

Middleware components in EGEE - 2 Acknowledgements This presentation includes slides and information from many sources:  Roberto Barbera (Slides on middleware are based on presentations given in Edinburgh, April 2004)  Other colleagues in EGEE  The European DataGrid training team  Authors of the LCG-2 User Guide v. 2.0 : Antonio Delgado Peris, Patricia Méndez Lorenzo, Flavia Donno, Andrea Sciabà, Simone Campana, Roberto Santinelli  Additional slides and preparation by Mike Mineter

Middleware components in EGEE - 3 Outline Overview Major components Data management Lifecycle of a job Summary

Middleware components in EGEE - 4 Towards a European e-Infrastructure To underpin European science and technology in the service of society To link with and build on  National, regional and international initiatives  Emerging technologies (e.g. fibre optic networks) To foster international cooperation  both in the creation and the use of the e-infrastructure Network infrastructure ( GÉANT ) Operations, Support and training Collaboration Pan-European Grid

Middleware components in EGEE - 5 User-view of EGEE: a multi-VO Grid User Interface Grid services User Interface

Middleware components in EGEE Present: Globus A software toolkit addressing certain technical problems in the development of Grid enabled tools, services, and applications  Offers a modular “bag of technologies”  Made available under liberal open source license Not turnkey solutions, but building blocks and tools for application developers and system integrators

Middleware components in EGEE - 7 Globus: Key components Grid Security Infrastructure (GSI)  X.509 authentication with delegates and single sign-on Grid Resource Allocation Mgmt (GRAM)  Remote allocation, monitoring of job, control of compute resources GridFTP protocol (FTP extensions)  High-performance data access & transport Grid Resource Information Service (GRIS) + Monitoring and Discovery Service (MDS)  Access to structure & state information Others…

Middleware components in EGEE - 8 VDT “The Virtual Data Toolkit (VDT) is an ensemble of grid middleware that can be easily installed and configured. In our experience, installing grid software is challenging and time consuming. The goal of the VDT is to make it as easy as possible for users to deploy, maintain and use grid middleware.”

Middleware components in EGEE - 9 Virtual Data Toolkit Condor Group  Condor/Condor-G  DAGMan  Fault Tolerant Shell  ClassAds Globus Alliance  Job submission (GRAM)  Information service (MDS)  Data transfer (GridFTP)  Replica Location (RLS) EDG & LCG  Make Gridmap  Certificate Revocation List Updater  GLUE Schema ISI & UC  Chimera & Pegasus NCSA  MyProxy  GSI OpenSSH  UberFTP LBL  PyGlobus  Netlogger Caltech  MonaLisa VDT  VDT System Profiler  Configuration software Others  KX509 (U. Mich.)

Middleware components in EGEE - 10 Part of the Grid “ecosystem”... LCG EGEE Used in USA EU NextGrid … GridCC Future e-Infrastructure EDG GlobusMyProxyCondor... VDT DataTAG AliEn CrossGrid... … SRM

Middleware components in EGEE - 11 Part of the Grid “ecosystem”... LCG EGEE Used in USA EU NextGrid DEISA, … GridCC Future e-Infrastructure EDG GlobusMyProxyCondor... VDT DataTAG AliEn CrossGrid... … SRM Large Hadron Collider Compute Grid “hardened” EDG – with strong focus on LCG challenges

Middleware components in EGEE - 12 Current production mware: LCG-2 Computing clusterNetwork resourcesData storage Operating systemLocal schedulerFile system User accessSecurityData transferInformation schema Workload managementData managementApp monitoring system User interfaces Applications Hardware System software “Basic” services “Collective” services Application level services HPSS, CASTOR… RedHat Linux NFS, … PBS, Condor, LSF,… VDT (Condor, Globus, GLUE) EU DataGrid Information system

Middleware components in EGEE - 13 Outline Overview Major components Data management Lifecycle of a job Summary

Middleware components in EGEE - 14 Major components ReplicaCatalogue Logging & Book-keeping ResourceBrokerStorageElementComputingElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Output “sandbox” Publish SE & CE info “User interface”

Middleware components in EGEE - 15 User Interface node The user’s interface to the Grid Command-line interface to  Proxy server  Job operations To submit a job Monitor its status Retrieve output  Data operations Upload file to SE Access file …  Other grid services Also C++ and Java APIs To run a job user creates a JDL (Job Description Language) file UI JDL

Middleware components in EGEE - 16 Authentication, Authorisation Authentication  User obtains certificate from CA  Connects to UI by ssh  Downloads certificate  Invokes Proxy server  Single logon – to UI - then Secure Socket Layer with proxy identifies user to other nodes Authorisation - currently  User joins Virtual Organisation  VO negotiates access to Grid nodes and resources (CE, SE)  Authorisation tested by CE, SE: gridmapfile maps user to local account UI CA VO mgr Personal VO database Gridmapfiles On CE, SE nodes SSL (proxy) VO service Daily update

Middleware components in EGEE - 17 “Compute element” A CE is a grid batch queue with a “grid gate” front-end: Homogeneous set of worker nodes Grid gate node Local resource management system: Condor / PBS / LSF master Globus gatekeeper Job request Info system Logging gridmapfile I.S. Logging

Middleware components in EGEE - 18 Storage elements and files Storage elements hold files: write once, read many Local Info Event Logging gridmapfile GridFTP Disk arrays or tapes Info system Logging Globus gatekeeper File transferRequests

Middleware components in EGEE - 19 Workload Management System (WMS) Distributed scheduling  multiple UI’s where you submit your job  multiple RB’s from where the job is sent to a CE  multiple CE’s where the job can be put in a queuing system Distributed resource management  multiple information systems that monitor the state of the grid  Information from SE, CE, sites

Middleware components in EGEE - 20 Resource Broker nodes Run the Workload Management System  To accept job submissions  Dispatch jobs to appropriate Compute Element (CE)  Allow users To get information about their status To retrieve their output A configuration file on each UI node determines which RB node(s) will be used When a user submits a job, JDL options are to:  Specify CE  Allow RB to choose CE (using optional tags to define requirements)  Specify SE (then RB finds “nearest” appropriate CE, after interrogating Replica Location Service)

Middleware components in EGEE - 21 Logging and Book-keeping Who did what when?? What’s happening to my job? Usually runs on Resource Broker node See LCG-2 user guide for a bit more on this

Middleware components in EGEE - 22 Information System Receives periodic (~5 minutes) updates from CE, SE Used by RB node to determine resources to be used by a job “Leaf/node” system: currently BDII is used CE SECESE Site Site aSite b Element

Middleware components in EGEE - 23 Information System Based on the Globus “Monitoring and Discovery Service” Receives periodic (~5 minutes) updates from CE, SE Used by RB node to determine resources to be used by a job Uses “GLUE schema”

Middleware components in EGEE - 24 Information System

Middleware components in EGEE - 25

Middleware components in EGEE - 26 Outline Overview Major components Data management Lifecycle of a job Summary

Middleware components in EGEE - 27 Data management User data: generally file-oriented (some RDBMS exceptions exist) Small files: On UI; passed to/from CE via sandbox Large files: require SE  Replica files on different SEs Fault tolerance Performance: – run job on CE “close” to data –share load on SE  Replica Catalogue - what replicas exist for a file?  Replica Location Service - where are they?

Middleware components in EGEE - 28 Replica Location Service (RLS) The Replica Location Service is a system that maintains and provides access to information about the physical location of copies of data files. It is a distributed service that stores mappings between globally unique identifiers of datafiles and the physical identifiers of all existing replicas of these datafiles. Design was a collaboration between Globus and EDG RM RLS ROS RMC

Middleware components in EGEE - 29 Naming Conventions  Logical File Name (LFN) An alias created by a user to refer to some item of data e.g. “lfn:cms/ /run2/track1”  Site URL (SURL) (or Physical File Name (PFN)) The location of an actual piece of data on a storage system e.g. “srm://pcrd24.cern.ch/flatfiles/cms/output10_1”  Globally Unique Identifier (GUID) A non-human readable unique identifier for an item of data e.g. “guid:f81d4fae-7dec-11d0-a765-00a0c91e6bf6” Logical File Name 1 Logical File Name 2 Logical File Name n GUID Physical File SURL n Physical File SURL 1

Middleware components in EGEE - 30 Replica Metadata Catalog (RMC) Replica Location Service (RLS) RMC:  Stores LFN-GUID mappings RLS:  Stores GUID-SURL mappings Logical File Name 1 Logical File Name 2 Logical File Name n GUID Physical File SURL n Physical File SURL 1 RMC RLS RM RLS RMC

Middleware components in EGEE - 31 Storage Element Data Replication Services: Basic Functionality Replica Manager Replica Location Service Replica Metadata Catalog Storage Element Files have replicas stored at many Grid sites on Storage Elements. Each file has a unique GUID. Locations corresponding to the GUID are kept in the Replica Location Service. Users may assign aliases to the GUIDs. These are kept in the Replica Metadata Catalog. The Replica Manager provides atomicity for file operations, assuring consistency of SE and catalog contents.

Middleware components in EGEE - 32 Storage Element Higher Level Replication Services Replica Manager Replica Location Service Replica Optimization Service Replica Metadata Catalog SE Monitor Network Monitor Storage Element The Replica Manager may call on the Replica Optimization service to find the best replica among many based on network and SE monitoring. Hooks for user-defined pre- and post- processing for replication operations are available.

Middleware components in EGEE - 33 Outline Overview Major components Data management Lifecycle of a job Summary

UI Network Server Job Contr. Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node Characts. & status

UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status submitted Job Status UI: allows users to access the functionalities of the WMS (via command line, GUI, C++ and Java APIs)

UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status edg-job-submit myjob.jdl Myjob.jdl JobType = “Normal”; Executable = "$(CMS)/exe/sum.exe"; InputSandbox = {"/home/user/WP1testC","/home/file*”, "/home/user/DATA/*"}; OutputSandbox = {“sim.err”, “test.out”, “sim.log"}; Requirements = other. GlueHostOperatingSystemName == “linux" && other. GlueHostOperatingSystemRelease == "Red Hat 7.3“ && other.GlueCEPolicyMaxCPUTime > 10000; Rank = other.GlueCEStateFreeCPUs; submitted Job Statu s Job Description Language (JDL) to specify job characteristics and requirements

UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Input Sandbox files Job waiting submitted Job Status NS: network daemon responsible for accepting incoming requests

Job submission UI Network Server Job Contr. - CondorG Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status WM: acts to satisfy the request Job Workload manager

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Where must this job be executed ?

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Matchmaker: responsible to find the “best” CE for a job

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Where are (which SEs) the needed data ? What is the status of the Grid ?

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker CE choice

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Job Adapter Job Adapter: responsible for the final “touches” to the job before performing submission (e.g. creation of wrapper script, PFN, etc.)

Job submission UI Network Server Job Contr. Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status Job Controller: responsible for the actual job management operations (done via CondorG) Job submitted waiting ready

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status Job submitted waiting ready scheduled

“Compute element” – reminder! Homogeneous set of worker nodes Grid gate node Local resource management system: Condor / PBS / LSF master Globus gatekeeper Job request Info system Logging gridmapfile I.S. Logging

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status submitted waiting ready scheduled running “Grid enabled” data transfers/ accesses Job Input Sandbox files

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status submitted waiting ready scheduled running done edg-job-get-output

Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Location Server Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done cleared

Job monitoring UI Log Monitor Logging & Bookkeeping Network Server Job Contr. - CondorG Workload Manager Computing Element RB node LM: parses CondorG log file (where CondorG logs info about jobs) and notifies LB LB: receives and stores job events; processes corresponding job status Log of job events edg-job-status edg-job-get-logging-info Job status

Middleware components in EGEE - 52 Interfaces Command-line: ssh onto user interface machine Portals – e.g. GENIUS – access from browser API’s: functions invoked from programs  Job submission  Details: see talks in Madrid via EGEE training website!

Middleware components in EGEE - 53 About jobs… Where is the exe?  On the UI, downloaded in the sandbox  OR: On the Worker Nodes, downloaded for a VO Can MPI be run?  On some compute elements  NOT across compute elements  EGEE – DEISA links for HPC are intended ! Can they be interactive?  Its been seen…BUT it is not supported…

Middleware components in EGEE - 54 Command-line: Job submission edg-job-submit [–r ] [-c ] [-vo ] [-o ]  -r the job is submitted directly to the computing element identified by  -c the configuration file is pointed by the UI instead of the standard configuration file  -vo the Virtual Organization (if user is not happy with the one specified in the UI configuration file)  -o the generated edg_jobId is written in the Useful for other commands, e.g.: edg-job-status –i (or edg_jobId) -i the status information about edg_jobId contained in the are displayed

Middleware components in EGEE - 55 Job Definition Attributes Executable (mandatory)  The command name Arguments (optional)  Job command line arguments StdInput, StdOutput, StdErr (optional)  Standard input/output/error of the job Environment (optional)  List of environment settings InputSandbox (optional)  List of files on the UI local disk needed by the job for running  The listed files are staged from the UI to the remote CE OutputSandbox (optional)  List of files, generated by the job, which have to be retrieved

Middleware components in EGEE - 56 Resource Attributes Requirements  Job requirements on computing resources  Specified using attributes of resources published in the Information System  If not specified, default value defined in UI configuration file is considered Default: other.GlueCEStateStatus == "Production" (the resource has to be in the Production grid) Rank  Expresses preference (how to rank resources that have already met the Requirements expression)  Specified using attributes of resources published in the Information Service  If not specified, default value defined in the UI configuration file is considered Default: - other.GlueCEStateFreeCPUs (the highest number of free CPUs)

Middleware components in EGEE - 57 “Data” Attributes InputData (optional)  Refers to data used as input by the job: these data are published in the Replica Catalog and stored in the SEs)  PFNs and/or LFNs DataAccessProtocol (mandatory if InputData specified)  The protocol or the list of protocols which the application is able to speak with for accessing InputData on a given SE OutputSE (optional)  The hostname of the output SE  RB uses it to choose a CE that is compatible with the job and is close to SE OutputData (optional)  Output Data that will be registered at the end of the job

Middleware components in EGEE - 58 Example JDL File Executable = “gridTest”; StdError = “stderr.log”; StdOutput = “stdout.log”; InputSandbox = {“/home/joda/test/gridTest”}; OutputSandbox = {“stderr.log”, “stdout.log”}; InputData = “lfn:testbed ”; DataAccessProtocol = “gridftp”; Requirements = other.Architecture==“INTEL” && \ other.OpSys==“LINUX” && other.FreeCpus >=4; Rank = “other.GlueHostBenchmarkSF00”;

Middleware components in EGEE - 59 Current production mware: LCG-2 Computing clusterNetwork resourcesData storage Operating systemLocal schedulerFile system User accessSecurityData transferInformation schema Workload managementData managementApp monitoring system User interfaces Applications Hardware System software “Basic” services “Collective” services Application level services HPSS, CASTOR… RedHat Linux NFS, … PBS, Condor, LSF,… VDT (Condor, Globus, GLUE) EU DataGrid Information system

Middleware components in EGEE - 60 Summary: EGEE components ReplicaCatalogue Logging & Book-keeping ResourceBrokerStorageElementComputingElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Output “sandbox” Publish SE & CE info “User interface”