and Alexandre Duarte OurGrid/EELA Interoperability Meeting Campina Grande, 31.08.2006 www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Interoperability Port OurGrid applications to EELA/gLite Port gLite applications to OurGrid Use OurGrid resources to execute jobs submitted to EELA Use EELA resources to execute jobs submitted to OurGrid www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

EELA Infrastructure www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Current Status www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Application Porting www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Port OurGrid Applications to EELA/gLite The OurGrid JDFs are written using a “subset” of the gLite Job Description Language We just need to write a simple translator from OurGrid JDF to a gLite JDL describing a Job Collection Each OurGrid task will be a Job in a gLite job Collection The Input and Output sandboxes will mention only local files May need a dictonary to translate job requirements www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Port EELA/gLite applications to OurGrid Two main aspects to consider: How to deal with DAG jobs ? How to process input and output sandboxes Build a Job Submitter able to: Convert the gLite JDL to a OurGrid JDF Translating all filenames in input and output sandboxes into local file names May need a dictionary to translate job requirements In the case of a DAG it have to create one JDFs for each Node Download all non-local files in the input sandbox to the local file system Submit the Job(s) to MyGrid following (if present) the DAG Upload all non-local files in the output sandbox to their target location www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Use OurGrid resources to execute jobs submitted to EELA www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Job Submission Reviewed www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Computing Element Accepts batch jobs (and job control requests) through a gatekeeper Performs the necessary AAA operations and map to a local user Passes the job to a layer that interacts with the local resource manager BLAH Monitors the status of the jobs and reports it to the client Client Grid Computing Element Monitoring Site AAA and local mapping Job Controller AAA - Authentication Authorization Accounting WN LRMS www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

BLAH The BLAHP (Batch Local ASCII Helper Protocol) provides a set of plain ASCII commands to manage jobs on the batch systems. Batch system interactions Not part of the daemon's core. Performed via external scripts with a common syntax among different batch systems. Three scripts for every batch system: xxx_submit xxx_status xxx_cancel The effort for batch system abstraction is concentrated in these scripts. Adding support for new batch systems requires “only” to write a new set of scripts. www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Proposed Solution Create a plugin for BLAH that can interact with MyGrid using it as a LRMS Problems: Can we really consider MyGrid a LRMS? There are some strong assumptions on batch systems: “There must be a way to dispatch files to running jobs.” Client Grid Computing Element Monitoring Site AAA and local mapping Job Controller MyGrid BLAH Plugin OurGrid Peer www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Use EELA resources to execute jobs submitted to OurGrid www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

OurGrid Archictecture www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

Proposed Solution MyGrid X.509 gLite Peer OurGrid Computing Workload 1 gLite Peer 6 2 OurGrid Workers Computing Element Workload Manager Computing Element 5 3 Worker Nodes Computing Element Computing Element Computing Element 4 www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006

I think that we may have answered the What I think that we may have answered the What. Now we need to answer Who and When. www.eu-eela.org - Campina Grande, OurGrid/EELA interoperability meeting 31.08.2006