1. www.eu-eela.eu E-science grid facility for Europe and Latin America Bridging OurGrid-based and gLite-based Grid Infrastructures Abmar de Barros, Adabriand Furtado, Francisco Brasileiro Universidade Federal de Campina Grande Laboratório de Sistemas Distribuídos {abmar,adabriand}@lsd.ufcg.edu.br, fubica@dsc.ufcg.edu.br

2. www.eu-eela.eu Motivation Interoperation of distinct grid e-infrastructures is regarded as an important asset when seeking a sustainable model for the operation of such systems –Interoperability increases the capacity of the e- infrastructures –Also allows a significant reduction in the overall costs of their operation Choroni, 2 nd EELA-2 Conference, 25.11.2009 2

3. www.eu-eela.eu Motivation The EELA-2 e-infrastructure allows resource centres to provide both dedicated resources and shared resources in an unique organisation –The service part runs gLite –The opportunistic part runs OurGrid It is natural that we investigate alternatives to interoperate these two parts of the e-infrastructure Choroni, 2 nd EELA-2 Conference, 25.11.2009 3

4. www.eu-eela.eu So much to say … … so little time!! :-( They say “a picture is worth 1,000 words” …... so, let me try to summarise what we did in 9,000 frames –http://www.youtube.com/watch?v=Q1WZjON EjKk Choroni, 2 nd EELA-2 Conference, 25.11.2009 4

5. www.eu-eela.eu The gateway approach In this approach, a gateway is deployed to bridge the two systems The gateway is responsible for translating a job written in a language accepted by one infrastructure into a job accepted by the other middleware Choroni, 2 nd EELA-2 Conference, 25.11.2009 5

6. www.eu-eela.eu The gateway implementation The gateway technology we use is the 3G- bridge proposed in the context of the EDGeS project Jobs originated in one system run in the other in a completely transparent way – A middleware-specific adaptor is responsible for converting the jobs from their particular native format to a canonical format –The translated jobs are stored in the gateway database to be later dispatched to the appropriate grid –For each grid there is an instance of a middleware- specific plug-in that implements a job management API defined by the 3G-bridge Choroni, 2 nd EELA-2 Conference, 25.11.2009 6

7. www.eu-eela.eu The gateway components Choroni, 2 nd EELA-2 Conference, 25.11.2009 7

8. www.eu-eela.eu Bridging from OurGrid to gLite A modified version of OurGrid worker represents gLite resources This worker is responsible for forwarding the job execution to the bridge, targeting it to gLite back-end It also manages all the job life-cycle using the gateway, obtaining transparency from the perspective of an OurGrid user The gLite plug-in submits the job to a gLite WMS and monitors its execution Choroni, 2 nd EELA-2 Conference, 25.11.2009 8

9. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 9

10. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 10 OG Job An OurGrid Job is submitted in the Broker.

11. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 11 OG Job The worker, instead of executing the job, forwards it to the gateway.

12. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 12 Gateway Job The gateway DB stores the job in a canonical format in order to be executed in the destination grid.

13. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 13 Gateway Job The engine retrieves new jobs from the database and routes them to their destination grid plug-in.

14. www.eu-eela.eu Bridging from OurGrid to gLite Choroni, 2 nd EELA-2 Conference, 25.11.2009 14 gLite Job The gLite plug-in creates a gLite version of the job and submits it to a gLite WMS

15. www.eu-eela.eu Bridging from gLite to OurGrid Transparency of job submission in this way is obtained by modifying a gLite CREAM CE (Computing Element) Instead of forwarding jobs to worker nodes, this CE submits jobs and manages their execution in the gateway The OurGrid plug-in submits the jobs to OurGrid system through the Broker as if they had been submitted by an user Choroni, 2 nd EELA-2 Conference, 25.11.2009 15

16. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 16

17. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 17 gLite Job A gLite user submits a job through an User Interface.

18. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 18 gLite Job This job eventually reaches the modified gLite CE that, instead of executing it in the worker nodes, forwards it to the gateway.

19. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 19 Gateway Job

20. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 20 Gateway Job

21. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 21 OG Job An OurGrid Job is then created and submitted to OG system through a Broker

22. www.eu-eela.eu Bridging from gLite to OurGrid Choroni, 2 nd EELA-2 Conference, 25.11.2009 22 OG Job This job is executed in an OurGrid Worker as if an ordinary OurGrid user has submitted it.

23. www.eu-eela.eu Crossing credentials Security is a main issue regarding grid computing Both OurGrid and gLite use credentials in order to: –Authenticate them against Certification Authorities –Authorize through VOMS servers The gateway job format provides a field indicating user credentials The plug-ins use these credentials on job submission, acting on behalf of the user who actually submitted the job Choroni, 2 nd EELA-2 Conference, 25.11.2009 23

24. www.eu-eela.eu Summary of achievements A Java implementation of the 3g-bridge is currently deployed in the EELA-2 certification infrastructure –Plug-ins for both gLite and OurGrid Initial testing campaign is under way A C++ implementation of the OurGrid plug-in is currently being tested by the EDGeS team Choroni, 2 nd EELA-2 Conference, 25.11.2009 24

25. www.eu-eela.eu Thanks for your attention! More details about this work can be found at: –http://www.eu-eela.eu/http://www.eu-eela.eu/ –http://www.ourgrid.org/http://www.ourgrid.org/ –http://redmine.lsd.ufcg.edu.br/projectshttp://redmine.lsd.ufcg.edu.br/projects Contact me at: –fubica@dsc.ufcg.edu.br Choroni, 2 nd EELA-2 Conference, 25.11.2009 25