E-science grid facility for Europe and Latin America JRA1 – Annual Activity Report Francisco Brasileiro Universidade Federal de Campina Grande – UFCG (Brazil) Diego Scardaci Istituto Nazionale di Fisica Nucleare – INFN (Italy) TB + EAC Meeting Bogotá,

E-science grid facility for Europe and Latin America Team Structure –UFCG  Francisco Brasileiro (Activity Manager)  Rafael Silva (MSc stud.: policy management in grids)  José Flávio Mendes Jr. (MSc stud.: grid information systems)  Rodrigo Miranda (Leader engineer of OurGrid middleware) –INFN  Diego Scardaci (Activity Manager Deputy) –CIEMAT  Antonio Juan Rubio Montero 2 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.1: Coordination of the Activity –All tasks are followed closely by either the activity manager or his deputy –Communication channels need to be improved  Skype meetings between manager and his deputy at least once per month  Fortnight summary reports from CIEMAT staff  FB shall establish a permanent communication channel with SA1 management  DS shall do the same for NA3 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America Team Structure (task assignment) –TJRA1.1: Activity management (FB and DS) –TJRA1.2: Infra-structure services (Led by RM under close supervision of FB)  TJRA1.2.1: Seed Resources Sharing (FB, RS, RM)  TJRA1.2.2: Porting of gLite to Microsoft Windows platforms (DS)  TJRA1.2.3: Interoperability between gLite and OurGrid (FB, RS, RM)  TJRA1.2.4: Application and VO compliant execution environments through virtualization (FB, RM, AM) –TJRA1.3: Application services (Led by DS)  TJRA1.3.1: Digital archives (DS)  TJRA1.3.2: Secure Storage Service (DS)  TJRA1.3.3: Cooperative workflows and tagging (JF + SegHidro team)  TJRA Additional services (DS) –TJRA1.4: Middleware repository (All team)  DS is the repository manager 4 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.2: Development of Infrastructure- oriented Additional Grid Services –TJRA1.2.1: Seed Resources Sharing  OurGrid has just been released Includes authentication and XMPP-based communication Support for X.509 certificates Support for privacy Application level and resource level security specification Available at and First site already operational at UFCG 5 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.2: Development of Infrastructure- oriented Additional Grid Services –TJRA1.2.2: Porting of gLite to Microsoft Windows platforms  Windows port of gLite UI and Computing Element is ready and available at:  6 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.2: Development of Infrastructure- oriented Additional Grid Services –TJRA1.2.3: Interoperability between gLite and OurGrid  We have moved from a “bridging” approach to a co- existence one OurGrid provides a good interface to run bag-of-tasks gLite is appropriate to support the execution of tightly-coupled applications BoT jobs should be submitted to the best- effort grid, draining these jobs out from the cluster’s queue 7 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.2: Development of Infrastructure- oriented Additional Grid Services –TJRA1.2.3: Interoperability between gLite and OurGrid  Guide available in the EOC site for helping administrators of gLite-based sites to install the OurGrid middleware in co- existence with gLite  Guide available to install standalone OurGrid-based sites  Guide available to write OurGrid jobs  Public portal available for testing OurGrid-enabled applications without the need to install the software –Status and statistics services for the best-effort infrastructure yet to be deployed as a core service  See 8 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.2: Development of Infrastructure- oriented Additional Grid Services –TJRA1.2.4: Application and VO compliant execution environments through virtualization  CIEMAT staff allocated to this task had to concentrate on other affairs during the last four months of 2008  Management expects to profit from a face-to-face meeting during the 1 st EELA-2 conference to get this activity moving at the CIEMAT side –We took advantage of synergy that exists between TJRA1.2.3 and TJRA1.2.4 to reach our milestone  OurGrid sites can run customized virtual machines that support the software required by a given VO 9 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.3: Development of Application- oriented Additional Grid Services –Digital Archives  GSAF is available in a stable version  10 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.3: Development of Application- oriented Additional Grid Services –Secure Storage Service  Available in a stable version  11 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.3: Development of Application- oriented Additional Grid Services –Cooperative workflows and tagging  Prototype available for tagging data of Environmental Science Applications This is a product of the SegHidro Project Relies on a centralized database for tags  Working on a distributed version JF’s MSc dissertation 12 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.3: Development of Application-oriented Additional Grid Services –Additional application-driven grid services  GFAL Java API The GFAL library presents a Posix interface for the I/O operations  gLibrary/DRI gLibrary/DRI extends gLibrary, a system with a easy-to-use web front-end designed to save and organize multimedia assets on Grid-based storage resources  SAGE: Storage Accounting SAGE is a system to measure the usage of storage resources in a gLite based grid infrastructure and make this data available to DGAS (the accounting system of gLite) to account the storage at higher levels  WatchDog Watches the status of a running job when it runs on a working node  Utilities A set of utilities that allow users to easily manage gLite Services 13 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.3: Development of Application-oriented Additional Grid Services –Multiple Middleware Installation  Instruction to install on a single computer a "super" Grid User Interface having clients both for gLite and Globus Toolkit 4 (GT4):  Instruction to install on the machines of a single cluster both a gLite Computing Element and a GT4 job allocation manager thus making a "super" Grid Computing Element: ent  We will provide support to Site-Admins for multiple middleware installation  OurGrid co-existence is compatible with multiple middleware resource centres 14 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America TJRA 1.4: Middleware Repository –EELA-Forge Site:  Forge is available at  Customized for EELA-2  Two project categories Services for the Applications Services for the Infrastructure 15 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America Status of forthcoming actions –Accomplishment of MJRA1.2: prototypes running in the validation infrastructure  Was delayed due to the unavailability of this infrastructure –DJRA1.1: Annual Activity Report  FB and DS have agreed on the template and on the division of tasks; first version should be available in the first week of March –MJRA1.4: Prototype of the gateway to transfer jobs from gLite to OurGrid and vice-versa  This milestone has been affected by the change of focus from interoperability to co-existence  Running gLite BoT jobs in OurGrid should be straightforward We can develop a new OurGrid Broker that is able to parse gLite.jdf files  Running OurGrid jobs on gLite is less interesting, now that the OurGrid-based infrastructure is able to use the gLite-based one in an opportunistic way 16 Bogotá, EELA-2 TB+EAC Meeting,

E-science grid facility for Europe and Latin America JRA1 Resources –JRA1 Section in EELA-2 web site  Contains a summary of the activity goals and points to the Wiki site  –JRA1 Wiki Site  Contains descriptions and links for each JRA1 services  –EELA-Forge Site  All released software  Bogotá, EELA-2 TB+EAC Meeting,