IGI – the Italian Grid initiative and its impact for the Astrophysics community Fabio Pasian INAF – Information Systems Unit INAF – Osservatorio Astronomico Trieste

Outline IGI – definition and scope Previous initiatives Activities Impact on astrophysics 10 April 20082F.Pasian - Italian Grid Infrastructure

IGI IGI = association for the Italian Grid Infrastructure Has been established as a consortium of 10 different national institutions and 4 consortia to provide long term sustainability for the Italian Grid. Partners: INFN, CNR, ELETTRA, ENEA, INAF, INGV, UNICAL, UNINA, UNIPG, UNIPNM; COMETA, COSMOLAB, GARR, SPACI 10 April 20083F.Pasian - Italian Grid Infrastructure

IGI – scope IGI focuses on setting up and operating a common e- Infrastructure for the Italian Sciences, and includes the main public Resource Providers and Computing Centers, in addition to various Regional Initiatives and other related projects. IGI will provide a consistent and coordinated Italian strategy as a step towards the European Grid Initiative (EGI) and as an interface to the EU Grid infrastructure projects e-IRG (e- Infrastructure Reflection Group) and ESFRI (European Strategy Forum on Research Infrastructures), and to other international activities as the need arises. European Grid Initiative 10 April 20084F.Pasian - Italian Grid Infrastructure

INFNGrid The INFN Grid project, approved in late 1999, has developed and deployed the first Italian Grid Infrastructure, based on GARR, the Italian research network.GARR More than 30 sites, both INFN and some among the most important Italian universities. Although primarily focused on physics, it has been, since the beginning, open to other fields of research (bio- medicine, earth observation, etc.) and to industry. Training/support activities 10 April 20085F.Pasian - Italian Grid Infrastructure

Grid.it With a grant received from the MIUR-FIRB funds (governmental funds for investment in fundamental research) for the Grid.it project, a number of National Research Institutions paved the way in for the development of a common production grid infrastructure supporting the Italian Research Area.  Developments  Production Grid 10 April 20086F.Pasian - Italian Grid Infrastructure

Transition Grid.it : 50 sites ("resource centers"), 4500 CPUs (4.5 MSPECINT), 1 PByte storage, 2.5 Gbps bandwidth Grid.it has come to a close in 2006 as a development project; to extend its benefits, IGI has taken over and acts as the national coordinator for the different pieces of the Italian e-Infrastructure present in EGEE. 10 April 20087F.Pasian - Italian Grid Infrastructure

Grid.it SPACI GRISÙ (Cometa, Cresco, Cosmolab, Scope) 10 April 20088F.Pasian - Italian Grid Infrastructure

PON consortia National funding to enhance computational infrastructures in southern Italy Four regional projects created:  COMETA consortium (TriGrid and PI2S2 projects) → U.Becciani’s talk  Cosmolab (CyberSar project)  SCOPE (University of Naples)  CRESCO (ENEA) Share middleware (INFNGrid distribution) → interoperability MiUR resources to expand PON experience to rest of Italy 10 April 2008F.Pasian - Italian Grid Infrastructure9

IGI – build upon previous work Leverage upon the large integration and standardization effort of international and national research projects such as EDG, LCG, Grid.it and EGEE, in order to establish a coherent platform of interoperable Grid Services customized for Italian user applications, and make it available in support of the Italian scientific end user communities and, possibly, early commercial adoptersEDG LCGGrid.itEGEE 10 April F.Pasian - Italian Grid Infrastructure

IGI middleware distribution (I) The idea is to expand the EGEE gLite distribution to tackle needs of Italian Grid community Taking from INFNGrid experience: with respect to the CERN gLite distribution, totally compatible; has additional components and specific configurations. Among the specificities:  Support for 20 VOrg’s  StoRM (access to storage)  P’n’P User Interface,  Configured MPI support  GridICE monitoring on Worker Nodes  … 10 April F.Pasian - Italian Grid Infrastructure

IGI middleware distribution (II) Which components can go in the release? A Board (the Executive Board of IGI) recieves the requests and evaluates  Functionality and added value of component  Reference User/VOrg community  Usage experience and tests performed  Evolution/development/sustainability of component and decides which are the additional components which can be inserted in the release, defining priorities A Release Team perfoms a technical evaluation and defines the activity plan and schedule Tight collaboration with developers is mandatory 10 April F.Pasian - Italian Grid Infrastructure

IGI middleware distribution (III) 10 April 2008F.Pasian - Italian Grid Infrastructure13

National framework IGI has submitted a proposal to be included within the roadmap for Italian research infrastructures Appropriate funding to be provided by MiUR Complementary to HPC proposal Coordinated with (part of) ESFRI roadmap for e-infrastructures 10 April F.Pasian - Italian Grid Infrastructure

Communities IGI plans to support activities in a vast range of scientific disciplines — e.g. Physics, Astrophysics, Biology, Health, Chemistry, Geophysics, Economy, Finance — and any possible extensions to other sectors such as Civil Protection, e-Learning, dissemination in Universities and secondary schools. 10 April F.Pasian - Italian Grid Infrastructure

Astrophysics as an IGI community Among these, the Astrophysics community is active as a user, by porting applications of various kinds, but also as a resource provider in terms of computing power and storage, and as middleware developer. 10 April F.Pasian - Italian Grid Infrastructure

Grid(s) for astrophysics A step backwards … Dedicated WP in Grid.it DRACO: data grid for astrophysics and coordination with the VObs ( ) Separate projects afterwards: VObs.it and DRACO2 (relying on the Italian grid infrastructure) funded by INAF 10 April F.Pasian - Italian Grid Infrastructure

Porting of applications within the Grid.it and DRACO projects:  Montecarlo  Hi-res N-body simulations  Data processing (OmegaCam) within the EGEE/EGAAP framework:  simulations of the Planck mission on COMETA:  among others, HPC applications (e.g. FLY) on IGI (and EGEE):  population of the BaSTI archive (see poster)  Leadership of A&A EGEE cluster. 10 April F.Pasian - Italian Grid Infrastructure

Development of middleware definition of requirements development of gridftp+EGEE drivers for CFITSIO development of G-DSE → C.Vuerli’s talk  originally in collaboration with INFN  “native” Grid access to relational databases  applied (and optimised) for astrophysics benchmarking and comparison among systems managing DBs on the Grid  Leadership of EGEE Database Group. 10 April F.Pasian - Italian Grid Infrastructure

Database access benchmarks 10 April 2008F.Pasian - Italian Grid Infrastructure20

10 April 2008F.Pasian - Italian Grid Infrastructure21

12 March 2008F.Pasian - (Super)computing and e-Infrastructures22 from K.Baxevanidis

12 March 2008F.Pasian - (Super)computing and e-Infrastructures23 e-Infrastructure: components Computing Infrastructure Network Infrastructure Data Infrastructure...Appl When defining the roadmap for the development of an e-Infrastructure for Astronomy, these components need to be thought as integrated, or at least fully interoperable generic domain-specific

10 April 2008F.Pasian - Italian Grid Infrastructure24 The path forward for e-infrastructure All facilities should be integrated in an interoperable e-infrastructure Goals for the next years:  Consolidating a Data Infrastructure on top of Network and Computing  Domain-specific applications on top of the Data Infrastructure  Inter-operation of applications (data processing, analysis, mining, bibliography, semantic web) to build a Knowledge Infrastructure Computing Infr. Network Infr. Data Infr.... appl Knowledge Infrastructure VObs This is the area where the VObs expects to bring in its own standards, tools and facilities