EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE project and the future of European grids Bob Jones EGEE-II Project Director CERN

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December How e-Infrastructrures help e-Science e-Infrastructures provide easier access for –Small research groups –Scientists from many different fields –Remote and still developing countries To new technologies –Produce and store massive amounts of data –Transparent access to millions of files across different administrative domains –Low cost access to resources  Mobilise large amounts of CPU & storage on short notice (PC clusters) –High-end facilities (supercomputers) And help to find new ways to collaborate –Develops applications using distributed complex workflows –Eases distributed collaborations –Provides new ways of community building –Gives easier access to higher education NETWORK. INFRASTRUCTURE GRID. INFRASTRUCTURE KNOWLEDGE. INFRASTRUCTURE

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December EGEE Main Objectives Operate a large-scale, production quality grid infrastructure for e-Science Attract new resources and users from industry as well as sciences Flagship grid infrastructure project co-funded by the European Commission Now in 2 nd phase with 91 partners in 32 countries

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December EGEE – What do we deliver? Infrastructure operation –Currently includes ~250 sites across 45 countries  Continuous monitoring of grid services & automated site configuration/management  Support many Virtual Organisations from diverse research disciplines Middleware –Production quality middleware distributed under business friendly open source licence  Implements a service-oriented architecture that virtualises resources  Adheres to recommendations on web service inter- operability and evolving towards emerging standards User Support - Managed process from first contact through to production usage –Training –Expertise in grid-enabling applications –Online helpdesk –Networking events (User Forum, Conferences etc.)

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December sites 45 countries 41,000 CPUs 5 PetaBytes >5000 users >100 VOs >100,000 jobs/day Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … 32%

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December Types of applications Simulation –LHC Monte Carlo simulations; Fusion; WISDOM –Jobs needing significant processing power; Large number of independent jobs; limited input data; significant output data Bulk Processing –HEP ; Processing of satellite data –Distributed input data; Large amount of input and output data; Job management (WMS); Metadata services; complex data structures Parallel Jobs –Climate models, computational chemistry –Large number of independent but communicating jobs; Need for simultaneous access to large number of CPUs; MPI libraries Short-response delays –Prototyping new applications; grid Monitoring grid; Interactivity –Limited input & output data; processing needs but fast response and quality of service Workflow –Medical imaging; flood analysis –Complex analysis algorithms; complex dependencies between jobs Commercial Applications –Non-open source software; Geocluster (seismic platform); FlexX (molecular docking); Matlab, Mathematics; Idl, … –License server associated to an application deployment model

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December EGEE User Forum 2007 Co-located with OGF20: 900+ attendees ~50 booths user forum: ~30 sessions 100+ presentations 20 demos ~60 posters

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December Registered Collaborating Projects Applications improved services for academia, industry and the public Support Actions key complementary functions Infrastructures geographical or thematic coverage 25 projects have registered as of September 2007: web pageweb page

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December Collaborating infrastructures

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December EGEE-II to EGEE-III EGEE-III proposal currently under negotiation with European Commission Key objectives –Expand/optimise existing EGEE infrastructure, include more resources and user communities –Prepare migration from a project-based model to a sustainable federated infrastructure based on National Grid Initiatives 2 year period – spring 2008 to spring 2010 –No gap between EGEE-II and EGEE-III Similar consortium –Now structured on a national basis (National Grid Initiatives/Joint Research Units) Networking activitiesSpecific Service Activities NA1: ManagementSA1: Operations NA2: Dissemination & Business outreachSA2: Networking Support NA3: TrainingSA3: Integration, testing & Cert. NA4: ApplicationsJoint Research Activities NA5: International Coop. & PolicyJRA1: Middleware engineering

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December European Grid Initiative Need to prepare permanent, common Grid infrastructure Ensure the long-term sustainability of the European e-Infrastructure independent of short project funding cycles Coordinate the integration and interaction between National Grid Infrastructures (NGIs) Operate the production Grid infrastructure on a European level for a wide range of scientific disciplines Must be no gap in the support of the production grid

Inauguration de l'Institut des Grilles, Paris, 3rd December EGI Design Study proposal approved to the European Commission (started 1 st September’07) Supported by 30+ National Grid Initiatives (NGIs ) 2 year project to prepare the setup and operation of a new organizational model for a sustainable pan-European grid infrastructure Federated model bringing together NGIs to build a European organisation Well defined, complimentary responsibilities between NGIs and EGI

Inauguration de l'Institut des Grilles, Paris, 3rd December Characteristics of NGIs Each NGI recognized national body with a single point-of- contact mobilise national funding and resources operate the national e-Infrastructure support user communities (application independent, and open to new user communities and resource providers) contribute and adhere to international standards and policies Responsibilities between NGIs and EGI are clearly separated and complementary

Inauguration de l'Institut des Grilles, Paris, 3rd December European NGIs + Asia, US, Latin America + PRACE + OGF-Europe + …

Inauguration de l'Institut des Grilles, Paris, 3rd December Upcoming Deliverables & Milestones Dec 2007: D2.1 – EGI consolidated requirements and use cases Feb 2008: D4.2 – Options analysis of different legal structures Mar 2008: D5.1/5.2 – Draft definition and convention of EGI organization  EGI Workshop „List of EGI functions and working model“ Apr 2008: D4.3 – Guidelines for NGIs June 2008: M4.1 – EGI Blueprint publication

Enabling Grids for E-sciencE EGEE-II INFSO-RI Inauguration de l'Institut des Grilles, Paris, 3rd December Summary Grids are all about sharing – they are a means of working with groups around the world –Today we have a window of opportunity to move grids from research prototypes to permanent production systems (as networks did a few years ago) Interoperability is key to providing the level of support required for our user communities EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research –In constant and significant production use A third phase of EGEE is under preparation Need to prepare the long-term –EGEE, collaborating projects, national grid initiatives and user communities are working to define a model for a sustainable grid infrastructure that is independent of short project cycles