EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE II: an eInfrastructure for Europe and beyond Bob Jones EGEE-II Project Director CERN

Enabling Grids for E-sciencE EGEE-II INFSO-RI The project EGEE –1 April 2004 – 31 March 2006 –71 partners in 27 countries, federated in regional Grids EGEE-II –1 April 2006 – 31 March 2008 –91 partners in 32 countries Objectives –Large-scale, production-quality grid infrastructure for e-Science –Attracting new resources and users from industry as well as science –Maintain and further improve “gLite” Grid middleware

Enabling Grids for E-sciencE EGEE-II INFSO-RI Applications on EGEE Applications from many scientific domains –Archaeology –Astrophysics –Computational Chemistry –Digital libraries –Earth Sciences –Financial Simulation –Fusion –Geophysics –High Energy Physics –Life Sciences –Multimedia –Material Sciences –….. Book of abstracts:

Enabling Grids for E-sciencE EGEE-II INFSO-RI Support for digital repositories GÉANT. INFRASTRUCTURE GRID. INFRASTRUCTURE KNOWLEDGE. INFRASTRUCTURE 3 layered model to support access to heterogeneous information and connect resources through common shared services Grids can offer: Sharing of resources Secure Access Control Data management Execution of computationally demanding applications (e.g. multi- media content)

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE Operations Structure Operations Coord. Centre (OCC) Regional Operations Centres (ROC) –Front-line support for user and operations issues –Provide local knowledge and adaptations –One in each region – many distributed –Manage daily grid operations – oversight, troubleshooting  “Operator on Duty” –Run infrastructure services ROCs serving

Enabling Grids for E-sciencE EGEE-II INFSO-RI Grid monitoring tools Tools used by the Grid Operator on Duty team to detect problems Distributed responsibility CIC portal –single entry point –Integrated view of monitoring tools Site Functional Tests (SFT) -> Service Availability Monitoring (SAM) –Need to expand usage in GIIS monitor (Gstat) GOC certificate lifetime GOC job monitor

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE Related Infrastructures GINGIN

Enabling Grids for E-sciencE EGEE-II INFSO-RI Grid Interoperability We currently see different flavors of Grids deployed worldwide –Because of application needs, legacy constraints, funding, etc. –Diversity is positive! – Competition to find the best solutions Many applications need to operate on more than one Grid infrastructure –Pragmatic approach to interoperability is key –Applications need interoperable Grid infrastructures now –A production infrastructure cannot be an early adopter of quickly changing standards Interoperability and standardization pursued at multiple levels –Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi)  Resulted in the “Grid Interoperability Now (GIN)” effort combining major worldwide and regional Grid efforts at GGF –Grid standardization and best practices at the Global Grid Forum  Now merging with comparable industry efforts – Open Grid Forum –Standardization of basic infrastructure like web services (OASIS)

Enabling Grids for E-sciencE EGEE-II INFSO-RI Grid Middleware Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory Foundation Grid Middleware will be deployed on the EGEE infrastructure –Must be complete and robust –Should allow interoperation with other major grid infrastructures –Should not assume the use of Higher-Level Grid Services Foundation Grid Middleware Security model and infrastructure Computing (CE) and Storage Elements (SE) Accounting Information and Monitoring Higher-Level Grid Services Workload Management Replica Management Visualization Workflow Grid Economies... Applications

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE Middleware Distribution gLite –Exploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others –Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications).  Pluggable components – cater for different implementations  Follow SOA approach, WS-I compliant where possible –Focus is on re-engineering and hardening –Business friendly open source license  Plan to switch to Apache-2

Enabling Grids for E-sciencE EGEE-II INFSO-RI Workload ManagementData Management Security Information & Monitoring Access gLite Grid Middleware Services API Computing Element Workload Management Metadata Catalog Storage Element Data Movement File & Replica Catalog Authorization Authentication Information & Monitoring Application Monitoring Auditing Job Provenance Package Manager CLI Accounting Site Proxy Overview paper

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE and Sustainability BUT … How does EGEE compare to other computing infrastructures? –Number of infrastructure users? –Number of application domains? –Number of computing nodes? –Number of years in service? What would happen, if EGEE is turned off? What happens after April 2008 (End of EGEE-II)?

Enabling Grids for E-sciencE EGEE-II INFSO-RI Sustainability: Beyond EGEE-II Need to prepare for permanent Grid infrastructure –Maintain Europe’s leading position in global science Grids –Ensure a reliable and adaptive support for all sciences –Independent of short project cycles –Modelled on success of GÉANT  Infrastructure managed in collaboration with national grid initiatives

Enabling Grids for E-sciencE EGEE-II INFSO-RI Structure Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI) EGEE-II federations would evolve into NGIs Each NGI is a national body –Recognised at the national level –Mobilises national funding and resources –Contributes and adheres to international standards and policies –Operates the national e-Infrastructure –Is application independent, open to new user communities and resource providers

Enabling Grids for E-sciencE EGEE-II INFSO-RI EGEE’06 Conference EGEE’06 – Capitalising on e-infrastructures –Keynotes on state-of-the-art and real-world use –Dedicated business track exploring Grids’ business potential –Demos and business/industry exhibition –Involvement of international community September 2006 Geneva, Switzerland

Enabling Grids for E-sciencE EGEE-II INFSO-RI Summary Grids are all about sharing – they are an excellent means of working with groups around the world EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research –In constant and significant production use –EUMedGrid & EUChinaGrid as part of this production infrastructure We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure –Next steps: Service Availability Monitoring, Service Level Agreements This work has shown the importance of interoperability/interoperations with related projects Need to prepare the long-term –EGEE, related EU projects, national grid initiatives and user communities are working to define a model for a sustainable grid infrastructure