Conference xxx - August 2003 EGEE is proposed as a project funded by the European Union under contract IST-2003-508833 Fabrizio Gagliardi EGEE designated.

Slides:



Advertisements
Similar presentations
EU DataGrid progress Fabrizio Gagliardi EDG Project Leader
Advertisements

Conference xxx - August 2003 Fabrizio Gagliardi EDG Project Leader and EGEE designated Project Director Position paper Delivery of industrial-strength.
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
INFSO-RI Enabling Grids for E-sciencE The EGEE project Fabrizio Gagliardi Project Director EGEE CERN, Switzerland Research Infrastructures.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
LCSC October The EGEE project: building a grid infrastructure for Europe Bob Jones EGEE Technical Director 4 th Annual Workshop on Linux.
EGEE is proposed as a project funded by the European Union under contract IST The EGEE International Grid Infrastructure and the Digital Divide.
EGEE is a project funded by the European Union under contract IST Information Technology Revolution! Enabling Grids for E-Science in Europe.
Enabling, facilitating and delivering quality training in the UK and Internationally The challenge of grid training and education David Fergusson, Deputy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE-III Program of Work Erwin Laure EGEE-II / EGEE-III Transition Meeting CERN,
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
EGEE is a project funded by the European Union under contract IST The EGEE project: An overview Frédéric Hemmer EGEE Middleware Manager Paradyn/Condor.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
What is OMII-Europe? Qin Li Beihang University. EU project: RIO31844-OMII-EUROPE 1 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe.
INFSO-RI Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Related Projects Dieter Kranzlmüller Deputy.
Results of the HPC in Europe Taskforce (HET) e-IRG Workshop Kimmo Koski CSC – The Finnish IT Center for Science April 19 th, 2007.
EGEE is proposed as a project funded by the European Union under contract IST EU eInfrastructure project initiatives FP6-EGEE Fabrizio Gagliardi.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
INFSO-RI Enabling Grids for E-sciencE EGEE and Industry Bob Jones EGEE-II Project Director Final EGEE Review CERN, May 2006.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
EU DataGrid progress and EGEE plans Fabrizio Gagliardi EDG Project Leader - EGEE Proposal Coordinator
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE – paving the way for a sustainable infrastructure.
INFSO-RI Enabling Grids for E-sciencE Plan until the end of the project and beyond, sustainability plans Dieter Kranzlmüller Deputy.
Enabling Grids for E-sciencE 1 EGEE III Project Prof.dr. Doina Banciu ICI Bucharest GRID activities in RoGrid Consortium.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
SA1/SA2 meeting 28 November The status of EGEE project and next steps Bob Jones EGEE Technical Director EGEE is proposed as.
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi.
Induction: Adding new applications to EGEE infrastructure –April 26-28, Adding new applications to EGEE infrastructure Roberto Barbera EGEE is.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ian Bird LCG Deployment Area Manager & EGEE Operations Manager IT Department, CERN Presentation to HEPiX 22 nd October 2004 LCG Operations.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
EGEE MiddlewareLCG Internal review18 November EGEE Middleware Activities Overview Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as.
EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
EGEE is a project funded by the European Union under contract IST Network Resources Provision Jean-Paul Gautier SA2 manager Cork meeting,
LCG LCG Workshop – March 23-24, Middleware Development within the EGEE Project LCG Workshop CERN March 2004 Frédéric Hemmer.
EGEE is a project funded by the European Union under contract IST Generic Applications in EGEE-NA4 Roberto Barbera NA4 Generic Applications.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
Guy Wormser IN2P3/CNRS, EGEE Applications Manager September 2003 EGEE is proposed as a project funded by the European Union under contract IST
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
EGEE is a project funded by the European Union under contract IST EGEE Summary NA2 Partners April
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
INFSO-RI Enabling Grids for E-sciencE Quality Assurance Gabriel Zaquine - JRA2 Activity Manager - CS SI EGEE Final EU Review
SA2 : Network Resource Provision All Activity Meeting – 17 March SA2 Execution Plan for the first year Jean-Paul Gautier SA2 Manager CNRS/UREC.
Induction: What is EGEE? –April 26-28, What is EGEE? John Murison, EGEE Training Team EGEE is funded by the European Union under contract IST
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
INFSO-RI Enabling Grids for E-sciencE An introduction to EGEE Mike Mineter NeSC Edinburgh
Induction: What is EGEE? –April 26-28, EGEE organisation and procedures John Murison, EGEE Training Team EGEE is funded by the European Union.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
Javier Orellana EGEE-JRA4 Coordinator CERN March 2004 EGEE is proposed as a project funded by the European Union under contract IST Network.
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
EGEE is a project funded by the European Union
EGEE Middleware Activities Overview
SA1 Execution Plan Status and Issues
Ian Bird GDB Meeting CERN 9 September 2003
Long-term Grid Sustainability
Bob Jones EGEE Technical Director
EGEE support for HEP and other applications
Connecting the European Grid Infrastructure to Research Communities
Cécile Germain-Renaud Grid Observatory meeting 19 October 2007 Orsay
Future EU Grid Projects
The EGEE project: An overview Frédéric Hemmer EGEE Middleware Manager
Peter Clarke EGEE Peter Clarke
Presentation transcript:

Conference xxx - August 2003 EGEE is proposed as a project funded by the European Union under contract IST Fabrizio Gagliardi EGEE designated Project Director Introduction to the EGEE project

NA4 launch – Paris, December DataGrid prototypes: DataGrid (I) 9.8 M Euros EU funding over 3 years (twice as much from partners) 90% for middleware and applications (High Energy Physics, Earth Observation, Genomic Exploration) Total of 21 partners, over 150 programmers from research and academic institutes as well as industrial companies Three year phased developments & demos ( ) Several improved versions of middleware software (final release end 2003) Several components of software integrated in the large Particle Physics Production LHC Computing Project (LCG) Software used by partner projects: DataTAG, CROSSGRID, GRACE

NA4 launch – Paris, December International Grid Projects Through links with sister projects, there is the potential for a truely global scientific applications grid

NA4 launch – Paris, December DataGrid prototypes: DataGrid (II) DataGrid testbed: more than 1000 CPUs at more than 15 sites (up to 40) Connections made possible by the EU-funded GEANT project connecting more than 30 countries across Europe speeds of up to 10 Gbit/s high data throughput quality of Service SiteCountryCPUsStorage CC-IN2P3*FR GB CERN*CH GB CNAF*IT GB Ecole Poly.FR6220 GB Imperial Coll.UK92450 GB LiverpoolUK210 GB ManchesterUK915 GB NIKHEF*NL GB OxfordUK130 GB PadovaIT11666 GB RAL*UK6332 GB SARANL GB TOTAL GB *also Dev. TB; +200 TB including tape

NA4 launch – Paris, December EGEE manifesto: Enabling Grids for E-science in Europe Goal Create a wide European Grid production quality infrastructure on top of present and future EU RN infrastructure Build on EU and EU member states major investments in Grid Technology International connections (US and AP) Several pioneering prototype results Larg Grid development teams in EU Requires major EU funding effort Approach Leverage current and planned national and regional Grid programmes Work closely with relevant industrial Grid developers, NRENs and US-AP projects EGEE Applications Geant network Geant Research Network Grid infrastructure ERA Applications

NA4 launch – Paris, December EGEE: Why? (I) Access to a production quality grid will change the way science and business is done in Europe More effective and seamless collaboration of dispersed communities, both scientific and commercial Ability to run large-scale applications comprising thousands of computers, for wide range of applications Transparent access to distributed resources from your desktop Benefits for several application fields: Bioinformatics (study of the human genome and proteome to understand genetic diseases) Engineering (design optimization, simulation, failure analysis and remote Instrument access and control) Medical/Healthcare (imaging, diagnosis and treatment ) Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems)

NA4 launch – Paris, December EGEE: Why? (II) Current Grid R&D projects run to completion within the next few months or next year (e.g. X#) The EGEE partners have already made major progress in aligning national and regional Grid R&D efforts, in preparation for EGEE EGEE will preserve the current strong momentum of the European Grid community, and the enthusiasm of the hundreds of young European researchers already involved in EU Grid projects (>150 in EDG alone)

NA4 launch – Paris, December EGEE: Partners Leverage national resources in a more effective way for broader European benefit 70 leading institutions in 27 countries, federated in regional Grids

NA4 launch – Paris, December EGEE Activities JRA1: Middleware Engineering and Integration JRA2: Quality Assurance JRA3: Security JRA4: Network Services Development SA1: Grid Operations, Support and Management SA2: Network Resource Provision NA1: Management NA2: Dissemination and Outreach NA3: User Training and Education NA4: Application Identification and Support NA5: Policy and International Cooperation 24% Joint Research28% Networking 48% Services Emphasis in EGEE is on operating a production grid and supporting the end- users

NA4 launch – Paris, December EGEE Operations Operate essential grid services Proactively monitor the operational state and performance initiate corrective action Validate and deploy middleware releases Set up operational procedures for new resources Coordinate the resolution of problems from both Resource Centres and users Filter and aggregate problems, providing or obtaining solutions Middleware deployment and resource induction Grid monitoring and control Core Infrastructure Services Resource provider and user support

NA4 launch – Paris, December Resource Center (Processors, disks) Grid server Nodes Resource Center Resource Center Resource Center Operations Center Regional Support Center (Support for Applications Local Resources) Regional Support Regional Support Regional Support EGEE Operations Structure

NA4 launch – Paris, December EGEE Service Activity (I) Create, operate, support and manage a production quality infrastructure Structure: EGEE Operations Management at CERN EGEE Core Infrastructure Centres in the UK, France, Italy and CERN (leveraging HEP LCG at the start), responsible for managing the overall Grid infrastructure Regional Operations Centres, responsible for coordinating regional resources, regional deployment and support of services in all other countries Offered services: Middleware deployment and installation Software and documentation repository Grid monitoring and problem tracking Bug reporting and knowledge database VO services Grid management services

NA4 launch – Paris, December EGEE Service Activity (II) Operations Management Centre – OMC Coordinator for CICs and for ROCs Team to oversee operations – problems resolved, performance targets, etc. Operations Advisory Group to advise on policy issues, etc. Core Infrastructure Centres – CIC Day-to-day operation management– implement operational policies defined by OMC Monitor state, initiate corrective actions, eventual 24x7 operation of grid infrastructure Provide resource and usage accounting, security incident response coordination, ensure recovery procedures Regional Operations Centres – ROC Provide front-line support to users and resource centres Support new resource centres joining EGEE in the regions

NA4 launch – Paris, December EGEE Service Activity (III) Resource Centers RegionCPU nodesDisk (TB)CPU Nodes Month 15 Disk (TB) Month 15 CERN UK + Ireland France Italy North South West Germany + Switzerland South East Central Europe Russia Totals Month 1: 10Month 15: 20

NA4 launch – Paris, December EGEE Middleware Activity Hardening and re-engineering of existing middleware functionality, leveraging the experience of partners Activity concentrated in few major centers Key services: Resource Access Data Management (CERN) Information Collection and Accounting (UK) Resource Brokering (Italy) Quality Assurance (France) Grid Security (Northern Europe) Middleware Integration (CERN) Middleware Testing (CERN)

NA4 launch – Paris, December EGEE Networking Activity (I) Dissemination and outreach Lead by TERENA User training and induction Lead by Unv Edin. (NeSC) Application identification and support Two pilot application centers (for high energy physics and biomedical grids) One more generic component dealing with longer term recruitment and support of other communities Policy and International cooperation Establish Grid policy forum Coordinate relations with other projects (EU and beyond) map points indicate federations and are not geographically precise

NA4 launch – Paris, December EGEE Networking Activity (II) EGEE Scope : ALL-Inclusive for academic applications Open to industrial and socio-economic world as well The major success criterion of EGEE: how many satisfied users from how many different domains ? 5000 users (3000 after year 2) from at least 5 disciplines 2 Pilot Application Domains: Physics & Bioinformatics Application domains and timelines are for illustration only

NA4 launch – Paris, December EGEE “Virtuous Cycle” A new scientific community makes first contacts to EGEE through outreach events organized by Networking Activities Follow-up meetings by applications specialists may lead to definition of new requirements for the infrastructure If approved, the requirements are implemented by the Middleware Activities After integration and testing, the new middleware is deployed by the Service Activities The Networking Activities then provide appropriate training to the community in question, so that it becomes an established user Peer communication and dissemination events featuring established users then attract new communities

NA4 launch – Paris, December EGEE and Industry Industrial participation encouraged both as potential end-users and IT technology and service suppliers Normally through national and regional Grid EGEE federations EGEE will maintain an Industry Forum to keep selected Industrial and Commercial interested parties in close contact Services developed in first EGEE 2 years phase (2004-5) might be tendered to Industry in second phase (2006-7)

NA4 launch – Paris, December EGEE Implementation Plans Initial service will be based on the LCG infrastructure (this will be the production service, most resources allocated here) Also will need a certification test-bed system For debugging and problem resolving of the production system In parallel must deploy a development service Runs the candidate next software release for production Treated as an reliable facility (but with less support than the production service)

NA4 launch – Paris, December Conclusions EGEE is expected to deliver a real production Grid infrastructure for real scientific applications in Europe Important to have early adopters and applications representatives in all phases of the project Previous EDG experience has shown the importance of dedicated Grid support people in the applications NA4 is going to play a fundamental role

NA4 launch – Paris, December To know more: EU EGEE – EU DataGrid –