1. An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director Bob.Jones@cern.ch

2. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 2 u 9.8 M Euros EU funding over 3 years n www.eu-datagrid.org www.eu-datagrid.org u 90% for middleware and applications (Physics, Earth Observation, Biomedical) u 3 year phased developments & demos u Total of 21 partners n Research and Academic institutes as well as industrial companies u Extensions (time and funds) on the basis of first successful results: n DataTAG (2002-2003) www.datatag.org n CrossGrid (2002-2004) www.crossgrid.org n GridStart (2002-2004) www.gridstart.org The EU DataGrid Project u Project started on Jan. 2001 u Testbed 0 (early 2001) n International test bed 0 infrastructure deployed s Globus 1 only - no EDG middleware u Testbed 1 ( early 2002 ) n First release of EU DataGrid software to defined users within the project u Testbed 2 (end 2002) n Builds on Testbed 1 to extend facilities of DataGrid n Focus on stability u Testbed 3 (2003) n Advanced functionality & scalability n Currently being deployed u Project stops on March 2004 n Final review 19 th & 20 th February 2004 DataGrid is a project funded by the European Commission under contract IST-2000-25182

3. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 3 Software 50 use cases ~20 software releases Current release 2.1 ~900K lines of code People >350 registered users 12 Virtual Organisations 20 Certificate Authorities >500 people trained ~380 man-years of effort ~138 years funded Scientific applications 5 Earth Obs institutes 9 bio-informatics apps 6 HEP experiments Testbeds ~20 regular sites >40 sites using EDG sw >10000s jobs submitted >1000 CPUs >15 TeraBytes disk 3 Mass Storage Systems DataGrid in Numbers

4. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 4 DataGrid open source license u Open Source license developed for all grid middleware produced by the project n The project has developed an open-source style software license to protect the IPR of the project s in line with GGF recommendations s http://www.edg.org/license.html http://www.edg.org/license.html n The license is similar the "modified BSD License s but subsequent contributors providing modifications, enhancements or derivative works are free to decide on the license conditions that apply to his or her own contributions n This license was accepted by all project partners including commercial partners working on software development (IBM UK, DATAMAT, CSSI) n This license has subsequently been used as the basis of the Globus contributors license and is being considered by other EU projects for their own use u The license does not apply to applications software running on the grid n Sites must acquire necessary licenses before such application software is installed n Sites then advertise the software via the grid information service and users specify it in their job description. The resource broker performs the matchmaking

5. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 5 DataGrid Exploitation u DataGrid middleware is used by many sites to connect to the grid n Take-up would have been slower if the sites had to pay a license fee or enter into a written agreement to access the middleware u DataGrid middleware has been adopted/enhanced by many other projects n CrossGrid, GridPP, INFNgrid etc. have adopted the EDG middleware and deployed it on their own grids u DataGrid Industrial partners are investigating commercial exploitation n CSSI: working with SMEs as a basis of providing large computing facilities for making technology break-thrus u LHC Computing Grid (LCG) has enhanced DataGrid middleware to provide a production facility (currently 26 sites) for physics data processing n This will be the basis for the proposed EGEE project grid facility

6. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 6 The next generation of grids - EGEE Create a European-wide Grid production quality infrastructure for multiple sciences Profit from current and planned national and regional Grid programmes, building on n the results of existing projects such as DataGrid, LCG and others n the EU Research Network Geant and work closely with relevant industrial Grid developers and NRENs Support Grid computing needs common to the different communities integrate the computing infrastructures and agree on common access policies Exploit International connections (US and AP) Provide interoperability with other major Grid initiatives such as the US NSF Cyberinfrastructure, establishing a worldwide Grid infrastructure EGEE is proposed as a project funded by the European Union under contract IST-2003-508833

7. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 7 EGEE - Strategy u Start with LCG (enhanced DataGrid) middleware to provide a service from day 1 u In parallel, middleware will be re-engineered based on implementations of the Open Grid Services Infrastructure (an extension of web services) that have demonstrated scalability via large scale deployment and adoption for many applications u This new middleware will be distributed under an open source license u New application groups will be expected to contribute resources consistent with their requirements n project must demonstrate that this is less than is needed without the grid (I.e. by making use of idle resources at different resources centres) u Based on experience with DataGrid and LCG, we expect to attract many resources n From 3000 CPUs in 2004 to 8000 CPUs across 50 sites in 2006

8. Bob Jones (CERN) Delivery of industrial-strength Grid middleware: establishing an effective European approach 21 January 2004 - n° 8 Summary u DataGrid has developed an open source license suitable for EU projects and acceptable to industrial partners u DataGrid has demonstrated the validity of an open source approach for software development in EU projects u Adopting an Open Source approach has facilitated the take-up of DataGrid middleware, structures and processes by resource providers, other projects and industrial partners u An open source approach has been adopted for the future EGEE project