1. EMI INFSO-RI-261611 European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director

2. EMI INFSO-RI-261611 Outline What is EMI? EMI Vision and Objectives How does it work? Conclusions 26/05/2010 EMI Overview - Kick-off Meeting 2

3. EMI INFSO-RI-261611 Outline What is EMI? EMI Vision and Objectives How does it work? Conclusions 26/05/2010 EMI Overview - Kick-off Meeting 3

4. EMI INFSO-RI-261611 EMI Mission Statement EMI Overview - Kick-off Meeting 4 The European Middleware Initiative (EMI) project represents a close collaboration of the major European middleware providers - ARC, gLite, UNICORE and dCache - to establish a sustainable model to support, harmonise and evolve the grid middleware for deployment in EGI, PRACE and other distributed e-Infrastructures 26/05/2010

5. EMI INFSO-RI-261611 FP7 Program 26/05/2010 EMI Overview - Kick-off Meeting 5 FP7 Capacities Work Programme 2010: Infrastructures Call FP7-INFRASTRUCTURES-2010-2 Sub-topic: 1.2.1.3 – Middleware and repositories Develop middleware that strengthens European presence by consolidating or even going beyond existing DCIs (e.g. exploiting emerging developments like virtualisation), while improving their stability, reliability, usability, functionality, interoperability, security, management, monitoring and accounting, measurable quality of service, and energy efficiency Starting date: May 1 st Duration: 3 years Total budget: 23M € (12M € from EC + 11M € from partners) Effort: 64 FTEs/year (88% for technical activities)

6. EMI INFSO-RI-261611 Primary Objectives Consolidate the existing middleware distribution simplifying services and components to make them more sustainable (including use of off-the-shelf and commercial components whenever possible) Evolve the middleware services/functionality following the requirement of infrastructure and communities, mainly focusing on operational, standardization and interoperability aspects Reactively and proactively maintain the middleware distribution to keep it in line with the growing infrastructure usage EMI Overview - Kick-off Meeting 6 Consolidate Evolve Support 26/05/2010

7. EMI INFSO-RI-261611 Partners (26) EMI Overview - Kick-off Meeting 726/05/2010

8. EMI INFSO-RI-261611 Outline What is EMI? EMI Vision and Objectives How does it work? Conclusions 26/05/2010 EMI Overview - Kick-off Meeting 8

9. EMI INFSO-RI-261611 A European Vision EMI Overview - Kick-off Meeting 9 Today Tomorrow Sustainability Persistence Interoperability Easier Access Sustainability Persistence Interoperability Easier Access 26/05/2010

10. EMI INFSO-RI-261611 Increased Usability One of the major complaints of research users about the middleware is about its limited “userfriendliness” – Deployment, configuration, service management, interoperability, security mechanisms, flexibility, etc. Unnecessary duplication of services and libraries User requirements (ESFRI, VRCs) – EMI is requirement driven and will actively participate to the definition of user requirements with the major user communities and infrastructures 26/05/2010 EMI Overview - Kick-off Meeting 10

11. EMI INFSO-RI-261611 Security One of the most important and most difficult aspects of the middleware – Usability: existing certificate-based technologies are needed, but too complex to manage or use for the typical user or not easy to integrate in existing security contexts – Reliability: the increasing use of distributed computing and the handling of sensitive data require reliable and auditable security methods – Interoperability: the chosen methods must be common across all services and implementations 26/05/2010 EMI Overview - Kick-off Meeting 11

12. EMI INFSO-RI-261611 Standardization Very important to address a number of existing limitations – Interoperability, integration, extensibility and evolution, commercial usage All services must: – Implement the ‘best’ relevant standards – Implement them in the same way ‘Best’ means: – A ‘community’ standard, if it is useful, usable or can be realistically improved – A ‘de facto’ standard, if no community standard exists or what exists is clearly not usable EMI Overview - Kick-off Meeting 1226/05/2010

13. EMI INFSO-RI-261611 Standardization EMI intends to be an active player in the standardization process – Actively take part in the European standardization roadmap coordinated by the European Commission and by initiatives like SIENA – Actively take part in established international standardization bodies like OGF EMI Overview - Kick-off Meeting 1326/05/2010

14. EMI INFSO-RI-261611 Interoperability One of the major requirements of most user communities – Interoperability between different implementations of the same services or functionality – Interoperability among HTC and HPC – Interoperability between different infrastructures Also in this case, the widespread and formally correct adoption of standards is of primary importance EMI Overview - Kick-off Meeting 1426/05/2010

15. EMI INFSO-RI-261611 Integration with New Technologies Technology evolves continually Distributed computing middleware must be able to capitalize on past achievements, but also learn from past lessons and become increasingly efficient and flexible Using labels like Grids or Clouds is misleading How can existing stable, reliable and secure services be made more elastic, dynamic, efficient? And again, standards are very important 26/05/2010 EMI Overview - Kick-off Meeting 15

16. EMI INFSO-RI-261611 Innovation EMI Overview - Kick-off Meeting 16 Innovation is a key driver behind EMI New services or functionality are introduced as needed based on: New user requirements Need to evolve existing services or replace older technologies to support the growing infrastructures Special focus on integration of virtualization, monitoring interfaces, messaging, support for portals and gateways Stability of the existing infrastructure operations must be guaranteed Agreed migration timelines and paths 26/05/2010

17. EMI INFSO-RI-261611 Industrial Relationships The sustainability process relies on increased adoption by commercial companies EMI has an ‘industrial plan’ made of two important points: – Work with commercial partners to transfer and integrate technology in both directions – Understand with commercial experts what is the market, the realistic targets and the sustainable business models 26/05/2010 EMI Overview - Kick-off Meeting 17

18. EMI INFSO-RI-261611 Outline What is EMI? EMI Vision and Objectives How does it work? Conclusions 26/05/2010 EMI Overview - Kick-off Meeting 18

19. EMI INFSO-RI-261611 Project Structure Administrative and Technical Management Dissemination and Communication Maintenance and Support Development, Integration and Evolution Quality Assurance 19 EMI Overview - Kick-off Meeting 26/05/2010

20. EMI INFSO-RI-261611 Who‘s Who Project Director, NA1 Leader: Alberto Di Meglio (CERN) Technical Director: Balazs Konya (LU) NA2 Leader: Diana Cresti (INFN) SA1 Leader: Francesco Giacomini (INFN) SA2 Leader: Alberto Aimar (CERN) JRA1 Leader, Deputy TD: Morris Riedel (JUELICH) 26/05/2010 EMI Overview - Kick-off Meeting 20

21. EMI INFSO-RI-261611 Project Execution 21 EMI Overview - Kick-off Meeting Project Executive Board (PEB)Project Technical Board (PTB) Project DirectorTechnical Director Tech. areas PT Leaders External 26/05/2010 Engineering Management Team QA

22. EMI INFSO-RI-261611 Technical Areas EMI Overview - Kick-off Meeting 22 Compute Services Data Services Security Services Infrastructure Services A-REX, UAS-Compute, WMS, CREAM, MPI, etc dCache, StoRM, UAS-Data, DPM, LFC, FTS, Hydra, AMGA, etc UNICORE Gateway, UVOS/VOMS/VOMS- Admin, ARGUS, SLCS, glExec, Gridsite, Proxyrenewal, etc Logging and Bookkeeping, Messaging, accounting, monitoring, virtualization/clouds support, information systems and providers 26/05/2010

23. EMI INFSO-RI-261611 Who‘s Who Security Area Leader: John White (UH) Compute Area Leader: Massimo Sgaravatto (INFN) Data Area Leader: Patrick Fuhrmann (DESY) Infrastructure Area leader: James Casey (CERN) Release Manager and EMT Chair: Cristina Aiftimiei (INFN) 26/05/2010 EMI Overview - Kick-off Meeting 23

24. EMI INFSO-RI-261611 Software Engineering Process EMI Software Engineering Process is based on best practices: ITIL and COBIT provide a proven foundation for Release, Change, Problem Management, Quality Assurance and Continual Improvement The concept of Product Team is used to clearly allocate tasks and responsibility Each PT is responsible for one or more products from design to after- release user support, including testing and certification Each PT has a Leader responsible for the planning and execution of the tasks delegated to the PT Published release policies Periodic major releases of EMI with clear support timelines Individual service or component releases within an EMI major release Guaranteed backward-compatibility of each service within a major release EMI Overview - Kick-off Meeting 2426/05/2010

25. EMI INFSO-RI-261611 Releases Major releases are the way of introducing major changes, possibly non-backward compatible They represent more a definition of interfaces and behaviours than an actual list of packages ‘At least’ one per year, more is possible, but depends on the type and impact of changes and our capability of supporting them Between any two major releases, the PTs maintain and enhance their products independently, but release them following an agreed process EMI Overview - Kick-off Meeting 2526/05/2010

26. EMI INFSO-RI-261611 Who‘s Who Product Team Leaders: – Are being identified, complete list will be published on the EMI (internal) web site and kept up-to-date 26/05/2010 EMI Overview - Kick-off Meeting 26

27. EMI INFSO-RI-261611 User Support Third-level User Support within the EGI-wide support line Technical User Support to ‘customers’ outside the EGI support lines (if necessary) Use GGUS as unique entry point for ‘incident management’ (user tickets) Response times defined by Service Level Agreements EMI Overview - Kick-off Meeting 2726/05/2010

28. EMI INFSO-RI-261611 Who‘s Who User Support Manager: Mathilde Romberg (JUELICH) 26/05/2010 EMI Overview - Kick-off Meeting 28

29. EMI INFSO-RI-261611 Shared initiatives Collaborations EMI Overview - Kick-off Meeting 29 EMI EGI-InSPIRE, PRACE, WLCG,OSG ESFRI, VRCs Stratuslab VENUS-C EDGI Requirements Releases Collaborations 26/05/2010 IGE SLAs & Support SIENA Industry Collaborations

30. EMI INFSO-RI-261611 Workplan Year 1 – Mostly focused on security, consolidation of services and libraries, usability. First major release at the end of the year (technical preview around PM6) Year 2 – Mostly focused on integration and deployment of messaging services, integration of virtualization technology and standardization of interfaces. Second major release at the end of the year Year 3 – New requirements, revision or business and exploitation plans Sustainability vision after project end – User-friendly, standard-based middleware is deployed through mainstream OS distributions and supported also by commercial companies EMI Overview - Kick-off Meeting 3026/05/2010

31. EMI INFSO-RI-261611 Conclusions EMI is the new European reference for distributed computing middleware It brings together the expertise of the major European middleware providers It propose a practical, but ambitious plan to shape the future of European middleware to empower EGI, PRACE and the research infrastructures at large Everybody is welcome to collaborate 26/05/2010 EMI Overview - Kick-off Meeting 31

32. EMI INFSO-RI-261611 Thank you 26/05/201032 EMI Overview - Kick-off Meeting EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611