EMI INFSO-RI-261611 European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.

Slides:



Advertisements
Similar presentations
EMI INFSO-RI NA2 – Outreach and Collaborations Emidio Giorgio (INFN Catania) NA2 Leader 1 st EMI Periodic Review Brussels, 22 June 2011.
Advertisements

EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.
EMI INFSO-RI European Middleware Initiative (EMI) Standardization and Interoperability Florida Estrella (CERN) Deputy Project Director.
The OMII Perspective on Grid and Web Services At the University of Southampton.
EGI: A European Distributed Computing Infrastructure Steven Newhouse Interim EGI.eu Director.
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.
EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EMI is partially funded by the European Commission under Grant Agreement RI Post EMI Plans and MeDIA Alberto DI MEGLIO, CERN Project Director WLCG.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director.
EMI INFSO-RI SA2 - Quality Assurance Alberto Aimar (CERN) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EMI is partially funded by the European Commission under Grant Agreement RI Software stack consolidation Balázs Kónya, Lund University 3rd EMI all-hands,
Overview & Status of the Middleware & EGI Core Proposals Steven Newhouse Interim EGI Director EGEE Technical Director 26/05/2016 Status of EGI & Middleware.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Vision for European DCIs Steven Newhouse Project Director, EGI-InSPIRE 15/09/2010.
EMI INFSO-RI EMI Structure, Plans, Deliverables Alberto Di Meglio (CERN) Project Director ATLAS Software & Computing Week Geneva, 21 July 2011.
European Middleware Initiative (EMI) – Release Process Doina Cristina Aiftimiei (INFN) EGI Technical Forum, Amsterdam 17. Sept.2010.
EMI INFSO-RI NA2 – Outreach and collaborations Status Report Emidio Giorgio (INFN Catania) Work Package Leader EMI First EC Review 22 June 2011,
EMI 1 Release The EMI 1 (Kebnekaise) release features for the first time a complete and consolidated set of middleware components from ARC, dCache, gLite.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN.
Future of Operational Tools- Separate proposal First meeting – 6th October.
EMI INFSO-RI JRA1.5-Infra-Cloud Computing Task Force Shahbaz Memon (JUELICH)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Bob Jones EGEE project director CERN.
EMI is partially funded by the European Commission under Grant Agreement RI Project Overview Alberto DI MEGLIO, CERN Project Director 2nd EMI Periodic.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
EMI INFSO-RI Project Overview NA1 – Administrative and Technical Coordination Alberto Di Meglio (CERN) Project Director 1 st EMI Periodic Review.
EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) SA1 Leader 1 st EMI Periodic Review Brussels, 22 June 2011.
EMI INFSO-RI Overview of the EMI development objectives Balázs Kónya (Lund University) EMI Technical Director EMI All Hands Prague, 23rd November.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
EMI INFSO-RI EMI Roadmap to Standardization and DCI Collaborations Alberto Di Meglio (CERN) Project Director.
EMI INFSO-RI SA1 Session Report Francesco Giacomini (INFN) EMI Kick-off Meeting CERN, May 2010.
European Middleware Initiative (EMI) The Software Engineering Model Alberto Di Meglio (CERN) Interim Project Director.
EMI is partially funded by the European Commission under Grant Agreement RI Project Status and NA1 Alberto Di Meglio, CERN 3 rd EMI All-Hands Meeting.
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN)
SA2.6 Task: EMI Testbeds Danilo Dongiovanni INFN-CNAF.
European Middleware Initiative (EMI) An Overview Alberto Di Meglio v
EMI INFSO-RI Technical Overview Balázs Kónya (Lund University) Technical Director 1 st EMI Periodic Review Brussels, 22 June 2011.
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.
EMI INFSO-RI NA3 & Sustainability Morris Riedel (JUELICH) Peter Stefan (NIIF) et al. EMI Vision Meeting, Geneva, 14 th -15 th December 2011.
EMI is partially funded by the European Commission under Grant Agreement RI NA2 : Outreach and Training Emidio Giorgio, INFN NA2 Leader 2 nd EMI.
European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
SciencePAD Open Software for Open Science Alberto Di Meglio – CERN.
EMI INFSO-RI SA1 – Maintenance and Support Francesco Giacomini (INFN) EMI First EC Review Brussels, 22 June 2011.
EMI Inter-component and Large Scale Testing Infrastructure Danilo Dongiovanni INFN-CNAF.
EMI INFSO-RI Project Overview NA1 Report Alberto Di Meglio (CERN) Project Director 1 st EMI Periodic Review Brussels, 22 June 2011.
Collaboration ed. 11/11/2009gLite Open Collaboration1 The gLite Open Collaboration “WLCG Overview Board” M. Mazzucato gLite Collaboration Board Chair.
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Plans for PY2 Steven Newhouse Project Director, EGI.eu 30/05/2011 Future.
EMI is partially funded by the European Commission under Grant Agreement RI Open Source Software and the ScienceSoft Initiative Alberto DI MEGLIO,
EMI INFSO-RI European Middleware Initiative (EMI) HSIN-YEN CHEN ASGC gWRF Thailand.
EMI INFSO-RI SA2: Quality Assurance Status Report Alberto Aimar(SA2) SA2 Leader EMI First EC Review 22 June 2011, Brussels.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director.
EMI INFSO-RI EMI 1, open source middleware and the road to sustainability Alberto Di Meglio (CERN) Project Director EGI User Forum EMI Technical.
EMI INFSO-RI /04/2011What's new in EMI 1: Kebnekaise What’s new in EMI 1 Kathryn Cassidy (TCD)‏ EMI NA2.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Outlook and Open Source Activities Alberto DI MEGLIO, CERN Project.
EMI is partially funded by the European Commission under Grant Agreement RI EMI Sustainability Alberto Di Meglio, CERN DCI Projects Meeting Amsterdam,
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI DCI Collaborations Steven Newhouse 15/09/2010 DCI Vision1.
Bob Jones EGEE Technical Director
Sustainability of EMI Results
Sviluppo middleware sostenibile Il caso di EMI
EMI and GISELA Collaboration
European Middleware Initiative (EMI)
EMI Collaboration Programs
EMI Interoperability Activities
European Middleware Initiative (EMI)
Presentation transcript:

EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN) Project Director

EMI INFSO-RI Outline What is EMI? EMI Vision and Objectives How does it work? EMI and UNICORE Conclusions 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Outline What is EMI? EMI Vision and Objectives How does it work? EMI and UNICORE Conclusions 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI EMI Mission Statement Jülich, UNICORE Summit The European Middleware Initiative (EMI) project represents a close collaboration of the major European middleware providers - ARC, gLite, UNICORE and dCache - to establish a sustainable model to support, harmonise and evolve the grid middleware for deployment in EGI, PRACE and other distributed e-Infrastructures 18/05/2010

EMI INFSO-RI FP7 Program Jülich, UNICORE Summit FP7 Capacities Work Programme 2010: Infrastructures Call FP7-INFRASTRUCTURES Sub-topic: – Middleware and repositories Develop middleware that strengthens European presence by consolidating or even going beyond existing DCIs (e.g. exploiting emerging developments like virtualisation), while improving their stability, reliability, usability, functionality, interoperability, security, management, monitoring and accounting, measurable quality of service, and energy efficiency Starting date: May 1 st Duration: 3 years Total budget: 23M € (12M € from EC + 11M € from partners) Effort: 64 FTEs/year (88% for technical activities) 18/05/2010

EMI INFSO-RI Primary Objectives Consolidate the existing middleware distribution simplifying services and components to make them more sustainable (including use of off-the-shelf and commercial components whenever possible) Evolve the middleware services/functionality following the requirement of infrastructure and communities, mainly focusing on operational, standardization and interoperability aspects Reactively and proactively maintain the middleware distribution to keep it in line with the growing infrastructure usage Jülich, UNICORE Summit Consolidate Evolve Support 18/05/2010

EMI INFSO-RI Partners (24) Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Outline What is EMI? EMI Vision and Objectives How does it work? EMI and UNICORE Conclusions 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI A European Vision Jülich, UNICORE Summit Today Tomorrow Sustainability Persistence Interoperability Easier Access Sustainability Persistence Interoperability Easier Access 18/05/2010

EMI INFSO-RI Increased Usability One of the major complaints of research users about the middleware is about its limited “userfriendliness” – Deployment, configuration, service management, interoperability, security mechanisms, flexibility, etc. Unnecessary duplication of services and libraries User requirements (ESFRI, VRCs) – EMI is requirement driven and will actively participate to the definition of user requirements with the major user communities and infrastructures 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Security One of the most important and most difficult aspects of the middleware – Usability: existing certificate-based technologies are needed, but too complex to manage or use for the typical user or not easy to integrate in existing security contexts – Reliability: the increasing use of distributed computing and the handling of sensitive data require reliable and auditable security methods – Interoperability: the chosen methods must be common across all services and implementations 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Standardization Very important to address a number of existing limitations – Interoperability, integration, extensibility and evolution, commercial usage All services must: – Implement the ‘best’ relevant standards – Implement them in the same way ‘Best’ means: – A ‘community’ standard, if it is useful, usable or can be realistically improved – A ‘de facto’ standard, if no community standard exists or what exists is clearly not usable Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Standardization EMI intends to be an active player in the standardization process – Actively take part in the European standardization roadmap coordinated by the European Commission and by initiatives like SIENA – Actively take part in established international standardization bodies like OGF Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Interoperability One of the major requirements of most user communities – Interoperability between different implementations of the same services or functionality – Interoperability among HTC and HPC – Interoperability between different infrastructures Also in this case, the widespread and formally correct adoption of standards is of primary importance Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Integration with New Technologies Technology evolves continually Distributed computing middleware must be able to capitalize on past achievements, but also learn from past lessons and become increasingly efficient and flexible Using labels like Grids or Clouds is misleading How can existing stable, reliable and secure services be made more elastic, dynamic, efficient? And again, standards are very important 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Innovation Jülich, UNICORE Summit Innovation is a key driver behind EMI New services or functionality are introduced as needed based on: New user requirements Need to evolve existing services or replace older technologies to support the growing infrastructures Special focus on integration of virtualization, monitoring interfaces, messaging, support for portals and gateways Stability of the existing infrastructure operations must be guaranteed Agreed migration timelines and paths 18/05/2010

EMI INFSO-RI Industrial Relationships The sustainability process relies on increased adoption by commercial companies EMI has an ‘industrial plan’ made of two important points: – Work with commercial partners to transfer and integrate technology in both directions – Understand with commercial experts what is the market, the realistic targets and the sustainable business models 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Outline What is EMI? EMI Vision and Objectives How does it work? EMI and UNICORE Conclusions 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Project Structure Administrative and Technical Management Dissemination and Communication Maintenance and Support Development, Integration and Evolution Quality Assurance 19 Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Project Execution 20 Jülich, UNICORE Summit 2010 Project Executive Board (PEB)Project Technical Board (PTB) Project DirectorTechnical Director Tech. areas PT Leaders External 18/05/2010 Engineering Management Team QA

EMI INFSO-RI Technical Areas Jülich, UNICORE Summit Compute Services Data Services Security Services Infrastructure Services A-REX, UAS-Compute, WMS, CREAM, MPI, etc dCache, StoRM, UAS-Data, DPM, LFC, FTS, Hydra, AMGA, etc UNICORE Gateway, UVOS/VOMS/VOMS- Admin, ARGUS, SLCS, glExec, Gridsite, Proxyrenewal, etc Logging and Bookkeeping, Messaging, accounting, monitoring, virtualization/clouds support, information systems and providers 18/05/2010

EMI INFSO-RI Software Engineering Process EMI Software Engineering Process is based on best practices: ITIL and COBIT provide a proven foundation for Release, Change, Problem Management, Quality Assurance and Continual Improvement The concept of Product Team is used to clearly allocate tasks and responsibility Each PT is responsible for one or more products from design to after- release user support, including testing and certification Each PT has a Leader responsible for the planning and execution of the tasks delegated to the PT Published release policies Periodic major releases of EMI with clear support timelines Individual service or component releases within an EMI major release Guaranteed backward-compatibility of each service within a major release Jülich, UNICORE Summit /05/2010

EMI INFSO-RI User Support Third-level User Support within the EGI-wide support line Technical User Support to ‘customers’ outside the EGI support lines (if necessary) Use GGUS as unique entry point for ‘incident management’ (user tickets) Response times defined by Service Level Agreements Jülich, UNICORE Summit /05/2010

EMI INFSO-RI Shared initiatives Collaborations Jülich, UNICORE Summit EMI EGI, PRACE, WLCG,OSG ESFRI, VRCs Stratuslab VENUS-C EDGI Requirements Releases Collaborations 18/05/2010 IGE SLAs & Support SIENA Industry Collaborations

EMI INFSO-RI Workplan Year 1 – Mostly focused on security, consolidation of services and libraries, usability. First major release at the end of the year (technical preview around PM6) Year 2 – Mostly focused on messaging services, integration of virtualization technology and standardization of interfaces. Second major release at the end of the year Year 3 – New requirements, revision or business and exploitation plans Sustainability vision after project end – User-friendly, standard-based middleware is deployed through mainstream OS distributions and supported also by commercial companies Jülich, UNICORE Summit /05/2010

EMI INFSO-RI EMI and UNICORE UNICORE brings into EMI essential contributions – Its existing expertise with HPC production services – Expertise in standardization and interoperability UNICORE has been traditionally very active in standardization activities with leading roles in OGF and more recently PGI Important interoperability use cases between HTC and HPC have been investigated already in the scope of projects like EUFORIA and are essential input for EMI – Important experiences with industrial partners – Expert effort on developing common security, info systems, messaging and service management technology across all EMI services 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Conclusions EMI is the new European reference for distributed computing middleware It brings together the expertise of the major European middleware providers It propose a practical, but ambitious plan to shape the future of European middleware to empower EGI, PRACE and the research infrastructures at large Everybody is welcome to collaborate 18/05/2010 Jülich, UNICORE Summit

EMI INFSO-RI Thank you 18/05/ Jülich, UNICORE Summit 2010 EMI is partially funded by the European Commission under Grant Agreement INFSO-RI