EMI is partially funded by the European Commission under Grant Agreement RI EMI Outlook and Open Source Activities Alberto DI MEGLIO, CERN Project Director EGI Community Forum 2012/EMI 2 nd Technical Conference 27-30/03/2012

EMI INFSO-RI EMI 27/03/2012EGI/EMI Conference gLite ARC UNICORE dCache

EMI INFSO-RI EMI Main Objectives 27/03/2012EGI/EMI Conference Maintenance and Support Innovation and Development Strategic activities Dissemination Sustainability Strategic activities Dissemination Sustainability EMI 1 KebnekaiseEMI 2 Matterhorn EMI Collaboration ScienceSoft

EMI INFSO-RI Maintenance – 14 EMI 1 updates released, fixing more than 1200 bugs – Coordination of security updates within EMI and with EGI Support – Since EMI 1 release 531 incidents submitted, 493 incidents resolved (93%) – Proactive EMI-EGI SLA monitoring No significant SLA violation observed Release – Matterhorn release schedule definition & management – Continuous build and integration using the ETICS system – Beta & acceptance testing process definition and implementation – Release provisioning through EGI/UMD or directly to sites for testing Maintenance and Support 427/03/2012EGI/EMI Conference 2012

EMI INFSO-RI Maintenance and Support 5 Releases of 119 components 42 services in 14 updates 1218 bugs fixed 493 incidents closed 27/03/2012EGI/EMI Conference 2012

EMI INFSO-RI Innovation and Development 27/03/2012EGI/EMI Conference EMI 1 Kebnekaise Open Source process adoption Distribution consolidation EMI 2 Matterhorn New functionality New services Agreements and standardization 29 Product Teams 57 products 101 planned development tasks 75 completed 19 prototypes 7 postponed

EMI INFSO-RI Innovation and Development 27/03/2012EGI/EMI Conference Requirements Technical Plans Development and Test Plans Development Testing Certification Validation Release Maintenance Support NA1, NA3, JRA1 JRA1 SA1 SA2 Software & Services Requirements Defines ImplementsCertifies Release Candidate Process definition Process monitoring NA2 Training Dissemination In-Reach

EMI INFSO-RI Major new features and services Extended back-end support for all EMI CEs to Torque, SGE, LSF, SLURM All the EMI services publish GLUE2 conformant information A common service registry for all EMI services (EMIR) Comprehensive set of Nagios probes for every EMI service Encrypted storage on ordinary EMI Ses based on Hydra and the Pseudonymity service A prototype of the common EMI security library (CANL) ARGUS as the official EMI authorization solution via integration with all the SEs and CEs Support for SL6 and Debian 6 Technical Agreements and Standardization Implementation of a common EMI interface for job management (EMI-ES) Storage Accounting record (StAR) and Compute Accounting record (CAR) A common EMI SAML profile Industry standard protocols for accessing the EMI SEs – DPM and DCache ready for NFS4.1 – HTTPS access to DPM, StoRM, dCache – WebDAV access to DPM and dCache Innovation and Development 27/03/2012EGI/EMI Conference 20128

EMI INFSO-RI Innovation and Development 27/03/2012EGI/EMI Conference EMIR, CANL, Nagios Probes, EMI-ES, XAML Profile, ARGUS, StAR, etc EDGI Bridges to access desktop computing resources through the EMI Computing Elements WNoDeS to access batch resources through a common interface supporting both grid and cloud models Community contributions

EMI INFSO-RI Infrastructure Build and test infrastructure for SL5, SL6 and Deb 6 Dynamic on-demand instantiation of nodes based on build requirements Automatic (ETICS) or user-defined generation of RPMs and DEB packages Testbed Testbed services for RCs and Production on all supported platforms (> 200 hosts/VMs) Deployment of 14 EMI 1 updates (> 40 products) Deployment of EMI 2 packages for the all supported platforms Use the new Nagios probes to monitor the services (very good collaboration with EGI) Metrics and Policies Compliance with EPEL/Fedora and Debian repositories Weekly Quality Control verifications and reports QA and Software Processes 27/03/2012EGI/EMI Conference

EMI INFSO-RI Dissemination and Out-Reach 27/03/2012EGI/EMI Conference ContentChannels +

EMI INFSO-RI Dedicated Strategy Director Promote EMI within open standard bodies Usage record extensions to storage/compute EMI Execution Service concepts to PGI/BES/JSDL Explore exploitation and sustainability models Different funding models (community funds, open source) Conduct interviews with core user communities on strategic topics (new requirements, clouds) Engage with contacts in industry SysFera, Buerhoop, TECHNICOLOR, dCore, etc. Strategic Activities 27/03/2012EGI/EMI Conference

EMI INFSO-RI A new initiative Promoted by EMI in collaboration with EGI, StratusLab, iMarine, OpenAIRE and a number of other projects and SMEs With the goal of Exploring the feasibility and advantages of creating an open source community for software specific to scientific communities Collecting community requirements, propose realistic solutions Making the activities of producing and using open source software for science more transparent and collaborative across communities and projects ScienceSoft 27/03/2012EGI/EMI Conference

EMI INFSO-RI ScienceSoft 27/03/2012EGI/EMI Conference Requirements/Gaps Lack of continuity in support, development, coordination of software Non-optimal communication between users and developers Lack of consistent real usage information Limited access to other users’ experience Limited or complex ways of finding what exists already Limited possibilities of influencing the production of software Lack of visibility and recognition of development activities No way of assessing the user “market” and potential revenues Possible solutions Software and services catalogues Generation of usage statistics Honour system (Peer-reviews) Citation system to allow software to be referenced in papers Marketplace for products, services, and people to match user needs and software products and skills Platform integration support based on the catalogues information Support for creation of ad-hoc communities and groups Coordination, collaboration and discussion tools Support for organization of technical events

EMI INFSO-RI ScienceSoft 27/03/2012EGI/EMI Conference

EMI INFSO-RI EMI sustainability plan is based on the continuing collaboration of its partners after the EMI project The third and final year of the project will focus on defining its scope, terms and composition In addition EMI is working in collaboration with its main users on a technology roadmap to define how distributed computing and data middleware will evolve in the next 3 to 5 years The vision resulting from this discussion will be contributed to the user community and will drive any future EMI activity EMI Collaboration 27/03/2012EGI/EMI Conference

EMI INFSO-RI Tuesday Info systems, security, messaging, data management, ScienceSoft Wednesday Job management, QA and software engineering Thursday Release management, testing, QC, standardization, accounting Training and demos for site admins and trainers (demo on EMI-ES and WNoDeS), application development Sessions, Training and Demos 27/03/2012EGI/EMI Conference

EMI INFSO-RI /03/2012EGI/EMI Conference EMI is partially funded by the European Commission under Grant Agreement INFSO-RI