1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu gergely.sipos@egi.eu malgorzata.krakowian@egi.eu 30/05/2012

2. www.egi.eu EGI-InSPIRE RI-261323 EGI European –Over 35 countries Grid –Secure sharing Infrastructure –Computers –Data –Instruments –…. and beyond!! 30/05/2012

3. www.egi.eu EGI-InSPIRE RI-261323 EGI Resource Infrastructure Providers: National Grid Initiatives 30/05/2012 (Snapshot: April 2012)

4. www.egi.eu EGI-InSPIRE RI-261323 Guiding Principles Be a neutral resource provider –Any application, any domain, any technology –A platform for domain specific innovation & use –Integration of any compliant resource End-user needs and technologies change –Allow communities to deploy their own services –Give communities the power to meet their own needs 30/05/2012

5. www.egi.eu EGI-InSPIRE RI-261323 EGI platforms Community Platform EGI resources (cores & storage) VM EGI Core Infrastructure Platform EGI Cloud Infrastructure Platform Virtual Research Communities EGI Collaboration platform Community Platform (gLite Grid) Grid services

6. www.egi.eu EGI-InSPIRE RI-261323 6 User communities of the Core infrastructure platform User VO Virtual Research Community Members Virtual Organisations Research communities Largest user communities: High Energy Physics Astronomy & Astrophysics Life Sciences Earth Sciences Computational Chemistry Fusion … ~25.000 users in ~200 Registered VOs http://operations-portal.egi.eu/vo

7. www.egi.eu EGI-InSPIRE RI-261323 Core infrastructure platform use case 1: workload management Computing service Storage Service Site X of YOUR VO Information System Submit job query Retrieve output Create job definition Submit job (batch executable + small inputs) Broker service User environment publish state VO Management Service (VOMS) create Proxy (~login) process Retrieve status & (small) output files Logging and bookkeeping service Job status Logging Read/write files 7 Core infrastructure platform

8. www.egi.eu EGI-InSPIRE RI-261323 Core infrastructure platform Core infrastructure platform use case 2: data management Computing service Storage service Site X of YOUR VO Information System Query Command line or Portal publish state VO Management Service (VOMS) create proxy Upload file Download file File Catalog and/or Metadata catalog Register file Lookup file File content File references 8

9. www.egi.eu EGI-InSPIRE RI-261323 Core infrastructure platform services 1/07/2010 1.Service registry (GOCDB) –Repository to maintain topology and other type of basic information about distributed services 2.Accounting infrastructure –To gatger, process and visualise usage of distributed services 3.Service Availability Monitor (SAM) –To gatger, process and visualise availability and reliability information about distributed services 4.Service discovery capability (GLUE and LDAP) –To store detailed and dynamic information about services. To discover services by features. 5.Helpdesk (GGUS, xGUS) –To troubleshoot problems or provide guidance about products and services.

10. www.egi.eu EGI-InSPIRE RI-261323 Cloud infrastructure platform Hardware OS Grid middleware Scientific portal Hypervisor Community specific, grid enabled services OS Scientific portal Hardware OS Grid middleware Scientific portals (SaaS environments) Community specific, grid enabled services OS Custom services OS

11. www.egi.eu EGI-InSPIRE RI-261323 Sept 2011 – March 2013: Federated Cloud Task Force –Identify open source technologies (OpenStack, OpenNebula,...) and open standard (OCCI, CDMI, GLUE2,...) –Deploy a testbed –Write blueprint for resource centres –Identify issues from non-technical areas (policy, dissemination) August 2012 – March 2013: Pilot use cases –Support early adopters –Collect and feedback requirements –Establish user-facing services EGI cloud roadmap http://go.egi.eu/cloud

12. www.egi.eu EGI-InSPIRE RI-261323 Structural biology – We-NMR project: Gromacs training environments Ecology – BioVel project: Remote hosting of OpenModeller service Linguistics – CLARIN project: Scalable ‘British National Corpus’ service (BNCWeb) Software development – SCI-BUS project: Simulated environments for portal testing Space science – ASTRA-GAIA project: Data integration with scalable workflows Some of the cloud infrastructure pilot use cases

13. www.egi.eu EGI-InSPIRE RI-261323 Services of the Collaborative platform 1: EGI Applications Database Benefits: Gives recognition to reusable scientific applications, application developer tools, portals, workflows, etc. Gives recognition to application developers (people profiles) Access through web page AND web gadget Community features such as commenting, rateing, tag-based groupings http://appdb.egi.eu 30/05/2012

14. www.egi.eu EGI-InSPIRE RI-261323 Benefits: Register & share training events, expertise, services, materials, resources, online courses, university courses Browse and search items Community features such as commenting, rating Access through web page and web gadget http://training.egi.eu 30/05/2012 Services of the Collaborative platform 2: Training Marketplace

15. www.egi.eu EGI-InSPIRE RI-261323 Services of the Collaborative platform 3: Requirements tracker 30/05/2012 Technology Coordination Board EGI Requirements Tracker NGIs VRCs VOs User Community Support Team of EGI.eu Technology providers projects events Input channels for community requirements EGI Helpdesk User Community Board Operations Management Board Resource centres Structured scientific communities NGIs & projects http://go.egi.eu/requirements

16. www.egi.eu EGI-InSPIRE RI-261323 EGI Web Gadgets: Embed EGI services into Websites! The simplest way to reuse EGI services: embed EGI gadgets into your website Benefits –Customisability –Reusability –Compatibility Existing gadgets: –Application Database –Training Marketplace –Requirement Tracker Use and develop gadgets & share them through EGI: www.egi.eu/user-support/gadgets 30/05/2012

17. www.egi.eu EGI-InSPIRE RI-261323 EGI’s Strategic Focus Community & Coordination –Community building through events. Next event: EGI Community Forum: http://cf2013.egi.euhttp://cf2013.egi.eu –Community networking through the NGIs –Collaboration Platform Operational Infrastructure (cloud & core) –Operate a European wide infrastructure –Offer its use to other research infrastructures –Build a federated cloud environment Virtual Research Environments (community platforms) –Enable 3 rd party integration & operation of VREs http://go.egi.eu/EGI2020 30/05/2012

18. www.egi.eu EGI-InSPIRE RI-261323 Summary EGI.eu established in Amsterdam –Supported through EGI-InSPIRE project EGI operates as a federation of national resource providers EGI works with technology providers on an open standards based architecture EGI evolves to support the needs of its current and new research communities 30/05/2012