Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Towards a European HPC Infrastructure ( Topics Vision The DEISA/eDEISA Infrastructure The DEISA2, the European HPC infrastructure

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Status of the European HPC Infrastructure Vision of the European DEISA/eDEISA projects in FP6 To enhance Europe’s capability computing and science by the integration of Europe’s most powerful supercomputing systems Tier-1 in a European HPC e-infrastructure DEISA built a European Supercomputing Service on top of existing national services. This service is based on the deployment and operation of a persistent, production quality, distributed supercomputing environment with continental scope Vision of the European Strategy Forum on Research Infrastructures (ESFRI) Delivering a turnkey operational solution for a future persistent European HPC ecosystem integrating national Tier-1 centres and the new European Tier-0 centres

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Vision of a European HPC Ecosystem in FP7 T-0: future shared European PetaFLOP systems T-1: leading national supercomputing systems … PRACE Building a world-class pan-European High Performance HPC Ecosystem which is operated under the umbrella of an European Legal Entity adopting operational and technological concepts and services designed and approved by DEISA2. Enhancing the performance DEISA2 - The Infrastructure for the European HPC Ecosystem Deep operational and technological integration of European HPC (T-0 and T-1) centres and systems providing efficient seamless access to shared HPC resources and large data repositories designing and approving an operational model for a large European Virtual HPC Centre. Providing scientists access to a large distributed HPC environment via integrated services. T-1 T-0 T-1 DEISA is paving the way to the efficient operation of the T-0 and T-1 ecosystem

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Towards a European HPC Infrastructure – DEISA2 Objectives Enhancing the existing distributed European HPC environment (DEISA) to a turnkey operational infrastructure National HPC Center (T1) National HPC Center (T1) National HPC Center (T1) National Data Center (T1) National Data Center National HPC Center (T1) National HPC Center (T1) Advancing the computational sciences in Europe by supporting user communities and extreme computing projects Enhancing the service provision by offering a complete variety of options of interaction with computational resources Fusion Community Cosmology Community Climate Community Material Sciences Community Weather forecast Communities Industry Communities European Petascale Center (T0) European Petascale Center (T0) European Petascale Center (T0) Integration of T1 and T0 centres The Petascale Systems need a transparent access from and into the national data repositories DEISA2 – The Virtual European HPC Center Operation - Technology - Application USA TeraGrid,DoE Japan NAREGI Chinese Academy Russian Academy DEISA2 Bridging worldwide HPC projects

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Partners DEISA2:May 1st, 2008 – April 30th, 2011 Three new partners joined June 2005 (eDEISA) DEISA:May 1st, 2004 – April 30th, 2008

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Partners/ Associate Partners BSC Barcelona Supercomputing Centre Spain CINECA Consortio Interuniversitario per il Calcolo Automatico Italy CSC Finnish Information Technology Centre for Science Finland EPCC University of Edinburgh and CCLRC UK ECMWF European Centre for Medium-Range Weather Forecast UK (int) FZJ Research Centre Juelich Germany HLRS High Performance Computing Centre Stuttgart Germany IDRIS Institut du Développement et des Ressources France en Informatique Scientifique - CNRS LRZ Leibniz Rechenzentrum Munich Germany RZG Rechenzentrum Garching of the Max Planck Society Germany SARA Dutch National High Performance Computing Netherlands KTH Kungliga Tekniska Högskolan Sweden CSCS Swiss National Supercomputing Centre Switzerland JSCC Joint Supercomputer Center of the Russian Russia Academy of Sciences

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA The basic DEISA infrastructures and services Dedicated high speed network infrastructure Common AAA infrastructure Global data management infrastructure Integrating distributed data with distributed computing platforms, including hierarchical storage management and databases. Major highlights are: High performace remote I/O and data sharing with global file systems, using full network bandwidth High performance transfers of large data sets, using full network bandwidth DCPE (Distributed Common Production Environment) The job management service The science gateways (portals) to supercomputing resources Common Operational Environment Common monitoring and Information systems Common system operation Common help desk Global Application Support

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA network infrastructure RENATER FUNET SURFnet GÉANT DFN GARR UKERNA RedIris 1 Gb/s GRE tunnel 10 Gb/s wavelength 10 Gb/s routed 10 Gb/s switched

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA 1GE site ECMWF via GEANT2 GRE tunnel GARR CINECA-Net: /24 ECMWF-Net: /24

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Linux SGI SARA (NL) LRZ (DE) DEISA Data Services - Global File System (based on IBM’s GPFS) CINECA (IT) FZJ (DE) ECMWF (UK) IDRIS (FR) AIX IBM domain RZG (DE) BSC (ES) LINUX Power-PC CSC (FI) HPC Common Global File System similar architectures / operation systems High bandwidth (10 Gbit/s) High Peformance Common Global File System various architectures / operating systems High bandwidth (up to10 Gbit/s)

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Workflow simulations using UNICORE UNICORE supports complex simulations that are pipelined over several heterogeneous platforms (workflows). UNICORE handles workflows as a unique job and transparently moves the output – input data along the pipeline. UNICORE clients that monitor the application can run in laptops. UNICORE has a user friendly graphical interface. DEISA has developed a command line interface for UNICORE.

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Operational Model

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Enabling Science The basic service providing model for scientific users is the Extreme Computing Initiative (see Identification, deployment and operation of a number of « flagship » applications requiring the infrastructure services, in selected areas of science and technology. European Call for proposals in May-June every year. Applications are selected on the basis of scientific excellence, innovation potential and relevance criteria, with the collaboration of the HPC national evaluation committees. Supported by the Applications Task Force (ATASKF) Hyperscaling of huge parallel applications, data oriented applications Workflows and coupled applications Production of an European Benchmark Suite for HPC systems

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Extreme Computing Initiative DECI call proposals, 12 European countries involved 30 mio cpu-h requested 29 proposals accepted, 12 mio cpu-h (standardized of P4 Jülich) DECI call proposals, 12 European countries involved 28 mio cpu-h requested 23 proposals accepted, 12 mio cpu-h DECI call proposals, 14 European countries involved (US, Canada, Brazil, Israel) 30 mio cpu-h requested

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Extreme Computing Initiative 15 European countries so far involved in DECI: Austria FinlandFranceGermany Greece HungaryItalyNetherlands PolandPortugalRussiaSpain Sweden SwitzerlandUK

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DECI Projects – Publications Benedict J. Reynwar, Gregoria Illya, Vagelis A. Harmandaris, Martin M. Müller, Kurt Kremer & Markus Deserno: Aggregation and vesiculation of membrane proteins by curvature mediated interactions, NATURE Vol 447|24 May 2007| doi: /nature05840 Cover story of Nature May 24, 2007 DECI project POLYRES 26 publications so far, among them NATURE, Phys Rev B, Phys Rev Lett, PNAS

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA The purpose of the DEISA2 Consolidation of the existing DEISA infrastructure Guaranteeing the continuity of those activities and services that currently contribute to the effective support of world-leading computational science in Europe DEISA2 providing a lean and reliable turnkey operational solution for a persistent European HPC ecosystem Evolvement this European infrastructure towards a robust and persistent European HPC ecosystem Enhancing the existing services, by deploying new services including support for European Virtual Communities, and by cooperating and collaborating with new European initiatives, especially PRACE that will enable shared European PetaFlop/s supercomputer systems DEISA2 as the vector for the integration of Tier-0 and Tier-1 systems in Europe

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA The purpose of DEISA2 DEISA2 advancing computational sciences in Europe DEISA2 will provide a consistent infrastructure for virtual organisations as the European Fusion Development Agreement (EFDA) supporting ITER, the Climate Modelling Community, the Cosmology Consortium VIRGO, Material Sciences projects/communities, Life Science projects/communities DEISA2 as an extended partnership DEISA2 targets the integration of further national Tier-1 partners DEISA2 bridging worldwide HPC projects Interoperation in a Grid context worldwide is seen as an important step for supporting international science communities which acquire computing time traversing existing political boundaries

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Integrated Tier-1 Systems Participant short nameArchitectureTF/s [1] [1] #Cores [2] [2] Memory in TB [3] [3] MPG-RZGIBM BlueGene P27.08, IBM Power , BAdW-LRZSGI-Altix Itanium 62.39, BSCIBM PowerPC CINECAIBM Blade Center IBM Power CSCCray XT4 dc10.12, Cray XT4 qc70.06, FZJIBM BlueGene P , IBM p690 cluster JUMP8.91, JUMP successor > 50n/a IDRIS-CNRSIBM p690+ Cluster IBM p690+ successor> 40n/a SARAIBM Power IBM Power UEdin-EPCCCray XT , UStutt-HLRSNEC SX

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Site, Project, CommunityShort Description CLARIN The pan-European Common Language Resources and Technology Infrastructure is committed to enabling eHumanities. COSMOS The COSMOS Network gathers 20 institutions from 6 different European countries involved in the climate research. DANTE DANTE (Delivery of Advanced Network Technology to Europe) is a non-profit organisation owned by a group of National Research and Education Networks (NRENs). EFDA/ITER The European Fusion Development Agreement is interested in a strong support for the theoretical fusion science community. EGI The consortium of EGI aims at establishing a sustainable Grid infrastructure in Europe, coordinating national Grid initiatives. ENES The European Network for Earth System Modelling expects a strong support for the earth science virtual community in a pan-European context by DEISA2. European Psi-k Network in Material Science Psi-k Network will collaborate with DEISA2 in improving the support for the European Virtual Scientific Communities in the field of Material Science. EuroPhysiome A European biomedical research project. HPC-Europa Pan-European Research Infrastructure on HPC providing HPC access and scientific support to researchers. ITESM The computing department of the Instituto Tecnol ó gico y de Estudios Superiores de Monterrey, Campus Estado de provides a wide range of Grid infrastructures for Latin America. Joint Supercomputer Center of the Russian Academy of Sciences The Joint Supercomputer Center JSCC represents HPC in the Russian Academy of Sciences. They are considered an Associate Partner. Meraka The African Advanced Institute for Information and Communications Technology is the leading HPC centre in South Africa and is deeply involved in the South African e-infrastructure. NAREGI The National Research Grid Initiative is the leading Japanese HPC infrastructure project. OMII-Europe OMII-Europe is the interoperability project in Europe providing open standards based interoperability components. PACE Partnership for Advanced Computing in Europe is aiming at installing leadership class supercomputers in Europe. SSC The Shanghai Supercomputer Center is currently the most powerful HPC centre in China. Supercomputing Center of the Chinese Academy of Sciences The Supercomputing Center SCCAS represents HPC in the Chinese Academy of Sciences. TeraGrid TeraGrid is an open scientific discovery infrastructure in the US, combining leadership class resources at nine partner sites to create an integrated, persistent computational resource. Collaboration with other EU Projects, Institutions,…

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Towards a European HPC Infrastructure Topics Vision The DEISA/eDEISA Infrastructure The DEISA2, the European HPC infrastructure

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA WP4 - Technologies WP3 - Operations WP6/WP6/WP7/WP9 – Applications and user support Offer new service or upgrade existing ones Offer new service or upgrade existing ones Answer Request for new/upgraded services Relationship of the WPs in DEISA2 (except management, dissemination and one “real” JRA)

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA Management Structure

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA2 WP1 Management WP2 Dissemination, External Relations WP3 Operations WP4 Technologies WP5 Applications enabling WP6 Environment, User Related Application Services, and Training WP7 DECI Computing Projects and Benchmark Suite WP8 (JRA) Integrated DEISA Development Environment WP9 (JRA) Enhancing Scalability

Ingrid Conferene, Ischia, April Stefan Heinzel, DEISA DEISA Partners DEISA Start on 1st of May 2004 Three new partners joined with eDEISA June 2005 DEISA2 should start 1st of May 2008 with 3 new Associate Partners for 3 years