ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT DIESIS Meeting – Portici

Contents ENEA-GRID infrastructure ( ) CRESCO project and the Virtual Lab ( Silvio Migliori * * ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM) ENEA-GRID and CRESCO project as part of DIESIS infrastructure

THE CONCEPT OF ENEA GRID INFRASTRUCTURE Cell Centered Data Base CCDB IMAGING-INSTRUMENTS COMP.-RESOURCESMULTI-SCALE-DATA-BASES NETWORK ADV.-COMP.-GRAPHICS DATA ANALYSIS DATA ACQUISITION By-Mark Ellisman

ENEA-GRID Sensor nets ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim –Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software –Build an homogeneous ICT infrastructure but with a distributed and delegated control –Integrate the ENEA-GRID with National and International GRIDS Data archives Colleagues & 3D Software catalogs Computers Application Fabric Connectivity Resource Collective User

ENEA-GRID from the user point of view Main feature: –Access from any kind of connection –Sharing data in world wide areas (geographical file system AFS) –Access to the data from any kind of digital device client –Running any kind of programs –Access to National and International GRIDS Sensor nets Data archives Computers Portic i ( Roma-1 Bologna EU… BrindisiRoma-2 Trisaia Software catalogs Computers Sensor nets ENEA-GRID

ENEA-GRID from application point of view Potentiality: –Running all Software Model for any kind of computer architecture –Only one installation for each software for all geographical computers –All authorized users can have access the software from local site –Any application can share the data in the common geographical file system –All sensors can share the data easily using the geographical file systems Sensor nets Computers Portic i ( Roma-1 Bologna EU… BrindisiRoma-2 Trisaia Software catalogs Computers Sensor nets ENEA-GRID Software Model 1 Software Model 2 Software Model 3 Software Model.. Rules Computers

AFS Geographical cross platform & File System AIX SGI SUN HP WinLinux Linux Alpha … LSF User programs and commercial codes LSF multi-cluster as integrator XTERM Graphical User Interface Application Portal (ICA-Protocol) ICAWEB Quality of service Monitoring, Automatic recovery Accaunting ENEA GRID

Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 5° ( Portici) & File System Load LevelerLSF Graphic User Interface Telnet ICA WEB Cluster 6° ( Brindisi) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 2° (Casaccia) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 4° (Trisaia ) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 3° (Frascati) AFS Geographical cross platform& File System Load LevelerLSF Graphic User Interface LSF multi-cluster as integrator Telnet User programs & commercial code ICA WEB Cluster 1° ( Bologna) A Simple view of ENEA GRID 8

CASACCIA FRASCATI S.Teresa Saluggia Ispra BOLOGNA PORTICI TRISAIA BRINDISI Manfredonia ENEA-GRID Computational & 3D Centers #CPU/Core 45

ENEA-GRID Computational Resources Computational resources of Portici (NA), Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575) Frascati(4), Portici(34),Trisaia(4), Brindisi(4) 10046Windows 32/64 Frascati(1), Trisaia(13) 6014Mac OS X Trisaia(4), Casaccia(2), Bologna(2) 108Solaris Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5) 4026IRIX Casaccia 30064Linux IA64 (Altix) Frascati(140), Casaccia(54), Portici(2700), Trisaia(20), Brindisi(84) 25000>3000 Linux x86 32/64 Frascati(258), Bologna(24), Portici(18),Brindisi(2) 3000>300AIX Gflops # CPU/Core OS

HPC CRESCO INFRASTRUCTURE Portici LAN Interconnections InfiniBand 4XDDR SERVERS GPFS 4 Nodi IBM 3650 IBFC High speed disc 2 GByte/s 160 TByte IBM/DDN 9550 Backup system 300 TByte IBM Tape Library TS3500 with 4 drives SERVERS BACKUP 3 Nodi IBM 3650 FCIB GARR (WAN) Section 1 (Large memory) 42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton Section 3 (Special) 4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each. 6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX5 4 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM Double interconnection at 1 Gbit & 1 network at 1 Gbit for management Section 2 (MPP) 256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MH z/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown 4x10 Gbits 400 /1000 Mbits 35 Node for services Servers for : Front-end installations AFS … CRESCO 17 TFlops

CRESCO HPC hall

CRESCO HPC details Sections 1 & 3 Section 2 & DDN Control room backup system network: IB/GB Corridor hot Sections 1 &2

Jack Dongarra 2002 CRESCO in the Top500 List June 2008 Italy (06/2008) 90CINECA 125ENEA 131ENI 135CILEA 156CINECA 226Telecom

Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 3000 CPU/cores CodeRisorsa SerialSection 1 & ENEA-GRID Parallel hardly coupledSection 2 Embarrassing parallelSection 1, 2, ENEA-GRID System with several parallel codes Section 1, 2, Section 1+2 Special ( FPGA, GB, CELL)Section 3 windows (serial and parallel)Section 3 Not LINUXENEA-GRID Large date Data BaseSection 1,2,3 e GPFS

DB_1 CPUS ENEA GRID WEB ICA SSH DNA Sequence system ( ABI Prism 3700) Trisaia DB_3 DB_2 Electron Microscope (Brindisi) 300 KeV (sept. 2004) ENEA GRID and experimental facilities Controlled Nuclear Fusion: FTU Frascati Tokamak Upgrade Video Acquisition

GARR PI2S2 GARR Others Entity La ENEA-GRID interoperability with others GRID ENEA has been developing the shared proxy solution Maintain the GRID internal architecture and autonomy Allow multiplatform impementations Under production on EGEE Under production on GRISU Required by EFDA for EGEE EFDA EGEE

CASACCIA FRASCATI S.Teresa Saluggia Ispra BOLOGNA PORTICI BRINDISI Manfredonia ENEA-GRID & GRISU & IGI ENEA-GRID SPACI TRISAIA GRISU INFN-GRID IGI Italian GRID Infrastructure

CRESCO for EUROPEAN FUSION Cresco 25 Tflops pick System for development and test of computational codes for ITER (EFDA contract) 1 Tflops pick IB

Accesso Client Accesso WEB sp4_-1.frascati.enea.it boquad.bologna.enea.it dafne.casaccia.enea.it GEANT infocal.trisia.enea.it Gateway to EGEE & GRISU Portici Brindisi Kleos.portici.enea.it ercules.brindisi.enea.it Accesso Diretto

Main Interface ENEA GRID makes use of Citrix Metaframe to publish an application providing a unified GUI interface all the available resources Application components: Java (GUI) shell scripts EnginFrame

ENEA-GRID & CRESCO CRESCO is totally integrate in ENEA-GRID

Submissions options Fluent options Example of use of FLUENT on ENEA-GRID External Users Sicurezza industriale Sicurezza ENEA

ENEA-GRID & Virtual Lab architecture Li ENEA University and research institute Enterprise New collaborations

ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT