ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT Infrastruttura & Competenze ICT ENEA Incontro Confindustria Monza Brianza ( )
Contents Infrastruttura ENEA-ICT & GRID/CLOUD Approccio Metodologico “Virtual Lab” Silvio Migliori ENEA-Unità Tecnica Sviluppo sistemi per l'informatica e l'ICT (UTICT) L'infrastruttura ICT dei laboratori virtuali ENEA a supporto della ricerca industria & territorio
ENEA-GRID Story Sensor nets ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim –Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software –Build an homogeneous ICT infrastructure but with a distributed and delegated control –Integrate the ENEA-GRID with National and International GRIDS Data archives Colleagues & 3D Software catalogs Computers Application Fabric Connectivity Resource Collective User
THE CONCEPT OF ENEA GRID INFRASTRUCTURE Cell Centered Data Base “CCDB” IMAGING-INSTRUMENTS COMP.-RESOURCESMULTI-SCALE-DATA-BASES NETWORK ADV.-COMP.-GRAPHICS DATA ANALYSIS DATA ACQUISITION By-Mark Ellisman
CodeApplication field FLUENT, OpenFoamCFD ANSYS,ABAQUS, NASTRAN Structures FLUKA,ERANOSNuclear MCNP, MCNPXNeutronics MpCCIFluid-structure interaction USER codesAny type and platform Web access Softwares Instruments
ENEA-GRID concept Potentiality: –Running all Software Model for any kind of computer architecture –Only one installation for each software for all geographical computers –All authorized users can have access the software from local site –Any application can share the data in the common geographical file system –All sensors can share the data easily using the geographical file systems Sensor nets Computers Portic i ( Roma-1 Bologna EU… BrindisiRoma-2 Trisaia Software catalogs Computers Sensor nets ENEA-GRID Software Model 1 Software Model 2 Software Model 3 Software Model.. Rules Computers
CASACCIA FRASCATI S.Teresa Saluggia Ispra BOLOGNA PORTICI TRISAIA BRINDISI Manfredonia ENEA-GRID Computational & 3D Centers (more then 4000 core) 90 > #CPU/Core 45 New 1000 core AMD 12 core/soket
Jack Dongarra 2002 CRESCO in the Top500 List June 2008 Italy (06/2008) 90CINECA 125ENEA 131ENI 135CILEA 156CINECA 226Telecom
Section 2 (MPP) 256 Nodes blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MH z/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown New 28 Nodes (224 core) Nehalem 2.4 GHz HPC CRESCO INFRASTRUCTURE Portici LAN SERVERS GPFS 4 Nodes IBM 3650 IBFC High speed storage 2 GByte/s 160 TByte IBM/DDN 9550 Backup system 300 TByte IBM Tape Library TS3500 with 4 drives SERVERS BACKUP 3 Nodes IBM 3650 FCIB GARR (WAN) Section 1 (Large memory) 42 Nodes SMP IBM x3850-M2 with 4 Xeon Quad- Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton Section 3 (Special) 4 Nodes blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each. 6 Nodes IBM x3755, 8 Core AMD 8222 FPGA VIRTEX5 4 Nodes IBM x 3755, 8 core AMD 8222 with NVIDIA Quadra FX 4500 X2 4 Nodes Windows 8 core 16 Byte RAM Double interconnection at 1 Gbit & 1 network at 1 Gbit for management 4x10 Gbits Mbits 35 Nodes for services Servers for : Front-end installations AFS CRESCO Peak: 28 TFlops CRESCO Peak: 28 TFlops New 10 Nodes for tools Tools: Faro Jobrama Amaca Interconnections InfiniBand 4XDDR
CRESCO HPC hall
Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 4000 CPU/cores CodeRisorsa SerialSection 1 & ENEA-GRID Parallel strongly coupledSection 2 Embarrassing parallelSection 1, 2, ENEA-GRID System with several parallel codes Section 1, 2, Section 1+2 Special ( FPGA, GB, CELL)Section 3 windows (serial and parallel)Section 3 Not LINUXENEA-GRID Large date “Data Base”Section 1,2,3 e GPFS
Some CRESCO HPC speed-up Fluent OpenFoam Commercial code Combustion Open Source Processors User Code CPMD Spedup procs
DB_1 CPUS ENEA GRID WEB ICA SSH DNA Sequence system ( ABI Prism 3700) Trisaia DB_3 DB_2 Electron Microscope (Brindisi) 300 KeV (sept. 2004) ENEA GRID and experimental facilities Controlled Nuclear Fusion: FTU Frascati Tokamak Upgrade Video Acquisition
New ENEA-GRID feature under develops for high resolution of microscope images Conceptual structure Site … Site 2 SITE 1 Logical access (AFS) MySQL structure Microscope High definition images CRESCO NX servers with graphic board New ENEA-GRD Java/web technology Low internet bandwidth for high resolution images 3D scenes
ENEA-GRID & CRESCO ACCESS FARO Graphics terminal Frontend all O.S. FARO
ENEA-GRID & CRESCO ACCESS FARO for Industry (Virtual LAB) Graphics terminal Frontend all O.S. SOFTWARE FARO for Virtual LAB (Gateway)
Conceptual structure from a remote user’s point of view Local Data AFS Data Integration > 4 TByte File server Streaming server Citrix XenApp Windows Linux Cluster WEB Sever NX+FARO Web conferencing Classroom Local GRID Cluster Main service View of TEM image Programs & Data E-learning tools ENEA GRID SOFTWARE INFRASTRUCTURE View of TEM image Programs & Data Supercomputing 3D Display E-learning tools Remote Operation Users Special Driver for TEM Remote Application Users + Remote operation NX + FARO
Corso SISM 9-10 Ottobre 2007
A new ENEA-GRID & Virtual Lab New material & TEM Li ENEA University and research institute Enterprise New collaborations
Cloud Computing in ENEA-GRID Prima Fase Fruizione di servizi e applicativi software Laboratori Virtuali (Accesso WEB a documentazione e software specifici di aree tematiche) File system geograficamente distribuito (OpenAFS) Seconda Fase Virtualizzazione Esperienza consolidata Esperienza nuova (work in progress)
Hydrogen storage and production Photovoltaic Metallic membranes Organic-inorganic adhesion Liquid and amorphous metallic and semiconductor systems Carbon and silicon based Tungsten and its alloys Quantum dots Materials under pressure etc ACTIVITIES CODES CPMD, CP2K, Quantum Expresso, LAMMPS GROMACS Homemade for intermetallics and semiconductors CMAST gathers all the CRESCO computational activities: ENEA researchers collaborate with industries and universities on several scientific activities sharing codes and ideas
OpenNebula e ENEA-GRID Accessibilità integrata in FARO Accesso integrato con il portale FARO Lista delle VM disponibili
To collaborate with ENEA ICT
ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT