1. CYBERSAR Cybersar Gianluigi Zanetti (zag@crsr4.it) Cybersar

2. CYBERSAR Cybersar A cooperative effort for a shared HPC facility Dual purpose –Computational Support to RTD –RTD on computational infrastructure Members of the co-op –CRS4, INAF, INFN, UNICA, UNISS, Nice, Tiscali Partially Funded by MUR –March 2006 – December 2008 Supported by RAS (Sardinian Regional Authority) –access to dark-fibers & regional network AOB INFN

3. CYBERSAR Cybersar A cooperative effort for a shared HPC facility Dual purpose –Computational Support to RTD –RTD on computational infrastructure Members of the co-op –CRS4, INAF, INFN, UNICA, UNISS, Nice, Tiscali Partially Funded by MUR –March 2006 – December 2008 Supported by RAS (Sardinian Regional Authority) –access to dark-fibers & regional network AOB INFN

4. CYBERSAR Cybersar Cybersar from afar 1/5 Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

5. CYBERSAR Cybersar Cybersar from afar 2/5 Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB

6. CYBERSAR Cybersar Cybersar from afar 3/5

7. CYBERSAR Cybersar Cybersar from afar 4/5 RTR DWDM network 2.5Gb/s lambdas Dark fiber core

8. CYBERSAR Cybersar Cybersar from afar 5/5 DWDM network 2.5Gb/s lambdas Janna dark fibers

9. CYBERSAR Cybersar Geographical latencies -or- Have bandwith, can wait Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

10. CYBERSAR Cybersar Have bandwith, can wait 1/7 Latencies Infiniband ~ 2  sec GbE ~ 10  sec Disk(10K rpm) ~ 8 msec 1 msec 0.5 msec

11. CYBERSAR Cybersar Have bandwidth, can wait 2/7

12. CYBERSAR Cybersar Have bandwidth, can wait 3/7 driving application I: large scale virtual observatory for deep space exploration

13. CYBERSAR Cybersar Have bandwidth, can wait 4/7 driving application II: ensemble forecast system of “extreme” meteorological events

14. CYBERSAR Cybersar Have bandwidth, can wait 5/7 : wavefield migration and montecarlo imaging of deep underground structures

15. CYBERSAR Cybersar Have bandwidth, can wait 6/7 driving application IV: immersive exploration of large scale scientific and engineering data

16. CYBERSAR Cybersar Have bandwidth, can wait 7/7 driving application V: driving (quasi-) holographic display

17. CYBERSAR Cybersar Dynamic resource allocation Total: Cpu : 1,224 cores RAM: 2.5 TB Disk: 211 TB Cpu : 488 cores RAM: 1 TB Disk: 100 TB Icnct: GbE, IB Cpu : 256 cores RAM: 0.5 TB Disk: 32 TB Icnct: GbE Cpu : 72 cores RAM: 0.14 TB Disk: 13 TB Icnct:, IB Cpu : 408 cores RAM: 0.8 TB Disk: 66 TB Icnct: GbE, IB

18. CYBERSAR Cybersar Collaborating computing centers, T = T 0 Network infrastructure Computing HW Computing HW Computing HW OS Middleware Application OS

19. CYBERSAR Cybersar Collaborating computing centers, T = T 0 + 6 months Network infrastructure Computing HW Computing HW Computing HW OS Middleware Application OS Middleware

20. CYBERSAR Cybersar Physical layer VO appslayer VO computing facility layer WN portal WN scheduler WN portal WN scheduler

21. CYBERSAR Cybersar Physical layer VO computing facility layer WN portal WN scheduler WN portal WN scheduler Control Plane VOCF-1 VOCF-n VOCF Blueprints VOCF running images Activator Hibernator VOCF Manager

22. CYBERSAR Cybersar WN portal WN scheduler VLAN WN portal WN scheduler Host deploymentVM deployment

23. CYBERSAR Cybersar Cybersar Control plane Clear separation between –state information & control logic Implemented as a SOA –All components wrapped in a WS –State information -> WSRF –Control logic -> BPEL workflows –VM (Xen) encapsulated by a WSRF (VMH) on each comp. host –Independent comm. Network to components –Low level components control via IPMI/SNMP wrapped by WS Status –Basic Deployement system, Activator and VOCF manager –16 dual opteron testbed –Xen 3, (kvm) support –Started testing gLite WN, CE See also: + Virtual Clusters for Grid Communities. I.Foster et al. CCGrid 2006 + An Edge Services Framework (ESF) for EGEE, LCG, and OSG. A.Rana et al. CHEP (Computing in High Energy and Nuclear Physics) 2006, Mumbai, February 13-17, 2006. + SOA based control plane for virtual clusters, P.Anedda et Al. IEEE-XHPC’07, 2007

24. CYBERSAR Cybersar Cyber-infrastructure for research in Sardinia Dedicated to the support of scientific & technological research Based on high speed networks connecting Network core on dark fibers Excellent platform to support research on –Optical switching –Bandwidth Unlimited Computing –Computing control plane AOB

25. CYBERSAR Cybersar Questions?