1. Grid’5000 Grid'5000 - DAS-3 workshop 104/12/06 Grid’5000 * DAS-3 – Grid'5000 workshop December 4th, 2006 www.grid5000.fr *5000 CPUs Pierre NEYRON - INRIA Head of Grid’5000 Technical Committee mailto: neyron@imag.fr

2. Grid’5000 Grid'5000 - DAS-3 workshop 204/12/06 Grid'5000 hardware Overview Hardware summary Grid'5000 Network Backbone network Security architecture Routing tables Grid'5000 Software stack Accounts management Grid tools Grid'5000 People Committees Technical staff Collaborative work Outline

3. Grid’5000 Grid'5000 - DAS-3 workshop 304/12/06 Grid’5000 platform overview 1000 (684) 518 (518) 500 (198) 500 (116) 500 (252) 500 (270) 500 (322) 500 (146) 500 (94) Nation wide Grid: 9 sites, 500 CPUs/site (1000 for Orsay) Currently: 2600 CPUs Interlink network: 10GB/s dark fibre

4. Grid’5000 Grid'5000 - DAS-3 workshop 404/12/06 Grenoble Rennes Lyon Toulouse Sophia Orsay Bordeaux

5. Grid’5000 Grid'5000 - DAS-3 workshop 504/12/06 Grid’5000 platform hardware Grid'5000 hardware summary see: https://www.grid5000.fr/mediawiki/index.php/Special:HardwareAbstract Manufacturers: HP Dell IBM Sun Apple CPU types: AMD Opteron [80%] Intel Xeon64 Intel Itanium2 Intel Xeon32 PowerPC G5 Network: Gigabit Ethernet Myrinet Infiniband

6. Grid’5000 Grid'5000 - DAS-3 workshop 604/12/06 Grid'5000 hardware Overview Hardware summary Grid'5000 Network Backbone network Security architecture Routing tables Grid'5000 Software stacks Accounts management Grid tools Grid'5000 People Committees Technical staff Collaborative work Outline

7. Grid’5000 Grid'5000 - DAS-3 workshop 704/12/06 Grid’5000 backbone network Grid'5000 dedicated backbone network Renater4: Sites connected to a single layer-2 VLAN RENATER Rennes RENATER Lille RENATER Nancy RENATER Bordeaux ParisLyon RENATER Grenoble Lyon RENATER Sophia RENATER Toulouse Black fibre Dedicated Lambda Fully isolated traffic! 10 Gbps 1Gb through Renater3 (MPLS) Renater4 VLAN 550 192.168.4.0/24 RENATER Orsay DAS-3 via Geant and Surfnet

8. Grid’5000 Grid'5000 - DAS-3 workshop 804/12/06 Grid'5000 router Site's Grid'5000 access machine Secure access Grid'5000 site Grid’5000 security architecture 2 fibers: 1 dedicated to Grid’5000 Grid'5000 site Grid'5000 site Grid'5000 network is isolated from Renater general purpose network. Access is granted thru secure gateways Lab Reginal Node Regional node Regional Node Cluster Lab's router SSH Regional Node Internet Renater general purpose national network backbone Grid'5000 dedicated isolated network backbone Lab network Grid'5000 site Site servers (DNS, LDAP, NFS, DHCP/PXE, Console, Reboot) Cluster nodes workstation Renater ds Grid'5000 network is

9. Grid’5000 Grid'5000 - DAS-3 workshop 904/12/06 Grid’5000 routing tables Site-to-Site routing tables Bordeaux 192.168.133.0 /24 (255.255.255.0) Grenoble (idpot ) 129.88.70.0 /24 (255.255.255.0) (icluster2) 129.88.98.0 /24 (255.255.255.0) (icare ) 192.168.11.0 /24 (255.255.255.0) Lille 192.168.159.0 /24 (255.255.255.0) Lyon 10.69.0.0 /17 (255.255.128.0) Nancy 172.28.52.0 /22 (255.255.252.0) Orsay 172.24.0.0 /16 (255.255.0.0 ) Rennes 131.254.202.0 /23 (255.255.254.0) Sophia 138.96.20.0 /22 (255.255.252.0) Toulouse 192.168.22.0 /24 (255.255.255.0) On site, not routed local networks Several private networks are used but not routed from site to site: admin network, IPMA/RSA network, Myrinet/Infiniband network... Routing for experiments using virtualization 10..0.0 address space used for virtual nodes (work in progress) => DAS-3 connection: Need to avoid IP conflicts

10. Grid’5000 Grid'5000 - DAS-3 workshop 1004/12/06 Grid'5000 hardware Overview Hardware summary Grid'5000 Network Backbone network Routing tables Security Grid'5000 Software stacks Accounts management Grid tools Grid'5000 People Committees Technical staff Collaborative work Outline

11. Grid’5000 Grid'5000 - DAS-3 workshop 1104/12/06 Cluster A single account for every user on every sites: Every site runs a LDAP server Every site manages its LDAP branch of user accounts Every site replicates the LDAP branches of the other sites Home directories structure automatically created All sites share the same global Grid'5000 account directory Grid'5000 account management Grid'5000 site SSH Home directories /home/ / LDAP accounts site local branch + replicated remote branches Grid'5000 site SSH Grid'5000 site remote accounts replication + home directory creation & on demand synchronization Unique user accounts on Grid'5000

12. Grid’5000 Grid'5000 - DAS-3 workshop 1204/12/06 Cluster Grid'5000 grid tools Grid'5000 site SSH Grid'5000 site SSH Resource management & deployment homes LDAP Grid'5000 site OAR Kadeploy OAR Kadeploy OAR Grid Every cluster is managed by a OAR server On user's demand, every cluster can be redeployed with the user's provided environment OAR grid allows grid submission over the whole grid

13. Grid’5000 Grid'5000 - DAS-3 workshop 1304/12/06 Grid'5000 hardware Overview Hardware summary Grid'5000 Network Backbone network Routing tables Security Grid'5000 Software stacks Accounts management Grid tools Grid'5000 People Committees Technical staff Collaborative work Outline

14. Grid’5000 Grid'5000 - DAS-3 workshop 1404/12/06 Grid’5000 committees Steering Committee (CP): Pr. Franck Cappello, Pr. Thierry Priol, Pr. Brigitte Plateau & al Technical Committee (CT): 20 engineers + researchers, about 50 persons Users: more than 200 active users, located on Grid'5000 sites/nearby/in foreign countries (Netherlands, Brazil, Africa, Japan...)

15. Grid’5000 Grid'5000 - DAS-3 workshop 1504/12/06 Grid’5000 technical staff Grid'5000 technical staff is dispatched on all 9 sites, France wild.  National: coordination + development (2 engineers)  Sites: 1 or 2 engineers per sites for the administration People hosted in INRIA research labs or universities. Bordeaux – Grenoble – Lille – Lyon – Nancy - Orsay (Paris) – Rennes – Sophia-Antipolis (Nice) - Toulouse Grid'5000 as a computer grid, and as a grid of People

16. Grid’5000 Grid'5000 - DAS-3 workshop 1604/12/06 Grid’5000 collaborative work Communication means: Mailing lists (CP, CT, users, site-users, site- staff, network-staff) Instant messaging (Grid'5000 dedicated Jabber server) Phone + audio-conf (monthly CT audio- meeting + task dedicated meeting... ) Physical meeting every 4 months Tools aiding collaborative work: Wiki: public web site + user's portal + committees portal Bugzilla: ticket tracking, task assignment SVN repository / GForge incident tracking tools/cross admin logs/monitoring

17. Grid’5000 Grid'5000 - DAS-3 workshop 1704/12/06 QUESTIONS ?