1. HEPix April 2006 NIKHEF site report What’s new at NIKHEF’s infrastructure and Ramping up the LCG tier-1 Wim Heubers / NIKHEF (+SARA)

2. HEPix April 2006 Wim Heubers / NIKHEF Servers & desktops Server systems: Server systems: Supermicro: SLC3, SLC4, MS Server 2003 Supermicro: SLC3, SLC4, MS Server 2003 high-end file service: EMC high-end file service: EMC low-end file service: Supermicro + Infortrend low-end file service: Supermicro + Infortrend compute server: quad Opteron (theory dep.) compute server: quad Opteron (theory dep.) Desktop systems: Desktop systems: Dell Dimensions: SLC3, SLC4, MS XP Dell Dimensions: SLC3, SLC4, MS XP Apple Mac revival Apple Mac revival What’s new at NIKHEF’s infrastructure

3. HEPix April 2006 Wim Heubers / NIKHEF Migrating file services Phasing out Solaris (NFS) and MS 2003 (CIFS) central file services for ‘home’ and ‘project’ Phasing out Solaris (NFS) and MS 2003 (CIFS) central file services for ‘home’ and ‘project’ Migration to EMC NS502 filer Migration to EMC NS502 filer Integration of Unix and Windows home dirs Integration of Unix and Windows home dirs native NFS and CIFS access (no SAMBA) native NFS and CIFS access (no SAMBA) different view on same file different view on same file Advantages: Advantages: one home dir per user, one quota system (incl group), snapshots, dynamic volume management, etc. one home dir per user, one quota system (incl group), snapshots, dynamic volume management, etc. What’s new at NIKHEF’s infrastructure

4. HEPix April 2006 Wim Heubers / NIKHEF Storage on demand SARA (1) offers ‘storage-on-demand’ SARA (1) offers ‘storage-on-demand’ iSCSI, NFS, CIFS services iSCSI, NFS, CIFS services high (FC) and normal (SATA) performance high (FC) and normal (SATA) performance implemented on EMC implemented on EMC connection: dedicated fibers (or OPN, or VLAN) connection: dedicated fibers (or OPN, or VLAN) pilot project has just started pilot project has just started exploring data migration scenarios, replication and backup issues, etc exploring data migration scenarios, replication and backup issues, etc fixed price per TB/year for 3-years contract. fixed price per TB/year for 3-years contract. (1) SARA is our neighbor and ‘ partner for a broad range of expertise in ICT’. What’s new at NIKHEF’s infrastructure

5. HEPix April 2006 Wim Heubers / NIKHEF Networking Upgrade NREN (SURFnet-6) connection: Upgrade NREN (SURFnet-6) connection: 10 gigabit/sec bandwidth 10 gigabit/sec bandwidth OPN services OPN services we are ‘pilot user’, good results! we are ‘pilot user’, good results! Wireless LAN Eduroam authentication Wireless LAN Eduroam authentication inter-institutional roaming inter-institutional roaming RADIUS-based infrastructure that uses 802.1X RADIUS-based infrastructure that uses 802.1X What’s new at NIKHEF’s infrastructure

6. HEPix April 2006 Wim Heubers / NIKHEF Netherlands LHC/Tier-1 Partners: NIKHEF, SARA, NCF Partners: NIKHEF, SARA, NCF Budget: BigGrid (the Dutch E-science Grid) Budget: BigGrid (the Dutch E-science Grid) Organization: to be discussed Organization: to be discussed Network infrastructure present at campus: Network infrastructure present at campus: NREN SURFnet-6 core NREN SURFnet-6 core The Amsterdam Internet Exchange ams-ix The Amsterdam Internet Exchange ams-ix The optical internet exchange Netherlight The optical internet exchange Netherlight Ramping up the LCG tier-1

7. HEPix April 2006 Wim Heubers / NIKHEF Netherlands LHC/Tier-1 Commitment share of total Tier-1 needs: Commitment share of total Tier-1 needs: LHCb: 23% LHCb: 23% ATLAS: 11,5% ATLAS: 11,5% ALICE: 5,75% ALICE: 5,75% Planned resources: Planned resources: Ramping up the LCG tier-1 20062007200820092010CPU’s2001000300050008000 Disk PB 0.21.12.53.86.1 Tape PB 0.10.71.83.55.7 reminder: update power & cooling infra

8. HEPix April 2006 Wim Heubers / NIKHEF Netherlands LHC/Tier-1 Service challenges Service challenges VOBox discussion VOBox discussion Security infrastructure Security infrastructure 3D database project 3D database project Ramping up the LCG tier-1

9. HEPix April 2006 Wim Heubers / NIKHEF Current resources: clusters LCG2 production cluster LCG2 production cluster 66 nodes, dual AMD 1.6 GHz (home made, heat!) 66 nodes, dual AMD 1.6 GHz (home made, heat!) 30 nodes, dual Xeon 2.8 GHz (Supermicro) 30 nodes, dual Xeon 2.8 GHz (Supermicro) 32 nodes, dual Xeon 3.2 GHz (Dell) 32 nodes, dual Xeon 3.2 GHz (Dell) LISA – Dell ‘national’ cluster, partly available for LCG) LISA – Dell ‘national’ cluster, partly available for LCG) 625 nodes, dual Xeon 3.4 GHz 625 nodes, dual Xeon 3.4 GHz Matrix – IBM cluster Matrix – IBM cluster 36 nodes, dual Xeon 3.0 GHz 36 nodes, dual Xeon 3.0 GHz Ramping up the LCG tier-1 In progress: purchase 100 dual Xeon nodes

10. HEPix April 2006 Wim Heubers / NIKHEF Current resources: storage Mass storage system distributed on two locations Mass storage system distributed on two locations Amsterdam and Almere (‘a booming city in the polder’) Amsterdam and Almere (‘a booming city in the polder’) Hardware: Hardware: Disk cache on 5 nodes, 2 TB/node Disk cache on 5 nodes, 2 TB/node 2 StorageTek tape robots (STK 9310, STK SL8500) 2 StorageTek tape robots (STK 9310, STK SL8500) Fibre Channel SAN Fibre Channel SAN Software: Software: SRM and dCache SRM and dCache CXFS and DMF (SGI) data migration to/from tape CXFS and DMF (SGI) data migration to/from tape LCG storage now: 40 TB (permanent) + 20 TB (volatile) LCG storage now: 40 TB (permanent) + 20 TB (volatile) Ramping up the LCG tier-1 In progress: purchase 24 TB durable storage

11. HEPix April 2006 Wim Heubers / NIKHEF Thank you