Presentation is loading. Please wait.

Presentation is loading. Please wait.

TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost TRIUMF SITE REPORT Corrie Kost Head Scientific Computing.

Similar presentations


Presentation on theme: "TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost TRIUMF SITE REPORT Corrie Kost Head Scientific Computing."— Presentation transcript:

1 TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost TRIUMF SITE REPORT Corrie Kost Head Scientific Computing

2 TRIUMF MANPOWER Public Computing Services2.0 FTE Network Infrastructure1.5 FTE Software Support & Security3.0 FTE PC Support Group2.0 FTE Data Acquisition Systems2.5 FTE Private CPU farms and Westgrid0.5 FTE Conferencing facilities0.3 FTE TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

3 WestGrid – UBC/TRIUMF Site 504 dual 3.06 GHz Xeon blades Red Hat Linux 7.3 compute nodes PBS Scheduling with Maui 10 TB disk storage 24 TB tape storage Direct Gigabit connection between sites sites Possible 10GB in future Subatomic physics allocation: ~1/3 of compute resources TWIST will be a Beta user this month. TRIUMF/UBC first HEP site to install large (1008 CPU) blade cluster? TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

4 WestGrid – UBC/TRIUMF Site (www.westgrid.ca) Like the summer rains – two weeks away since August! Blade power consumption exceeded expectations –Use 12 of 14 –Replace hot swap power supplies GPFS has some teething problems Reduced cabling welcome – wireless would be better! Very little infant mortality (no blades failed!) TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

5 14 dual-cpu blades in 7U Chassis Side view of a blade TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

6 Rear View of Blades Chassis TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

7 WestGrid –UBC/TRIUMF Site Storage 1 Rack Blades 6 Racks UPS Batteries Inverters Switch Gear

8 SATA IDE Drives system from HardData 64 bit 1.6GHz Opterons approx. equal to 32 bit 2.8GHz P4 (Xeons) Performance detailsPerformance details: Konstantin Olchanski (olchansk@triumf.ca) First look at Dual 1.6GHz Opterons TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

9 Misc. Developments 1 TB Raid 5 disks attached to Linux (TRSHARE) for Linux & Windows users (via Samba) Mosix & PBS Clustering – Steve McDonald 11:30 Wed Bandwidth Management – Steve McDonald – 11:40 Wed Colubris Radius Server – Steve McDonald – 11:50 Wed SPAM fighting at TRIUMF – Andrew Daviel – 13:50 Tue Document Management System: Docushare Windows 2003 Terminal Service (TNT2K3) TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost

10 Misc. Developments TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost Videoconferencing –One older room with limited capability –A new room with Westgrid funded equipment –Several protocols supported: ISDN, H323, VRVS, AccessGrid –Participation in the Westgrid Collaborative/Visualization effort to improve videoconferencing quality and tools

11 First Transatlantic Native 10 Gigabit Ethernet Connection Catalin Meirosu CERN and “Politehnica” University of Bucuresti On behalf of the International GRID Testbed International Testbed

12 The First Transatlantic 10 GE WAN PHY over an OC-192c circuit using lightpaths provided by SURFnet and CANARIE Cisco ONS 15454 Force10 E 600 Force10 E 600 HP Itanium-2 HP Itanium-2 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Ixia 400T Intel Itanium-2 Intel Xeon Ixia 400T 10GE WAN PHY 10GE LAN PHY OC192c OttawaTorontoChicagoAmsterdam Geneva 9.24 Gbps using traffic generators 5.5 Gbps using TCP on PCs 6 Gbps using UDP on PCs ITU Telecom World 200312 International Testbed

13 The First Transatlantic 10 GE Cisco ONS 15454 Force10 E 600 Force10 E 600 HP Itanium-2 HP Itanium-2 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Ixia 400T Intel Itanium-2 Intel Xeon Ixia 400T 10GE WAN PHY 10GE LAN PHY OC192c OttawaTorontoChicagoAmsterdam Geneva ITU Telecom World 200313 International Testbed ESTA, IST-2001-33182


Download ppt "TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost TRIUMF SITE REPORT Corrie Kost Head Scientific Computing."

Similar presentations


Ads by Google