1. US ATLAS Western Tier 2 Status Report Wei Yang Nov. 30, 2007 US ATLAS Tier 2 and Tier 3 workshop at SLAC

2. VersionGHzCoresSPECint2000 SPECcfp200 0Description PeakValue cluster name SITE:PROD_SLAC Pentium(R) III CPU family 1400MHz6-11-11.40664037,392noma Dual Core AMD Opteron(tm) Processor 24415-5-81.8441,12649,54457,508don Dual Core AMD Opteron(tm) Processor 27015-33-21.91961,452284,592349,860cob Dual Core AMD Opteron(tm) Processor 27515-33-22.21121,521170,352138,400yili Xeon(TM) CPU 2.66GHz15-2-72.660911065,360tori Dual Core AMD Opteron™ Processor 221815-65-22.65561,8271,015,8120boer Intel Xeon(R) X53557-6-152.661042,178226,5120fell Summary: Totals1,012 1,746,812648,520 Normalization 1,726641 ATLAS has ~ 32% fair share

3. CPU resource  Current (FY07 fund)  312 cores of AMD Opteron 2218  2 GB / core  Procurement with FY08 program fund  320 cores of Intel Xeon X5355 (40 units)  2 GB / core  38% program fund

4. Storage  Current  72 TB raw / 51 TB usable (3 thumpers)  FY08 Procurement  58% program funds  Thumpers. > 200 TB usable based on old price  Negotiating Price  Xrootd on Solaris / ZFS  GridFTP for Xrootd  Composite Name Space and XrootdFS  Run SRM on XrootdFS

5. Procurement for other Experiments  224 cores of AMD Opteron 2218  104 cores of Intel Xeon X5355  2 GB / core  In general queues, accessible by ATLAS  SUN Black box # 2  Intel Xeon X5335  CPU nodes ordered from DELL

6. Software infrastructure  RHEL 3 32 bit on old batch nodes  RHEL 4 64 bit on newer batch nodes  LSF 6.1 with Fair Share  How to implement analysis queue in fair share environment ?  Nagios  Ganglia

7. Grid Middleware and DDM  OSG 0.8  Gatekeeper Need customization of Globus LSF module  GridFTP and GridFTP for Xrootd  GUMS 1.2 one-to-one mapping for DNs and local accounts  RSV and Gratia Has to hack into Gratia code to make it reporting correctly  DQ2 0.4, will upgrade to 0.4.1

8. Networking  Tuning significantly improved the iperf performance measurement  Increase TCP buffers  Enable hardware functions for transmission  Can not achieve stable measurement, probably due to competing traffic  WAN is still 1 GB / 2GB  10 GB upgrade plan pushed back to January  Plan to evaluate TeraPath and QoS

9. Networking, cont’d  Disk-2-disk  2~3MB/sec with 1 stream  15 MB/sec with 12 streams  300 MB / sec goal  SRM on XrootdFS + multiple GridFTP for Xrootd  One GridFTP with multiple NIC channel binding

10. ATLAS production SLAC  Production runs smoothly  Gatekeeper can handle 500-600 jobs easily  Utilization is low  Regional physicists utilizing WT2 spare cycles  Much less (useless) debugging at Tier 2 level after moving to PandaMover

11. September is both a good month and a bad month for WT2