ICFA/SCIC Aug '05 SLAC Site Report 1 SLAC Site Report Les Cottrell, Gary Buhrmaster, Richard Mount, SLAC For ICFA/SCIC meeting 8/22/05

ICFA/SCIC Aug '05 SLAC Site Report 2 SLAC Funding Increasingly multi-program: –Increasing focus on photon sources SPEAR3, Linear Coherent Light Source (LCLS) and Ultra Fast Science Center –Increased funding from BES LINAC increasingly funded by BES (all in 2009) –HEP roughly stable, BaBar stops taking data 2008 –Also NASA (GLAST and Large Synoptic Space Telescope (LSST)) –Joint (Stanford / DoE / NSF) funded projects KIPAC, UltraFast center, Guest House

ICFA/SCIC Aug '05 SLAC Site Report 3 SLAC Organization Photon Science Particle & Particle Astrophysics LCLS Construction (~$379 million) Operations (COO) –Computing/networking included here Computing as utility to all SLAC

ICFA/SCIC Aug '05 SLAC Site Report 4 Requires New business practices –More project oriented since multiple projects so need more accountability –No longer dominated by HEP Harder to “hide” projects like PingER with no sources of funding for operations.

ICFA/SCIC Aug '05 SLAC Site Report 5 SLAC external network traffic SLAC is one of top users of ESNet and one of the top users of Internet2. (Fermilab doesn’t do so badly either) –Majority of our science traffic is international –Connectivity to both ESnet and CENIC (via Stanford)

ICFA/SCIC Aug '05 SLAC Site Report 6 Terabytes/Month Fermilab (US)  WestGrid (CA) SLAC (US)  INFN CNAF (IT) SLAC (US)  RAL (UK) Fermilab (US)  MIT (US) SLAC (US)  IN2P3 (FR) IN2P3 (FR)  Fermilab (US) SLAC (US)  Karlsruhe (DE) Fermilab (US)  Johns Hopkins LIGO (US)  Caltech (US) LLNL (US)  NCAR (US) Fermilab (US)  SDSC (US) Fermilab (US)  Karlsruhe (DE) LBNL (US)  U. Wisc. (US) Fermilab (US)  U. Texas, Austin (US) BNL (US)  LLNL (US) Fermilab (US)  UC Davis (US) Qwest (US)  ESnet (US) Fermilab (US)  U. Toronto (CA) BNL (US)  LLNL (US) CERN (CH)  BNL (US) NERSC (US)  LBNL (US) DOE/GTN (US)  JLab (US) U. Toronto (CA)  Fermilab (US) NERSC (US)  LBNL (US) CERN (CH)  Fermilab (US) DOE Lab-International R&E Lab-U.S. R&E (domestic) Lab-Lab (domestic) Lab-Comm. (domestic)

ICFA/SCIC Aug '05 SLAC Site Report 7 ESnet BAMAN connection SLAC participated in the BAMAN “christening” activity on June 24 th 2005 –Moved physics data from SLAC to NERSC at ~8Gb/sec SLAC and ESnet personnel are working on the “commissioning” activities for production traffic cutover –Interim will be connection using 1Gb/s links

ICFA/SCIC Aug '05 SLAC Site Report 8 SLAC 10Gb/s plans Upgrade for border and core site equipment is being ordered RSN – –Cisco 6500’s SUP720s Router functionality – Netflow, MPLS, etc. –Will connect to ESnet and CENIC (via Stanford) at 10Gb/s (when Stanford gets their 10Gb/s upgrade) Power installation has been requested, but currently does not have a completion date –We had actually planned for new power and had it partially installed, and then the electrical arc flash accident on October 2004, suspending most electrical “hot work”, and the ESnet BAMAN equipment has utilized the previously installed outlets.

ICFA/SCIC Aug '05 SLAC Site Report 9 Network Research Activities IEPM for >= 10Gbits/s hybrid networks –Forecasting for middleware/scheduling, problem detection, trouble shooting, develop/evaluate new measurement tools –Passive monitoring for high speed links –Provide network monitoring infrastructure to support critical HEP experiments Next Gen transport evaluation: –User space transport (UDT), new TCP stacks, RDMA/DDP

ICFA/SCIC Aug '05 SLAC Site Report 10 Network Research Activities Datagrid Wide area network Monitoring Infrastructure (DWMI) PingER and the Digital Divide

ICFA/SCIC Aug '05 SLAC Site Report 11 Network Research Activities High speed testbed involvement –UltraLight SLAC systems currently at Sunnyvale Level(3) –Originally UL equipment was to be located at SLAC, but connection to USN has changed plans –USN via UltraLight project. Not directly connected at this time –ESnet Science Data network (SDN) provisioned, guaranteed bandwidth circuits to support large, high-speed science data flows –SC05

ICFA/SCIC Aug '05 SLAC Site Report 12 Future production network requirements BaBar detector runs until December 2008 luminosity will continue to increase until end of run analysis will continue after 2008 GLAST - Launch in 2006 (low data rate) LCLS - First science in 2009 LSST - First science in 2012 (~0.5GB/sec)

ICFA/SCIC Aug '05 SLAC Site Report 13 Futures UltraFast center – modeling and analysis Huge memory systems for data analysis –The PetaCache project The Broader US HEP Program (aka LHC) –Contributes to the orientation of SLAC Scientific Computing R&D Continued network research activities –Network research vs. Research network activities

ICFA/SCIC Aug '05 SLAC Site Report 14 Futures Possibility of moving some/all of site computing infrastructure offsite –Power & Cooling challenges onsite We have a 1MW substation outside of building for expansion, but no cables into building. We have an 8” water cooling pipe, but we are near cooling capacity. –Building retrofit will be disruptive Computing center built for water cooled mainframes, not air cooled rack mounted equipment –If SLAC moves forward, we will require multiple lambdas from site to collocation facility