1. US ATLAS Tier 1 Facility Rich Baker Brookhaven National Laboratory DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National Laboratory NOVEMBER 14-17, 2000

2. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 2 Tier 1 Facility Requirements (1)  Based on NCB Review Numbers  Focus on Analysis (200k of 209k SI95)  Probably Insufficient for Simulation  CPU: 209,000 SpecInt95  Commodity Pentium/Linux  Estimated 640 Dual Processor Nodes  Online Storage: 365 TB Disk  High Performance Storage Area Network  Baseline: Fibre Channel Raid Array

3. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 3 Tier 1 Facility Requirements (2)  Tertiary Storage: 2 PB Tape Library  Baseline: HPSS, STK Media & Tape Drives  75% Event Summary Data  25% Simulation, Analysis Objects, Local Data  “Raw” I/O Rate: 400 MB/second, 12.5 PB/year  Exploit Use Patterns to Maximize Efficiency  Random Access to AOD - Always on Disk  Managed Access to ESD - Grid SW? Custom SW?

4. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 4 Estimation Methods - Hardware (1)  Use Recent RCF Purchases as Cost Baseline  Moore’s Law Scaling for Commodity Components (CPU, Disk, Tape)  STK Tape Drives: Constant Cost per Drive, Double I/O Capacity Every 2 Years  Similar Constant Cost Projections for High Performance Data Mover Nodes  $40K per HPSS Mover Node  $30K per SAN Control Node

5. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 5 Estimation Methods - Hardware (2)  Local Area Network: 8% of Disk+CPU Cost plus $20K per HPSS Mover  Firewall/WAN Hardware: 25% of LAN Cost  Interactive Nodes  2 Linux Nodes Purchased per Year  Maintain One Sun/Solaris Node  “General Purpose” Nodes  21 Currently for RCF - Estimate 25 for ATLAS

6. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 6 Estimation Methods - Software  Share Site License Costs with RCF  HPSS: 50% of $200K by 2005  LSF: 50% of $65K Starting 2002  Veritas: $5K per SAN Control Node  Or Other SW Choice  Most Other SW License Costs Can Only be Estimated - Total $97K in 2005  Good Estimate Based on Actual RCF Costs to Support Operational Facility & Development

7. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 7 Existing Facility

8. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 8

9. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 9 Timeline Overview  Prototype – FY ‘01 & FY ‘02  Initial Development & Test, 1% to 2% scale  Establish Facility Independent from RCF  Lessons Learned from RCF Experience  System Tests – FY ‘03 & FY ‘04  Large Scale System Tests, 5% to 10% scale  Support Growing Tier 2 Network  Operation – FY ‘05, FY ‘06 & beyond  Full Scale System Operation, 20% (‘05) to 100% (‘06)

10. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 10 Tier 1 Facility Capacity

11. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 11 Tier 1 Facility Staffing

12. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 12 Tier 1 Budget By Year (FY’01 k$) Includes Tier 1 Staff Under WBS 2.3.2

13. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 13 Tier 1 Budget (FY’01 k$)

14. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 14 Tier 1 Material Costs (FY’01 k$)  HPSS License Included in HPSS  Volume Manager Software Included in Disk  “Other” Includes Power, Special Purpose Nodes, Video Conferencing, Supplies

15. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 15 Tier 1 Materials Summary (FY’01 k$)

16. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 16 Tier 1 Facility Beyond 2006 (FY’01 k$)  Staffing: Constant at 25.5 FTE  Major HW Components  Constant $ at 33% of 2006 Full Facility Cost  Allows for Continual Upgrade  All Other Costs Level at 2005/2006 Levels

17. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 17 Comments  Scaleable Design - Recent 2.5X Expansion  Very Late Bulk Procurement  Working System Earlier - Minimize Design Risk  Maximize Moore’s Law Advantage  Retain Flexibility as Long as Possible  Leverage RCF Knowledge  Lessons Learned  Improved Estimation

18. November 14-17, 2000 Rich Baker US ATLAS Tier 1 Facility 18 Summary  Facility Already Running  Near Term Prototype Planning in Progress  Budget Exceeds Agency Guideline by 33%  Despite Recent 2.5X Scale Expansion!  Estimates Are Realistic  Detailed Cost Basis From Recent Purchases  Moore’s Law Uncertainty  Build to Cost Contingency Feasible  As Long as Tier 2 Facilities Are Funded