1. OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program October 31, 2008 Chander Sehgal OSG Project Manager

2. October 31, 2008 2 OSG Today  29 VOs  ~75 sites (19 SE & 82 CE)  ~400,000 wall clock hours per day (peaks over 500,000)  25-30% opportunistic use  ~15% is non- physics  >15,000 cores used per day  >43,000 cores accessible OSG has enabled US-CMS and US-ATLAS to be ready for LHC startup

3. October 31, 2008 33 OSG Platform for the US-LHC Collaborations Software/Middleware a)Support the movement, storage and management of the petabyte LHC data sets. b)Support of job workflow, scheduling and execution at the Tier-1, Tier-2 and Tier-3 sites, that supports transparent access across the European and US grids We are still grappling with how to evolve the software without perturbing production Services a)Information, accounting and monitoring Services publishing to the WLCG b)Reliability and Availability monitoring used by the experiments to determine the availability of sites and the WLCG to match to the MOU. Support a)Security monitoring, incident response, notification and mitigation b)Operational support including centralized Ticket Handling, with automated bi-directional communication between the systems in Europe and the USA c)Collaboration with ESNET and Internet2 network projects for the integration and monitoring of the underlying network fabric. d)Site Coordination and common support for Tier 3 sites (>8 now on OSG) e)End-to-end support for simulation, production, analysis and focused data challenges; enabling USLHC readiness for real data taking. It is a challenge to measure effectiveness and/or improvement in support OSG platform has been successfully exercised via the various data challenges as we prepare for the LHC startup

4. October 31, 2008 44 Recent OSG Steps for LHC startup  OSG Release 1.0 – a stable production grade software release (June 2008)  Improvements to RSV for reporting site availability  Improvements to Gratia for accounting data to WLCG  Improvements to GIP to enable better matchmaking  New tools needed by ATLAS and CMS, specifically lcg-utils (for data management) and LFC (for data replication tracking)  OSG Production Focus in OSG re-org  Increased management attention to near-term production issues  Increased effort at gathering and understanding metrics  Direct input from US-CMS, US-ATLAS, LIGO in OSG meetings  Staff re-alignment to increase operational focus at GOC  Initiatives to address near-term stakeholder needs  BDII upgrade and stress testing for CMS (to meet 3X current)  Increased support for BeStMan & XRootD for USLHC Tier-2/Tier-3

5. October 31, 2008 55 OSG Reporting to WLCG on behalf of US-LHC (Example) US LHC Tier2 Activity for September 2008 Long path to success, and there remains fragility in end-to-end process

6. October 31, 2008 66 US-ATLAS Production on OSG Are these useful?

7. October 31, 2008 77 US-CMS Production on OSG Are these useful?

8. October 31, 2008 88 OSG and US-LHC Next Steps  OSG year3 work program adds focus  to understanding production volumes, use efficiencies, and issues identified in on-going simulations and data challenges  to improve ease of use and diagnostic capabilities associated with data storage and management  to increase capability for integration and development of software tools  to provide dedicated support for “at large” VOs  to adapt policy and support models to varying site types and sizes (e.g. US-LHC Tier3, non-Physics resources, etc.)  Leverage “embedded” partnership model to understand and respond to the needs of US-CMS and US-ATLAS

9. October 31, 2008 9 Backup Slides

10. October 31, 2008 10 US-LHC Benefits from OSG Common to US-ATLAS and US-CMS 1.Serves as integration and delivery point for core middleware components including compute and storage elements (VDT) 2.Cyber Security operations support within OSG and across Grids (e.g. WLCG) in case of security incidents 3.Cyber Security infrastructure including site-level authorization service, operational service for updating certificates and revocation lists 4.Service availability monitoring of critical site infrastructure services, i.e. Computing and Storage Elements (RSV) 5.Service availability monitoring and forwarding of results to WLCG 6.Site level accounting services and forwarding accumulated results to WLCG 7.Consolidation of Grid client utilities incl. incorporation of LCG client suite, resolving Globus library inconsistencies 8.dCache packaging through VDT and support through OSG-Storage 9.Integration testbed for new releases of the OSG software, pre-production deployment testing 10.Continuous support of the distributed Computing Facility and production services through the weekly OSG facility phone meetings

11. October 31, 2008 11 US-LHC Benefits from OSG (continued) Specific to US-ATLAS 1.LCG File Catalog (LFC) server and client packaging – needed in support of the ATLAS global Distributed Data Management system (DDM) 2.Bestman and xrootd: SRM and file system support for Tier 2 and Tier 3 facilities 3.Support for integration and extension of security services in the PanDA workload management system and the GUMS grid identity mapping service, for compliance with OSG security policies and requirements Specific to US-CMS 1.Bestman: SRM support for Tier 3 facilities 2.lcg-utils tools for data management 3.Scalability testing of OSG services, incl. BDII, CE, SE, and work with developers to improve the underlying middleware.

12. October 31, 2008 12 Executive Director, Ruth Pordes Technical Director, Miron Livny, Project Manager Chander Sehgal, Production Coordinator: TBD Resources Manager: Bill Kramer Extensions /Applications Torre Wenaus, Frank Würthwein Joint Oversight Team DOE & NSF OSG Council Chairs: Paul Avery, Kent Blackburn, Extensions Effort Staff & iSGTW Security Officer: Mine Altunay; Deputy: Doug OlsonIntegration & Site Coordination: Rob GardnerOperations: Rob QuickVOs : Abhishek Rana, Britta DaudertEducation, Training: Alina Bejan Executive Team E4CI CI-Team Project Engagement: John McGee; Campus Grids: Sebastien Goasguen User Communities: VOs, Site Administrators Software + VDT : Alain Roy, (Storage: Tanya Levshina) OSG Facility Software Tools Alain Roy, Mine Altunay OSG PI: Miron Livny OSG Co-PIs: Paul Avery, Kent Blackburn, Ruth Pordes Major Account Managers to US ATLAS, US CMS, LIGO Sept 2008