OSG Council Meeting, August 2nd 2011 1 Executive Director Report to the OSG Council Executive Director Report to the OSG Council August 2 nd 2011, Ruth.

Slides:



Advertisements
Similar presentations
Dec 14, 20061/10 VO Services Project – Status Report Gabriele Garzoglio VO Services Project WBS Dec 14, 2006 OSG Executive Board Meeting Gabriele Garzoglio.
Advertisements

Contributors & Users Science Communities Campuses Universities & Laboratories Service & Software Providers Scientists, Researchers, Educators, Students.
 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 05/15/2013.
May 9, 2008 Reorganization of the OSG Project The existing project organization chart was put in place at the beginning of It has worked very well.
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
Open Science Grid Frank Würthwein UCSD. 2/13/2006 GGF 2 “Airplane view” of the OSG  High Throughput Computing — Opportunistic scavenging on cheap hardware.
Assessment of Core Services provided to USLHC by OSG.
1 Open Science Grid in Adolescence: Ruth Pordes Fermilab.
OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.
OSG Area Coordinators Meeting Cross-ProjectArea Report Ruth Pordes 2/8/2011.
Executive Director Report Ruth Pordes OSG Council Meeting, August 5 th 2008.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
Key Project Drivers - FY11 Ruth Pordes, June 15th 2010.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
ED Report Council Meeting ED Report Council Meeting March 11 th 2010 Ruth Pordes OSG Executive Director.
OSG Area Coordinators Meeting Operations Rob Quick 2/22/2012.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 12/21/2011.
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
May 8, 20071/15 VO Services Project – Status Report Gabriele Garzoglio VO Services Project – Status Report Overview and Plans May 8, 2007 Computing Division,
OSG Project Manager Report for OSG Council Meeting August 5, 2008 Chander Sehgal.
OSG – the next few years Vicky White, Fermilab OSG Council Meeting March 15, 2013.
OSG Area Coordinators Meeting Proposal Chander Sehgal Fermilab
OSG Council, Aug 22 nd -23 rd 2012 Ruth Pordes, Council Chair.
Discussion Topics DOE Program Managers and OSG Executive Team 2 nd June 2011 Associate Executive Director Currently planning for FY12 XD XSEDE Starting.
Report on the state of OSG Software Alain Roy. OSG Year 6 Planning, July 2011 Points to discuss 1.State of RPM transition 2.State of last scheduled Pacman.
OSG Software and Operations Plans Rob Quick OSG Operations Coordinator Alain Roy OSG Software Coordinator.
OSG Project Manager Report for OSG Council Meeting OSG Project Manager Report for OSG Council Meeting October 14, 2008 Chander Sehgal.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
Production Coordination Staff Retreat July 21, 2010 Dan Fraser – Production Coordinator.
OSG Executive Director Report OSG Council Meeting OSG Executive Director Report OSG Council Meeting May 19 th 2011 Ruth Pordes.
Data Intensive Science Network (DISUN). DISUN Started in May sites: Caltech University of California at San Diego University of Florida University.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.
OSG Production Report OSG Area Coordinator’s Meeting Aug 12, 2010 Dan Fraser.
Partnerships & Interoperability - SciDAC Centers, Campus Grids, TeraGrid, EGEE, NorduGrid,DISUN Ruth Pordes Fermilab Open Science Grid Joint Oversight.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 11/02/2011.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
OSG PKI Transition: Transition Phase Report Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center Open Science Grid (OSG) Introduction for the Ohio Supercomputer Center February.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
9 Oct Overview Resource & Project Management Current Initiatives  Generate SOWs  8 written and 6 remain;  drafts will be complete next week 
Open Science Grid & its Security Technical Group ESCC22 Jul 2004 Bob Cowles
Production Coordination Area VO Meeting Feb 11, 2009 Dan Fraser – Production Coordinator.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
April 26, Executive Director Report Executive Board 4/26/07 Things under control Things out of control.
OSG Area Coordinators Meeting Operations Rob Quick 1/11/2012.
Production Oct 31, 2012 Dan Fraser. Current Production Focus Transition to RPMs 52(44) sites using RPM based installs 52(44) sites using RPM based installs.
OSG Area Report Production – Operations – Campus Grids Jan 11, 2011 Dan Fraser.
CMS Usage of the Open Science Grid and the US Tier-2 Centers Ajit Mohapatra, University of Wisconsin, Madison (On Behalf of CMS Offline and Computing Projects)
Open Science Grid as XSEDE Service Provider Open Science Grid as XSEDE Service Provider December 4, 2011 Chander Sehgal OSG User Support.
OSG Deployment Preparations Status Dane Skow OSG Council Meeting May 3, 2005 Madison, WI.
Open Science Grid in the U.S. Vicky White, Fermilab U.S. GDB Representative.
OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider Program OSG Report for DOE/NSF Joint Oversight Group U.S. Large Hadron Collider.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 02/13/2012.
April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.
Identity Management in Open Science Grid Identity Management in Open Science Grid Challenges, Needs, and Future Directions Mine Altunay, James Basney,
1 Open Science Grid.. An introduction Ruth Pordes Fermilab.
Towards deploying a production interoperable Grid Infrastructure in the U.S. Vicky White U.S. Representative to GDB.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 8/15/2012.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
Ruth Pordes, March 2010 OSG Update – GDB Mar 17 th 2010 Operations Services 1 Ramping up for resumption of data taking. Watching every ticket carefully.
Campus Grids Working Meeting Report Rob Gardner University of Chicago OSG All Hands March 10, 2010.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
What is OSG? (What does it have to do with Atlas T3s?) What is OSG? (What does it have to do with Atlas T3s?) Dan Fraser OSG Production Coordinator OSG.
OSG PKI Transition: Status and Next Steps (and Lessons Learned) Von Welch OSG PKI Transition Lead Indiana University Center for Applied Cybersecurity Research.
Open Science Grid Progress and Status
Presentation transcript:

OSG Council Meeting, August 2nd Executive Director Report to the OSG Council Executive Director Report to the OSG Council August 2 nd 2011, Ruth Pordes Status, FY12 planning

OSG Council Meeting, August 2nd Million CPU-hours/day; 1/ Million Jobs/day ¼ Petabyte over the WAN/day from >90sites 18 VOs 260 peer reviewed publications /year OSG Production Infrastructure

OSG Council Meeting, August 2nd

SBGrid 4

OSG Council Meeting, August 2nd 2011 DOSAR 5

OSG Council Meeting, August 2nd

2 representative (different from HCC) campus Vos – Glow, GridUNESP 7 Glow GridUNES P

OSG Council Meeting, August 2nd 2011 Proposals: InDHTC proposal to DOE ASCR SciDAC-3 Institute program has been rejected. OSG proposal for 33.3 FTE has been submitted jointly to DOE OHEP and NSF. CDIGS-2 1 year extension proposal for $200K submitted to NSF. 8

OSG Council Meeting, August 2nd 2011 Response from ASCR: 9

OSG Council Meeting, August 2nd 2011 Effort breakdown in OSG Proposal 10

OSG Council Meeting, August 2nd 2011 CDIGS Extension 11

OSG Council Meeting, August 2nd 2011 FY12 Planning Energetic Staff retreat last week in Madison. Preparation by project manager, Chander, and attendance by all FY12 area coordinators + members & delegees of ET. Planning is for 6 months of FY12 at FTEs. Some staff reduction from FY11 – Doug Olson, Robert Engel, transition at NCSA, Uwisc Madison. No new staff due to uncertainty in the funding. 12

OSG Council Meeting, August 2nd 2011 Reminder of the scope 13

OSG Council Meeting, August 2nd 2011 Future Challenges to Address (i)The heterogeneity of the resource environment of OSG makes it difficult for smaller communities to operate successfully at a significant scale. EASY EFFECTIVE THROUGHPUT (i)The complexity of the grid certificate-based authorization infrastructure presents a non-negligible barrier of entry for smaller communities. URGENCY IN ABILITY TO START (i)While the LHC communities are moving petabytes worldwide, smaller communities find it exceedingly difficult to manage terabytes. Over the last 5 years we have seen this gap in capability grow rather than shrink. ALL ASPECTS OF DATA HANDLING – MANAGEMENT, MOVEMENT, STORAGE 14

OSG Council Meeting, August 2nd 2011 Things I am looking for: Sustain/nurture the WLCG Sustain/nurture our significant communities and partners. Action on the Campuses Action on the s/w – keep up, get back “into the lead” Requirements that “I can click on and understand” Assessment that “I can click on and understand” Appropriate peering with XSEDE Items I will talk about today Allocations – first thoughts ID management – we are working with ESNET, Jim Basney (CILOGON) back as part of OSG. Software – full steam ahead to move fully to RPM packaged releases 15

OSG Council Meeting, August 2nd 2011 Policies for Use of Opportunistic Resources 16

OSG Council Meeting, August 2nd 2011 Discussion of how to implement allocations 17

OSG Council Meeting, August 2nd

OSG Council Meeting, August 2nd

OSG Council Meeting, August 2nd 2011 ID Management 20

OSG Council Meeting, August 2nd 2011 ID Management From proposal: "We are the major customer for the ESNet DOE Grids Certificate Authority. We are working together with ESNet and the NCSA CILogon project to chart a course for effective identity management across our constituencies and possibly the broader DOE science community.” Status: Series of meeting towards paper defining the problem. Initial tests with Clemson Shib IDP and CILOGON successful earlier this year. Next steps in testing integration of CILOGON with OSG services starting now. 21

OSG Council Meeting, August 2nd 2011 Software 22

OSG Council Meeting, August 2nd 2011 Focus on Software short term As you know there is a major push to transition from Pacman based s/w releases to fully RPM based. Some parts of the release already done via RPMS: LIGO, most of the Storage Software, SE. GT Gram2 will not be supported in the RPM release. GT5 and Cream will be supported in the RPM release. Activity to understand Bestman support past March 2012 is ongoing. 23

OSG Council Meeting, August 2nd 2011 Software – Moving to RPM based distribution 24

OSG Council Meeting, August 2nd

Staffing NamePercentDuties John Hover25%Integration/Packaging Xin Zhao25%Integration/Packaging Doug Strain50%Software Neha Sharma50%Software Igor Sfiligoi50%Software/Evaluations Alain Roy100%Management/Requirements 50/50 Matyas Selmeci100%Software Scot Kronenfeld25%Software Tim Cartwright50%Software UW TBD100%Software Suchandra Thapa100%Integration UCSD50%Evaluations, Haifeng Pi, Sanjay Padhi, Terrence Martin Dan Fraser18.5%Management/Coaching 26 All staff have responsibility for documentation, training and support. Additional – timely and flexible - contributed effort from (ITB) site administrators at US CMS, US ATLAS, Caltech, Fermilab, key. Additional contributions from VOs – ATLAS, CMS, DOSAR, SBGrid etc – very important. Documentation, understanding, deployment, training - all important items on the docket. Name Perce nt End Date Duties Alex Sim33% Mar 2012 Bestman support til Mar 2012 Brian Bockelman 50%Oct 2011Injected effort to help with RPM releases Derek Weitzel75%Sept 2011Injected effort to help with RPM releases Robert Engel50%Oct 2011Documentation oversight/coordination

OSG Council Meeting, August 2nd

OSG Council Meeting, August 2nd 2011 Make sure we are communicating with – trying to make sure all represented at the upcoming (User and Site) Summer Workshop (no particular order) RENCI √ SBGRID GRIDUNESP √ GRID COLOMBIA √ CONNECTICUT/Glue-X ALICE NYSGRID SURAGRID VT √ NERSC ATLAS TIER-3s CMS TIER-3s √ LIGO OSG SITES KISTI √ ORNL UJ As well as Non-OSG users of VDT – APAC.. 28