Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done.

Slides:



Advertisements
Similar presentations
Operations Coordination Team Maria Girone, CERN IT-ES Kick-off meeting 24 th September 2012.
Advertisements

Data & Storage Management TEGs Summary of recommendations Wahid Bhimji, Brian Bockelman, Daniele Bonacorsi, Dirk Duellmann GDB, CERN 18 th April 2012.
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
New VOMS servers campaign GDB, 8 th Oct 2014 Maarten Litmaath IT/SDC.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Ian Bird, James Casey, Oliver Keeble, Markus Schulz & thanks to Pere Mato CERN Grid Middleware for WLCG Where are we now – and where do we go from here?
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
Marian Babik, Luca Magnoni SAM Test Framework. Outline  SAM Test Framework  Update on Job Submission Timeouts  Impact of Condor and direct CREAM tests.
Workshop Summary (my impressions at least) Dirk Duellmann, CERN IT LCG Database Deployment & Persistency Workshop.
Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.
Key Project Drivers - an Update Ruth Pordes, June 14th 2008, V2: June 23 rd. These slides are in addition to the information available in
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
WLCG operations A. Sciabà, M. Alandes, J. Flix, A. Forti WLCG collaboration workshop July , Barcelona.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.
1 User Analysis Workgroup Discussion  Understand and document analysis models  Best in a way that allows to compare them easily.
Summary of TEG outcomes First cut of a prioritisation/categorisation Ian Bird, CERN WLCG Workshop, New York May 20 th 2012.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
LCG Introduction John Gordon, STFC GDB June 8 th 2011.
Evolution of storage and data management Ian Bird GDB: 12 th May 2010.
Site Manageability & Monitoring Issues for LCG Ian Bird IT Department, CERN LCG MB 24 th October 2006.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon Kick-off meeting, 24 th October 2011.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
Workload management, virtualisation, clouds & multicore Andrew Lahiff.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
December GDB Brief summary – J Coles. Meetings January meeting moved to 15 th 2014 events created. Check March meeting outside CERN. Copenhagen workshop.
Data management demonstrators Ian Bird; WLCG MB 18 th January 2011.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.
Sep 17, 20081/16 VO Services Project – Stakeholders’ Meeting Gabriele Garzoglio VO Services Project Stakeholders’ Meeting Sep 17, 2008 Gabriele Garzoglio.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
WLCG Technical Evolution Group: Operations and Tools Maria Girone & Jeff Templon GDB 12 th October 2011, CERN.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
LHCC Referees Meeting – 28 June LCG-2 Data Management Planning Ian Bird LHCC Referees Meeting 28 th June 2004.
Wahid Bhimji (Some slides are stolen from Markus Schulz’s presentation to WLCG MB on 19 June Apologies to those who have seen some of this before)
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons Maarten Litmaath On behalf of the WG participants GDB 09/09/2015.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
Evolution of WLCG infrastructure Ian Bird, CERN Overview Board CERN, 30 th September 2011 Accelerating Science and Innovation Accelerating Science and.
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
The HEPiX IPv6 Working Group David Kelsey HEPiX, Prague 26 April 2012.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
Acronyms GAS - Grid Acronym Soup, LCG - LHC Computing Project EGEE - Enabling Grids for E-sciencE.
Report TEG WLCG Data and Storage Management Giacinto DONVITO INFN-IGI 14/05/12Workshop INFN CCR - GARR
WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Site notifications with SAM and Dashboards Marian Babik SDC/MI Team IT/SDC/MI 12 th June 2013 GDB.
LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
LCG Introduction John Gordon, STFC GDB December 7 th 2010.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
Evolution of storage and data management
WLCG IPv6 deployment strategy
LCG Service Challenge: Planning and Milestones
Sviluppi in ambito WLCG Highlights
Database Readiness Workshop Intro & Goals
How to enable computing
Update on Plan for KISTI-GSDC
Final summary Ian Bird Amsterdam, DAaM 18th June 2010.
Summary from last MB “The MB agreed that a detailed deployment plan and a realistic time scale are required for deploying glexec with setuid mode at WLCG.
Workshop Summary Dirk Duellmann.
WLCG and support for IPv6-only CPU
WLCG Collaboration Workshop;
LHC Data Analysis using a worldwide computing grid
Presentation transcript:

Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done (e.g. Data management) – But the strategy needs to be documented The work must include consideration/models for long term support and sustainability Some general comments

Distributed data management and tools – Follow on from work on Amsterdam demonstrators etc – Data placement, caching – FTS re-write/replace – “xrootd” – Transfer protocols – Data access security needs/access control – Continued use of POOL? (only ATLAS?, how long?) – Interaction between DM tools and ROOT, Proof? Data Management

More to address site related services – Separation of archives and disk pools/caches – Future storage system needs: e.g. how should dcache, DPM, EOS, etc. evolve? – What are the storage system interfaces? SRM, S3,… – Filesystems / protocols: NFS4.x, S3, … – Security/access controls – These are site-run services: management interfaces? Monitoring? … Storage Management

Encompasses a broad range of topics – Pilots and pilot frameworks – What is needed from a CE now? – Is a generic WMS required by WLCG? – Use cases for clouds – Use of virtualisation – experiment expectations for using CERNVM, arbitrary images? (re- Hepix work) Site expectations for use of virtualisation in managing sites – Security model (MUPJs, etc.) – Whole node scheduling – How to ask for/use GPUs (is it required) – Information services – what is needed, what tools? Workload management

Scope should be use of “grid” database services – Not use of a db within an arbitrary application – LFC? What is still required? Deployment model – Frontier, squids, etc, vs 3D/streams, Goldengate, DataGuard, etc – What long term support is needed for Coral, COOL? – Work started in database workshop in June Databases

Should review risk analysis – what are the real threats now? Where should we focus Is the trust model still appropriate? – E.g. can we siplify the “glexec” issue? X509/VOMS/IGTF have been essential in having a world-wide use of resources – But there are problems associated with proxies Can/should other federated ID management systems be integrated? Security model

Need to document all the other pieces that we need supported – Monitoring (SAM, Nagios, etc.); better monitoring needs? Ability to analyse monitoring data? – Support tools (APEL, GGUS, etc.) – Underlying services (ActiveMQ, etc.) – Operational requirements on middleware – Application software management (e.g. cernvmfs) – Software management of middleware – Deployment management – Configuration management Operations tools and services

Form groups asap – aim to have them start early September First documents should be produced by end of 2011 Schedule

ATLAS, CMS agree with direction and will propose names LHCb, ALICE: ? OSG: sent letter of endorsement and names EGI, EMI ? Apps area-Pere Mato: several useful comments: – Discussion on next generation of software frameworks – this needs to be taken into account CNAF: propose chair for WLM wg UK: names for various wg’s Responses received

Encourage nominations for chairs of the groups urgently – I will propose names for missing areas Ask them to select experts for the groups, and to set agendas for the discussions Timescales: – End Aug: chairs and members selected – Mid-Sep: WG’s started – Oct, Nov (GDB?): progress reports of WG’s – End 2011: first documents Next steps