gLite->EMI2/UMD2 transition

Slides:



Advertisements
Similar presentations
ALICE G RID SERVICES IP V 6 READINESS
Advertisements

The Middleware Readiness Working Group LHCb Computing Workshop LHCb Computing Workshop Maria Dimou IT/SDC 2014/05/22.
The GridPP Wiki The case in favour of it Generic, standard information (e.g. GridPP Approved VOs) Common use cases.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Unified Middleware Distribution (UMD): SW provisioning to EGI Mario David.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
EMI is partially funded by the European Commission under Grant Agreement RI Post EMI Plans and MeDIA Alberto DI MEGLIO, CERN Project Director WLCG.
Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Deployment and Support in EGEE.
UK middleware deployment GridPP27 - CERN 15 th September 2011 GridPP27 - CERN 15 th September 2011 Status & plans Jeremy Coles.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.
Storage Accounting John Gordon, STFC GDB March 2013.
WLCG Middleware Support II Markus Schulz CERN-IT-GT May 2011.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES GGUS Ticket review T1 Service Coordination Meeting 2010/10/28.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
EMI INFSO-RI SA1 Session Report Francesco Giacomini (INFN) EMI Kick-off Meeting CERN, May 2010.
WLCG Service Report ~~~ WLCG Management Board, 7 th September 2010 Updated 8 th September
WLCG Software Lifecycle First ideas for a post EMI approach 0.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
EMI INFSO-RI European Middleware Initiative (EMI) Alberto Di Meglio (CERN)
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
SL5 Site Status GDB, September 2009 John Gordon. LCG SL5 Site Status ASGC T1 - will be finished before mid September. Actually the OS migration process.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementing product teams Oliver Keeble.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons Maarten Litmaath On behalf of the WG participants GDB 09/09/2015.
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
STFC in INDIGO DataCloud WP3 INDIGO DataCloud Kickoff Meeting Bologna April 2015 Ian Collier
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
Ian Bird LCG Project Leader Summary of EGI workshop.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
EGEE-II INFSO-RI Enabling Grids for E-sciencE SA3 Report Markus Schulz For EGEE-II SA3 IT Department, CERN Final EU.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI IPv6 Report for HEPiX CERN October 5, 2012 CERN 1
SLAs with Software Provider. Scope “…declare the rights and responsibilities between EGI.eu and the Software Provider for a particular component.” Which.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Middleware Update GDB, 9 th February 2011 Slides by Maria Alandes.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Middleware updates Peter Solagna – EGI.eu OMB – 16/07/ /3/
Status of the SL5 migration ALICE TF Meeting
WLCG IPv6 deployment strategy
DPM at ATLAS sites and testbeds in Italy
OpenSSL and Java 7 vs. 512-bit proxy keys
Communication, Communication, Communication
EMI and GISELA Collaboration
EGI Operations Management Board
LCG Service Challenge: Planning and Milestones
Virtualization and Clouds ATLAS position
SA3’s Responds to the Review Report
Andrea Manzi, Oliver Keeble
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
dCache – protocol developments and plans
Update on Plan for KISTI-GSDC
John Gordon, STFC-RAL GDB April 8th 2009
Update from the HEPiX IPv6 WG
EGI UMD Storage Software Repository (Mostly former EMI Software)
EMI: dal Produttore al Consumatore
Monitoring of the infrastructure from the VO perspective
IPv6 transition Vincenzo Spinoso EGI Operations.
WLCG Collaboration Workshop: Outlook for 2009 – 2010
UMD 2 Decommissioning Status
Andrea Manzi, Oliver Keeble
Retirement calendar of gLite 3.2 and EMI 1 middleware
Presentation transcript:

gLite->EMI2/UMD2 transition GDB September 2012

Clients/Services Services: Clients: we gave a recommendation for emi-1 Baseline Services page services with long term state services without state relying on EGI staged rollout overall a success recently some incompatibilities observed CREAM-CE SL(6) ALICE Clients: Started a validation for emi-1 WNs in spring 6 sites, all experiments, the main SEs Didn’t end with a clear result Presentation Title - 2

The situation The infrastructure has not been keen to upgrade recently Various reasons …some of them good Leaves us with obsolete and unsupported middleware on performing critical tasks …on obsolete OS (Feb 2012 for SL4 family) Recent experience gives concrete examples of the risks The short/medium term does not offer a natural moment to upgrade But we have to act to avoid future problems Presentation Title - 3

The situation The good news… Bad news… A number of sites are running up to date middleware versions (and have shared their experience) FTS 2.2.8 deployment is entirely EMI based CREAM has been adopted and validated in the EMI release No reasons not to upgrade… DPM has a number of EMI deployments out there …etc Bad news… Presentation Title - 4

Not latest, not greatest… Presentation Title - 5

The EGI / WLCG message Obsolete middleware must be upgraded. “2” is better than “1” EMI, UMD… Much closer to how things will look post-EMI EGI will be following this up via NGIs. WLCG sites and experiments: Balance between progress and stability limited acceptance of risks Unsupported software has risks and costs Problems with WN & UI (ie the clients) need to be understood Inc tarballs, Application area releases Presentation Title - 6

Services Not a request for panic mass-upgrades Validation by WLCG experiments has to start the EGI rollout doesn’t cover the experiments explicitely There is no perfect moment to wait for the long shutdown isn’t a vacation from computing gLite is obsolete DPM/LFC have a couple of months Clients have a couple of months The advantages Supported software More reliable software Better performing software ( including new features ) Presentation Title - 7

Worker Node A group of willing sites have agreed to install the EMI2/SL5/64bit WN and make queues available SL6 will follow Uses the EMI testing repository Updates can be immediately produced Bypassing EMI release process A full client release (tarball etc.) will happen after WN validation At this point the infrastructure can start upgrading Problem: Coordination and effort Presentation Title -

Status: Sites involved: All work based on best effort DESY:  dCache,  ATLAS and CMS CERN: Castor and EOS,  ATLAS and CMS Rutherford: CASTOR,    ATLAS and CMS ?? Brunel: DPM,  CMS INFN-Napoli: DPM, ATLAS INFN-CNAF: STORM, ATLAS and CMS All work based on best effort difficult to plan experiments can start only after the sites have moved Request for emi-2 test queues September 3rd 3 replies Presentation Title - 9

Next Steps Setup a page to track progress Expand to services get emi-2 / SL5 WNs verified Expand to services We need a more formal collaboration this will increase overall efficiency now individual sites and experiments cooperate locally very difficult to get a reliable global view Presentation Title - 10

Post emi ???? Discussions on software lifecycle process is on-going discussion of WLCG needs with EGI/EMI have started a proposal prepared for the next WLCG-MB General approach as much independence between PTs as possible you need it, you provide it there will be no one else  support for batch systems, re-locatable clients etc. this is already happening, but sharing is slow Presentation Title - 11