WLCG GDB, CERN, 10th December 2008 Latchezar Betev (ALICE-Offline) and Patricia Méndez Lorenzo (WLCG-IT/GS) 1.

Slides:



Advertisements
Similar presentations
CREAM: Update on the ALICE experiences WLCG GDB Meeting Patricia Méndez Lorenzo (IT/GS) CERN, 11th March 2009.
Advertisements

CREAM John Gordon GDB November CREAM number of sites now – gstat2 says 24. Batch systems supported Experiment Tests Feedback from sites. Evaluation.
ALICE Operations short summary and directions in 2012 Grid Deployment Board March 21, 2011.
ALICE Operations short summary and directions in 2012 WLCG workshop May 19-20, 2012.
Patricia Méndez Lorenzo (IT/GS) ALICE Offline Week (18th March 2009)
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
1 ANSL site of LHC and ALICE Computing Grids. Deployment and Operation. Narine Manukyan ALICE team of A.I. Alikhanian National Scientific Laboratory
The EDGeS project receives Community research funding 1 Specific security needs of Desktop Grids Desktop Grids Desktop Grids EDGeS project EDGeS project.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
ALICE Roadmap for 2009/2010 Patricia Méndez Lorenzo (IT/GS) Patricia Méndez Lorenzo (IT/GS) On behalf of the ALICE Offline team Slides prepared by Latchezar.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
LCG Plans for Chrsitmas Shutdown John Gordon, STFC-RAL GDB December 10 th, 2008.
Status of the production and news about Nagios ALICE TF Meeting 22/07/2010.
22 nd September 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Angela Poschlad (PPS-FZK), Antonio Retico.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/02/08 VOMS deployment Extent of VOMS usage in LCG-2 –Node types gLite 3.0 Issues Conclusions.
PDC’06 – production status and issues Latchezar Betev TF meeting – May 04, 2006.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
 Status of the ALICE Grid Patricia Méndez Lorenzo (IT)ALICE OFFLINE WEEK, CERN 18 October 2010.
CREAM: ALICE Experience WLCG GDB Meeting, CERN 11th November 2009 Stefano Bagnasco (INFN-Torino), Jean-Michel Barbet (Subatech), Latchezar Betev (ALICE),
Experiment Operations: ALICE Report WLCG GDB Meeting, CERN 14th October 2009 Patricia Méndez Lorenzo, IT/GS-EIS.
1 WLCG-GDB Meeting. CERN, 12 May 2010 Patricia Méndez Lorenzo (CERN, IT-ES)
VO Box Issues Summary of concerns expressed following publication of Jeff’s slides Ian Bird GDB, Bologna, 12 Oct 2005 (not necessarily the opinion of)
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
LCG Support for Pilot Jobs John Gordon, STFC GDB December 2 nd 2009.
Status of the Production ALICE TF MEETING 11/02/2010.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
Patricia Méndez Lorenzo (CERN, IT/GS-EIS) ċ. Introduction  Welcome to the first ALICE T1/T2 tutorial  Delivered for site admins and regional experts.
WLCG ‘Weekly’ Service Report ~~~ WLCG Management Board, 5 th August 2008.
Christmas running post- mortem (Part III) ALICE TF Meeting 15/01/09.
Criteria for Deploying gLite WMS and CE Ian Bird CERN IT LCG MB 6 th March 2007.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks glexec/SCAS pilot service Status and short-term.
LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
Current status WMS and CREAM CE deployment Patricia Mendez Lorenzo ALICE TF Meeting (CERN, 02/04/09)
WLCG Service Report ~~~ WLCG Management Board, 17 th February 2009.
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
GRID interoperability and operation challenges under real load for the ALICE experiment F. Carminati, L. Betev, P. Saiz, F. Furano, P. Méndez Lorenzo,
CERN IT Department CH-1211 Genève 23 Switzerland t CHEP 2009, Monday 26rd March 2009 (Prague) Patricia Méndez Lorenzo on behalf of the IT/GS-EIS.
CREAM CE: upgrades in the system  Migration of the ALICE production queue in the CREAM CE: DONE  From pps-cream-fzk.gridka.de:8443/cream-pbs-pps to.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
Pledged and delivered resources to ALICE Grid computing in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
ALICE WLCG operations report Maarten Litmaath CERN IT-SDC ALICE T1-T2 Workshop Torino Feb 23, 2015 v1.2.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
Availability of ALICE Grid resources in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
The ALICE Christmas Production L. Betev, S. Lemaitre, M. Litmaath, P. Mendez, E. Roche WLCG LCG Meeting 14th January 2009.
Status of the SL5 migration ALICE TF Meeting
Kilian Schwarz ALICE Computing Meeting GSI, October 7, 2009
ALICE Workload Model – WMS and CREAM
gLite->EMI2/UMD2 transition
Latest WMS news and more
Summary on PPS-pilot activity on CREAM CE
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
Database Readiness Workshop Intro & Goals
Patricia Méndez Lorenzo ALICE Offline Week CERN, 13th July 2007
Grid status ALICE Offline week Nov 3, Maarten Litmaath CERN-IT v1.0
The CREAM CE: When can the LCG-CE be replaced?
Short update on the latest gLite status
Summary from last MB “The MB agreed that a detailed deployment plan and a realistic time scale are required for deploying glexec with setuid mode at WLCG.
Simulation use cases for T2 in ALICE
ALICE – FAIR Offline Meeting KVI (Groningen), 3-4 May 2010
All Wales Safeguarding Procedures Review Project
Presentation transcript:

WLCG GDB, CERN, 10th December 2008 Latchezar Betev (ALICE-Offline) and Patricia Méndez Lorenzo (WLCG-IT/GS) 1

 ALICE is interested in the deployment of the CREAM-CE service at all sites which provide support to the experiment  Focus: Direct CREAM-CE submission  WMS submission not required  CREAM-CE proxy renewal feature not required  48h voms extensions ensured by the security  Enough to run production/analysis jobs without any addition extension  The experiment has began to test the CREAM-CE since the beginning of Summer 2008 in a fully production environment  This talk will focus on the experiment experiences using CREAM-CE, the expectations and requirements for all the sites 10-Dec The ALICE CREAM-CE CERN-WLCG GDB Meeting

 Test CREAM-CE instance provided by GridKa  Tests operated through a second VOBOX parallel to the already existing service at the T1  Access to the CREAM-CE  Initially 30 CPUS (in PPS) available for the testing  Moved in few weeks to the production ALICE queue (production setup)  Intensive functionality and stability tests from July to September 2008  Production stopped at the end of September of 2008 for CREAM-CE upgrades at the site  Confirmed the deployment of new version last week at GridKa (tested and perfectly working)  Excellent support from the CREAM-CE developers and the site admins  Thanks to Massimo Sgaravatto (Padova-INFN) and Angela Poschlad (GridKa) for the continous support 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 3

 More than jobs successfully executed through the CREAM-CE in the mentioned period  No interventions in the VOBOX required in the testing phase  CREAM used to distribute real (standard) ALICE jobs 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 4 Running on the production queue Running on PPS nodes

 The CREAM-CE requires a delegated proxy for submission purposes  The VOBOX already contains it  /opt/vobox/alice/proxy-repository/…. Contains already the user delegated proxies  ALICE submission procedure  Delegation-submission-delegation-submission  Procedure used only during the testing phase  Quite time consumming procedure  3 seconds estimated per submission  Delegation-submission-submission-submission is the proper procedure to follow 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 5

 Small changes are required into the ALICE submission infrastructure to use the CREAM-CE  Moreover related to the jdl agent construction:  The OutputSandbox declaration enforces a further field: « outputsandboxdesturi » which declares the gridftp server where to retrieve the output of the job  First test setup:  Leaving the job outputs into the CREAM-CE and retrieving them later via globus- url-copy (derty solution but OK for testing)  Final Setup (required for the production)  GridKa included a gridftp server into the 2 nd VOBOX  A new CREAM-CE submission module has been included in the last ALiEn version 2.16 (deployed this week at all sites)  Based in the experiences gained during the testing phase at GridKa  ALICE s/w is therefore ready and it foresees the CREAM-CE deploymentat all sites 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 6

 During the last October pre-GDB meeting it was explicitly mentioned:  Unlikely to be deployable as an lcg-CE replacement on this timescale (downtime period), but we can continue with rollout in parallel.  In addition during the November pre-GDB meeting it was concluded:  The lcg-CE replacement will required the WMS submission in place and the resolution of the proxy renewal issue (among more other points related to the service performance)  It was encouraged however the deployment of the system in parallel to the LCG-CE 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 7

 The parallel LCG-CE vs. CREAM-CE setup in terms of ALICE computing model means the deployment of a 2 nd VOBOX  Each VOBOX is able to submit to a specific backend  One VOBOX  LCG-CE OR CREAM-CE submission: replacement approach  Two VOBOXES  LCG-CE AND CREAM-CE submission: parallel approach  This is a temporary solution during the parallel running phase  As soon as the replacement is ensured and the LCG-CE is deprecated ALICE will not required a 2 nd VOBOX 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 8

 Remarks for the 2 nd VOBOX deployment  Non-stop for the deployment of the CREAM-CE  Serious concerns providing a 2 nd VOBOX at the T2 sites  Each site will be treated individually  Observe the virtual service setup as a temporal solution  This is NOT applicable to the T1 sites 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 9

 In addition:  Setup of the ALICE production queue behind the CREAM-CE  This procedure puts the CREAM-CE directly in production  GridFTP server  Required to retrieve the job (agent) outputs  Removed from the VOBOX in January 2008 with the deployment of the gLite3.1 VOBOX  It was not longer required by the 4 LHC experiments at that time  No specific wish for the placement of this service  It can be provided into the VOBOX but this site decision 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 10

 There are 3 sites currently providing CREAM-CE (plus all the further requirements including a 2 nd VOBOX):  GridKa (Germany)  VECC (India)  IHEP (Russia)  ALICE encourages all sites to provide a CREAM-CE during the LHC downtime  The latest AliEnv2.16 is ready to use the CREAM-CE in parallel to the LCG-CE (WMS submission only. RB fully deprecated )  The experiment foresees the CREAM-CE system in full production (if ready) before the real data taking  The test/feedback and the support by the experiment and the CREAM-CE experts is available for all sites 10-Dec 2008 The ALICE CREAM-CE CERN-WLCG GDB Meeting 11