Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.

Slides:



Advertisements
Similar presentations
LCG Tiziana Ferrari - SC3: INFN installation status report 1 Service Challenge Phase 3: Status report Tiziana Ferrari on behalf of the INFN SC team INFN.
Advertisements

Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
Storage Issues: the experiments’ perspective Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 9 September 2008.
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
INFSO-RI Enabling Grids for E-sciencE SRMv2.2 experience Sophie Lemaitre WLCG Workshop.
WLCG Service Report ~~~ WLCG Management Board, 27 th October
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
Status report on SRM v2.2 implementations: results of first stress tests 2 th July 2007 Flavia Donno CERN, IT/GD.
Status of SRM 2.2 implementations and deployment 29 th January 2007 Flavia Donno, Maarten Litmaath IT/GD, CERN.
SRM 2.2: tests and site deployment 30 th January 2007 Flavia Donno, Maarten Litmaath IT/GD, CERN.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
WLCG Service Report ~~~ WLCG Management Board, 24 th November
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.
What is expected from ALICE during CCRC’08 in February.
Your university or experiment logo here Storage and Data Management - Background Jens Jensen, STFC.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.
1 LHCb on the Grid Raja Nandakumar (with contributions from Greig Cowan) ‏ GridPP21 3 rd September 2008.
1 User Analysis Workgroup Discussion  Understand and document analysis models  Best in a way that allows to compare them easily.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
1 LHCb File Transfer framework N. Brook, Ph. Charpentier, A.Tsaregorodtsev LCG Storage Management Workshop, 6 April 2005, CERN.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/06/07 SRM v2.2 working group update Results of the May workshop at FNAL
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
GGUS Slides for the 2012/07/24 MB Drills cover the period of 2012/06/18 (Monday) until 2012/07/12 given my holiday starting the following weekend. Remove.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.
Busy Storage Services Flavia Donno CERN/IT-GS WLCG Management Board, CERN 10 March 2009.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Site Report: Prague Jiří Chudoba Institute of Physics, Prague WLCG GridKa+T2s Workshop.
WLCG Service Report ~~~ WLCG Management Board, 7 th September 2010 Updated 8 th September
4 March 2008CCRC'08 Feb run - preliminary WLCG report 1 CCRC’08 Feb Run Preliminary WLCG Report.
Service Availability Monitor tests for ATLAS Current Status Tests in development To Do Alessandro Di Girolamo CERN IT/PSS-ED.
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
WLCG Service Report ~~~ WLCG Management Board, 18 th September
WLCG Grid Deployment Board CERN, 14 May 2008 Storage Update Flavia Donno CERN/IT.
Handling of T1D0 in CCRC’08 Tier-0 data handling Tier-1 data handling Experiment data handling Reprocessing Recalling files from tape Tier-0 data handling,
WLCG Information System Use Cases Review WLCG Operations Coordination Meeting 18 th June 2015 Maria Alandes IT/SDC.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
SRM v2.2 Production Deployment SRM v2.2 production deployment at CERN now underway. – One ‘endpoint’ per LHC experiment, plus a public one (as for CASTOR2).
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data Management cluster summary David Smith JRA1 All Hands meeting, Catania, 7 March.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,
8 August 2006MB Report on Status and Progress of SC4 activities 1 MB (Snapshot) Report on Status and Progress of SC4 activities A weekly report is gathered.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
1 SRM v2.2 Discussion of key concepts, methods and behaviour F. Donno CERN 11 February 2008.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
CERN IT Department CH-1211 Genève 23 Switzerland t CCRC’08 Review from a DM perspective Alberto Pace (With slides from T.Bell, F.Donno, D.Duelmann,
WLCG Service Report Jean-Philippe Baud ~~~ WLCG Management Board, 24 th August
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
SRM 2.2: experiment requirements, status and deployment plans 6 th March 2007 Flavia Donno, INFN and IT/GD, CERN.
Acronyms GAS - Grid Acronym Soup, LCG - LHC Computing Project EGEE - Enabling Grids for E-sciencE.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
SRM v2.2: service availability testing and monitoring SRM v2.2 deployment Workshop - Edinburgh, UK November 2007 Flavia Donno IT/GD, CERN.
CERN WLCG Grid Storage Systems Deployment Flavia Donno, CERN 6 November 2007 Organization of Storage Support through GGUS Flavia Donno CERN/IT-GD CERN.
Status of the SRM 2.2 MoU extension
Flavia Donno, Jamie Shiers
Flavia Donno CERN GSSD Storage Workshop 3 July 2007
SRM2 Migration Strategy
CASTOR-SRM Status GridPP NeSC SRM workshop
Proposal for obtaining installed capacity
INFNGRID Workshop – Bari, Italy, October 2004
Presentation transcript:

Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD

Grid Deployment Board, CERN 5 December 2007 Agenda Status of the implementations Site Status Experiment tests Status of high-level tools (GFAL, lcg-utils, FTS) Site Availability Monitor (SAM) Storage Support

Grid Deployment Board, CERN 5 December 2007 Implementations Status CASTOR: PrepareToPut with not supported protocol returning invalid status CASTOR returns not fully specified TURLs Lost file being investigated dCache: GetSpaceMetadata not returning correct space value Ls recently fixed to report correctly the status of a file (NEARLINE/ONLINE) and space tokens ReleaseFiles not working without requestID DPM: Abort sometime not returning correct status at file and request level ReleaseFiles not working without requestID StoRM: RemainingPinTime not returned by Get/BringOnline ReleaseFiles not working without requestID

Grid Deployment Board, CERN 5 December 2007 BringOnline/Get operations CASTOR: It does not ignore a token if passed If the token is not passed, then it tries to match requested storage class or protocol If nothing is passed, and a copy of the file exists on disk it is served If no copy of the file exist on disk, the file is retrieved in a “default” area Automatic copy of files between pools can be enabled Users can be stopped from recalling files in specific “production” space tokens. dCache: Space Token cannot be provided by users to retrieve files from tape. “default space” is always used. Paths can be used to select pools. The use cases provided by the experiments and the implications of the above behavior will be summarized in a document that will be discussed during CCRC08 phone conferences

Grid Deployment Board, CERN 5 December 2007 Site Status Source: Pioneer Consulting LLC The rollout plan is being followed Only SARA, CNAF, CERN and IN2P3 publish the production SRM v2.2 endpoints in production. SARA has not configured space tokens for ATLAS/LHCb FZK will publish the pre-production endpoint soon

Grid Deployment Board, CERN 5 December 2007 Site Status Source: Pioneer Consulting LLC The pre-production SRM v2.2 endpoints are not kept functional enough for the experiments to use No Tier-2s yet.

Grid Deployment Board, CERN 5 December 2007 Experiment tests Preliminary tests executed only by ATLAS and LHCb Still only basic functionality tests to get familiar with SRM v2.2 and with the high-level tools Some requests concerning functionality needed is being made. A list is being compiled and discussed with the developers Stress tests are also needed to understand the bottleneck of SRM v2.2 What about CMS and Alice ?

Grid Deployment Board, CERN 5 December 2007 High-level tools The current version of GFAL (1.10.5) and lcg-utils (1.6.4) tested by the experiment is distributed by GSSD as a tarball and installed on lxplus in a test area. It is also distributed in the AA external area Not yet in production (some of the SRM v1 functionalities are broken) Some functionalities available only through APIs (prestage, pin) Tested OK in OSG (distribution via VDT ?) The space token can be specified as input on Get/prestage FTS 2.0 does not offer the possibility of specifying the space token for the source. However, the file is assumed to be available on disk (no prestage).

Grid Deployment Board, CERN 5 December 2007 Site Availability Monitor The current tests (S2, lcg-utils, gfal, bdii) are being integrated in SAM. Probably available with next release.

Grid Deployment Board, CERN 5 December 2007 Storage Support Working with sites to create second level support for dCache and StoRM User forum already well established. They can be published in the GGUS portal Already well established GGUS channels. Working on hooking up second level support to GGUS

Grid Deployment Board, CERN 5 December 2007 Storage Support SRM v2.2 deployment workshop in Edinburgh Reached limit in attendance (50 people) Tutorials and hands-on for dCache, DPM, and StoRM Input received: very useful, good material produced The event should be repeated Good forum to discuss encountered problems Thank you to GridPP, NeSC and WLCG for supporting the event

Grid Deployment Board 5 December 2007 Thank You