LCG Storage workshop at CERN. July 2-3 2007. Geneva, Switzerland. BNL’s Experience dCache1.8 and SRM V2.2 Carlos Fernando Gamboa Dantong Yu RHIC/ATLAS.

Slides:



Advertisements
Similar presentations
Distributed cluster dynamic storage: a comparison of dcache, xrootd, slashgrid storage systems running on batch nodes Alessandra Forti CHEP07, Victoria.
Advertisements

GridKa May 2004 Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Installing dCache into an existing Storage environment at GridKa Forschungszentrum.
J Jensen CCLRC RAL Data Management AUZN (mostly about SRM though) GGF 16, Athens J Jensen.
Steve Traylen Particle Physics Department Experiences of DCache at RAL UK HEP Sysman, 11/11/04 Steve Traylen
Owen SyngeDCache Slide 1 D-Cache Status Report Owen Synge.
LCG Tiziana Ferrari - SC3: INFN installation status report 1 Service Challenge Phase 3: Status report Tiziana Ferrari on behalf of the INFN SC team INFN.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft gridKa Forschungszentrum Karlsruhe GmbH Institute for Scientific Computing P.O.
EGEE is a project funded by the European Union under contract IST Using SRM: DPM and dCache G.Donvito,V.Spinoso INFN Bari
Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
Module 1: Installing Windows XP Professional
ATLAS computing in Geneva Szymon Gadomski, NDGF meeting, September 2009 S. Gadomski, ”ATLAS computing in Geneva", NDGF, Sept 091 the Geneva ATLAS Tier-3.
Magda – Manager for grid-based data Wensheng Deng Physics Applications Software group Brookhaven National Laboratory.
BNL Oracle database services status and future plans Carlos Fernando Gamboa RACF Facility Brookhaven National Laboratory, US Distributed Database Operations.
RAL PPD Site Update and other odds and ends Chris Brew.
Module 7: Fundamentals of Administering Windows Server 2008.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
Status report on SRM v2.2 implementations: results of first stress tests 2 th July 2007 Flavia Donno CERN, IT/GD.
DCache at Tier3 Joe Urbanski University of Chicago US ATLAS Tier3/Tier2 Meeting, Bloomington June 20, 2007.
BNL Facility Status and Service Challenge 3 Zhenping Liu, Razvan Popescu, Xin Zhao and Dantong Yu USATLAS Computing Facility Brookhaven National Lab.
Data management for ATLAS, ALICE and VOCE in the Czech Republic L.Fiala, J. Chudoba, J. Kosina, J. Krasova, M. Lokajicek, J. Svec, J. Kmunicek, D. Kouril,
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
CASTOR / GridFTP Emil Knezo PPARC-LCG-Fellow CERN IT-ADC GridPP 7 th Collaboration Meeting, Oxford UK July 1st 2003.
D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
Module 1: Installing Microsoft Windows XP Professional.
BNL Service Challenge 3 Site Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.
BNL ATLAS Database service update Yuri Smirnov, Iris Wu BNL, USA LCG Database Deployment and Persistency Workshop, CERN, Geneva October 17-19, 2005.
Optimisation of Grid Enabled Storage at Small Sites Jamie K. Ferguson University of Glasgow – Jamie K. Ferguson – University.
DCache Basics Alessandro Usai, Sergio Maffioletti Grid Group CSCS.
BNL Wide Area Data Transfer for RHIC & ATLAS: Experience and Plans Bruce G. Gibbard CHEP 2006 Mumbai, India.
BNL Facility Status and Service Challenge 3 HEPiX Karlsruhe, Germany May 9~13, 2005 Zhenping Liu, Razvan Popescu, and Dantong Yu USATLAS/RHIC Computing.
Alberto Aimar CERN – LCG1 Reliability Reports – May 2007
USATLAS dCache System and Service Challenge at BNL Zhenping (Jane) Liu RHIC/ATLAS Computing Facility, Physics Department Brookhaven National Lab 10/13/2005.
Status SC3 SARA/Nikhef 20 juli Status & results SC3 throughput phase SARA/Nikhef Mark van de Sanden.
OSG AuthZ components Dane Skow Gabriele Carcassi.
Derek Ross E-Science Department DCache Deployment at Tier1A UK HEP Sysman April 2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
Rutherford Appleton Lab, UK VOBox Considerations from GridPP. GridPP DTeam Meeting. Wed Sep 13 th 2005.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
BNL Service Challenge 3 Status Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
The CMS Top 5 Issues/Concerns wrt. WLCG services WLCG-MB April 3, 2007 Matthias Kasemann CERN/DESY.
BNL Service Challenge 3 Site Report Xin Zhao, Zhenping Liu, Wensheng Deng, Razvan Popescu, Dantong Yu and Bruce Gibbard USATLAS Computing Facility Brookhaven.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
Storage Classes report GDB Oct Artem Trunov
BNL Oracle database services status and future plans Carlos Fernando Gamboa, John DeStefano, Dantong Yu Grid Group, RACF Facility Brookhaven National Lab,
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
GridKa December 2004 Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Doris Ressmann dCache Implementation at FZK Forschungszentrum Karlsruhe.
SESEC Storage Element (In)Security hepsysman, RAL 0-1 July 2009 Jens Jensen.
ASCC Site Report Eric Yen & Simon C. Lin Academia Sinica 20 July 2005.
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
Western Tier 2 Site at SLAC Wei Yang US ATLAS Tier 2 Workshop Harvard University August 17-18, 2006.
1 5/4/05 Fermilab Mass Storage Enstore, dCache and SRM Michael Zalokar Fermilab.
Martina Franca (TA), 07 November Installazione, configurazione, testing e troubleshooting di Storage Element.
ALICE Physics Data Challenge ’05 and LCG Service Challenge 3 Latchezar Betev / ALICE Geneva, 6 April 2005 LCG Storage Management Workshop.
DB Questions and Answers open session (comments during session) WLCG Collaboration Workshop, CERN Geneva, 24 of April 2008.
Open Science Grid Consortium Storage on Open Science Grid Placing, Using and Retrieving Data on OSG Resources Abhishek Singh Rana OSG Users Meeting July.
STORAGE EXPERIENCES AT MWT2 (US ATLAS MIDWEST TIER2 CENTER) Aaron van Meerten University of Chicago Sarah Williams Indiana University OSG Storage Forum,
Security recommendations for dCache
Jean-Philippe Baud, IT-GD, CERN November 2007
Status of the SRM 2.2 MoU extension
Report of Dubna discussion
Flavia Donno CERN GSSD Storage Workshop 3 July 2007
Service Challenge 3 CERN
CMS transferts massif Artem Trunov.
LQCD Computing Operations
INFNGRID Workshop – Bari, Italy, October 2004
The LHCb Computing Data Challenge DC06
Presentation transcript:

LCG Storage workshop at CERN. July Geneva, Switzerland. BNL’s Experience dCache1.8 and SRM V2.2 Carlos Fernando Gamboa Dantong Yu RHIC/ATLAS computer facility Brook Haven National Lab

LCG Storage workshop at CERN. July Geneva, Switzerland.1 Table of Content  BNL’s dCache 1.8 storage and hardware configuration  BNL’s dCache1.8 configuration  Deployment problems  Second re-deployment dCache 1.8 patch level 1  General Commentaries  Future Plans

LCG Storage workshop at CERN. July Geneva, Switzerland.2 BNL’s dCache storage and hardware configuration  BNL end point: srm://dct00.usatlas.bnl.gov:8443/srm/managerv2?SFN=//pnfs/usatlas.bnl.gov/data/dteam  Storage class REPLICA-ONLINE (Tape0Disk1)  BNL’s end point hardware specification – CPU speed 3400 MHz – Memory KB – This is a server located outside BNL firewall – BNL's firewall not tape storage configured. – Disk space for storage 60GB

LCG Storage workshop at CERN. July Geneva, Switzerland.3 BNL’s dCache1.8 configuration  All dCache 1.8 components are installed on same server  Components installed:  SRM V2.2 door  Dcap door  Gridftp door  GSIdcap door  Gplazma cell  3 write pool of 20GB each one  PNFS

LCG Storage workshop at CERN. July Geneva, Switzerland.4 BNL’s dCache1.8 configuration (cont.)  Space Manager Configuration – Standar configuration based on dCache’s PoolManager.conf default parameters (1 write link, 1 linkGroup) – VO access control configuration – Group accounts: dteam001, ops001, usatlas5, usatlas4, usatlas3, usatlas2, usatlas1 – VO:ATLAS – Roles: dteamRole=*, /atlas/Role=production /atlas/soft-valid/Role=production

LCG Storage workshop at CERN. July Geneva, Switzerland.5 Deployment problems dCache 1.8 patch level 1 System StateTest NameObservation State1 -ReleaseFiles -Move RETURN:SRM_REQUEST_QUEUED After reboot of the dCache system State2 -06_StatusOfBringOnlineReques -09_ReleaseFiles -02_StatusOfPutRequest -04_PutDone, -05_PrepareToGet, -05_StatusOfGetRequest After working around 12 hours RETURN:SRM_REQUEST_Q UEUED State3 -06_BringOnlin -06_StatusOfBringOnlineReque -09_ReleaseFiles The test reported globus-url-copy failed Stability

LCG Storage workshop at CERN. July Geneva, Switzerland.6 Deployment problems dCache 1.8 patch level 1 Files appeared on the write pool not (PnfsManager) admin > cacheinfoof F48 cacheinfoof F48 No pool was returned However, the file does exist on the pool: data]# pwd /data/data5/dcache_pool_5/pool/data data]# ls -l F48 -rw-r--r-- 1 root root 2691 May 24 15: F48 Then looking in the admin on the pool (dct00_5) admin > rep ls -l F48 rep ls -l F F si={myStore:STRING} Tracing file from a specific test that reported SRM_REQUEST_QUEUED

LCG Storage workshop at CERN. July Geneva, Switzerland.7 Deployment problems dCache 1.8 patch level 1 (cont)  Authentication gPlazma: An entry on the DN of the user is not fully recreated authentication fails; differs from dn stored on kpwd file. Solution Work around: included the USER’s DN without the CN=xxxxx number.

LCG Storage workshop at CERN. July Geneva, Switzerland.8 Second re-deployment dCache 1.8 patch level 1 dCache 1.8 Parameter/Component BeforeAfter reinstall Number write pools/size5 / 20GB3 / 30GB Increased the timeout pool srmCopyReqThreadPoolSize 2512 remoteGsiftpMaxTransfers gridftp transfer per pool assumed 54 Mover queue18/pool30/pool dcachesrm-gplazma.policykpwd vo-role-mapping dCache1.8 and pnfs was re-installed.

LCG Storage workshop at CERN. July Geneva, Switzerland.9 General commentaries  Tuning Try several values for previous parameters until a stable configuration was found.  Learning curve Would be useful to have examples on using different SRM parameters for tuning purpose.

LCG Storage workshop at CERN. July Geneva, Switzerland.10 General commentaries (cont.) Validation Looking forward to install dCache 1.8 patch level 6 and verify if previous strategy can be used to keep passing the tests.

LCG Storage workshop at CERN. July Geneva, Switzerland.11 Future plans  Update dCache 1.8 patch level1 to patch level 6.  Setup a second test point with access to tape resource.