Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t DSS XROOTD news New release New features.

Slides:



Advertisements
Similar presentations
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS CASTOR Status Alberto Pace.
Advertisements

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS TSM CERN Daniele Francesco Kruse CERN IT/DSS.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.
GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
Staging to CAF + User groups + fairshare Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE Offline week,
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Web Content Management System Discussion.
Linux Operations and Administration
CERN IT Department CH-1211 Genève 23 Switzerland t XROOTD news Status and strategic directions ALICE-GridKa operations meeting 03 July 2009.
Copyright© 2003 Avaya Inc. All rights reserved Upgrade to Communication Manager 2.0 with Migration to Linux 8.0 Purpose: This presentation was prepared.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Ideas for 2011 Prepare must be done work items –Warranty –Software maintenance –Commitments.
AliEn uses bbFTP for the file transfers. Every FTD runs a server, and all the others FTD can connect and authenticate to it using certificates. bbFTP implements.
Introducing Dreamweaver MX 2004
A Web Crawler Design for Data Mining
CERN - IT Department CH-1211 Genève 23 Switzerland t CERN - IT Department CH-1211 Genève 23 Switzerland t Internet Services.
CERN IT Department CH-1211 Genève 23 Switzerland t Experience with Windows Vista at CERN Rafal Otto Internet Services Group IT Department.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Make the most of Office 2010, Expression.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Working with Windows 7 at CERN Michał Budzowski.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES P. Saiz (IT-ES) AliEn job agents.
XROOTD Tutorial Part 2 – the bundles Fabrizio Furano.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t LCG Gridview / LCG SAM use cases Miguel Anjo 8 th July 2008 Database Developers’ Workshop.
Status of the production and news about Nagios ALICE TF Meeting 22/07/2010.
CERN IT Department CH-1211 Genève 23 Switzerland t Castor development status Alberto Pace LCG-LHCC Referees Meeting, May 5 th, 2008 DRAFT.
1 / 22 AliRoot and AliEn Build Integration and Testing System.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Wahid, Sam, Alastair. Now installed on production storage Edinburgh: srm.glite.ecdf.ed.ac.uk  Local and global redir work (port open) e.g. root://srm.glite.ecdf.ed.ac.uk//atlas/dq2/mc12_8TeV/NTUP_SMWZ/e1242_a159_a165_r3549_p1067/mc1.
CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd setup An introduction/tutorial for ALICE sysadmins.
Redirector xrootd proxy mgr Redirector xrootd proxy mgr Xrd proxy data server N2N Xrd proxy data server N2N Global Redirector Client Backend Xrootd storage.
CERN - IT Department CH-1211 Genève 23 Switzerland t CASTOR Status March 19 th 2007 CASTOR dev+ops teams Presented by Germán Cancio.
Light weight Disk Pool Manager experience and future plans Jean-Philippe Baud, IT-GD, CERN September 2005.
File sharing requirements of remote users G. Bagliesi INFN - Pisa EP Forum on File Sharing 18/6/2001.
CERN IT Department CH-1211 Genève 23 Switzerland t Scalla/xrootd WAN globalization tools: where we are. Now my WAN is well tuned! So what?
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM / LFC and FTS news Ricardo Rocha ( on behalf of the IT/GT/DMS.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS Castor incident (and follow up) Alberto Pace.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS New tape server software Status and plans CASTOR face-to-face.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
AliEn central services Costin Grigoras. Hardware overview  27 machines  Mix of SLC4, SLC5, Ubuntu 8.04, 8.10, 9.04  100 cores  20 KVA UPSs  2 * 1Gbps.
ALICE DATA ACCESS MODEL Outline 05/13/2014 ALICE Data Access Model 2  ALICE data access model  Infrastructure and SE monitoring.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal at CERN Juraj Sucik Jarosław Polok.
CERN IT Department CH-1211 Genève 23 Switzerland t ALICE XROOTD news New xrootd bundle release Fixes and caveats A few nice-to-know-better.
CERN - IT Department CH-1211 Genève 23 Switzerland t Operating systems and Information Services OIS Proposed Drupal Service Definition IT-OIS.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Disk Space publication Simone Campana Fernando Barreiro Wahid.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES L. Betev, A. Grigoras, C. Grigoras, P. Saiz, S. Schreiner AliEn.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
SRM v2.2 Production Deployment SRM v2.2 production deployment at CERN now underway. – One ‘endpoint’ per LHC experiment, plus a public one (as for CASTOR2).
Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.
Developments for tape CERN IT Department CH-1211 Genève 23 Switzerland t DSS Developments for tape CASTOR workshop 2012 Author: Steven Murray.
Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES AI Images, flavours and partitions Vítor Gouveia,
CERN IT Department CH-1211 Genève 23 Switzerland t Xrootd through WAN… Can I? Now my WAN is well tuned! So what? Now my WAN is well tuned.
+ AliEn status report Miguel Martinez Pedreira. + Touching the APIs Bug found, not sending site info from ROOT to central side was causing the sites to.
Good user practices + Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CUF,
New Features of Xrootd SE Wei Yang US ATLAS Tier 2/Tier 3 meeting, University of Texas, Arlington,
CERN IT Department CH-1211 Genève 23 Switzerland t CMS SAM Testing Andrea Sciabà Grid Deployment Board May 14, 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
Federating Data in the ALICE Experiment
Essentials of UrbanCode Deploy QQ147 Components
Basic aliensh S. Bagnasco, INFN Torino CNAF Nov 27-28, 2007.
Status of the CERN Analysis Facility
CHAPTER 7.
GSIAF & Anar Manafov, Victor Penso, Carsten Preuss, and Kilian Schwarz, GSI Darmstadt, ALICE Offline week, v. 0.8.
Data Federation with Xrootd Wei Yang US ATLAS Computing Facility meeting Southern Methodist University, Oct 11-12, 2011.
GSIAF "CAF" experience at GSI
GFAL 2.0 Devresse Adrien CERN lcgutil team
Storage elements discovery
Networking for Home and Small Businesses – Chapter 2
Networking for Home and Small Businesses – Chapter 2
Presentation transcript:

Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS XROOTD news New release New features

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS Presentation Title - 2 New bundled release A new production release is available since a few days (vmss_1.7) –It contains the xrootd tag v Huge changelog available in the Savannah page See the ‘download’ section –Main items: Data management Refinements for the Virtual Mass Storage 3 rd party copy available by default Space reporting in Monalisa

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS Data management Big improvements visible in the ‘xrd’ command line interface –Of course the server must support them –Cluster-wide ‘ls’ and ‘recursive ls’ Now the output is what one should expect –Query space It gives an approximation of the used/free space managed by the cluster A correct one if each server mounts a disjoint set of disks –If you mount the same NAS to more than one server it will report more. Presentation Title - 3

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS SE cleanup Now, the actual content of an SE can be compared to the information in the AliEn catalogue –It’s a very heavy maintenance operation, worth doing from time to time –From the SE side it’s easy. Just compute the result of the recursive ls in ‘/’ You have to sync with Latchezar/Pablo about the actions –It was performed on ALICE::CERN::SE 1hr 50m for 5-6Mfiles Presentation Title - 4

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS Bundle refinements The VMSS is more mature –The native-XROOTD ALICE site federation through the Global Redirector Automatic fetch of absent files –Much faster than before Automatic reporting to ML of the space information –See the ‘SE status’ page Automatic reporting to ML of the server version –Easy to spot old ones from now on Presentation Title - 5

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS The 3 rd party copy Same plugin as CASTOR (by A.Peters) Authenticated “Push” mode for files –Files are pushed directly server->server –The push is triggered by the command xrd3cp Not included in the server bundle –No config needed, it works out of the box Presentation Title - 6

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS Mailing list There’s a new CERN-centric mailing list Used for announces about tags/versions –XROOTD-announce.cern.ch Everybody is invited –Not much traffic is foreseen Presentation Title - 7

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS The Global redirector Remarkable stability, it never needs restarts It will soon reach the first limit of 64 native xrootd sites in the same federation –A solution for this is in development –Will allow the aggregation of up to 256 sites No need to touch it now –But a check about the sites’ list will be performed –Completely transparent Some sites need to be refurbished –Old versions, not supporting it very well –A few of them also look unstable –More news after the round of checks Presentation Title - 8

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services DSS Upgrade! Upgrading is highly recommended Usual steps, usual Alien Howto – Newhttp://alien.cern.ch/twiki/bin/view/AliEn/HowToInstallXrootd New Better not to copy the old system.cnf –Copy the (few) values manually Better not as root, do a parallel normal installation –In a parallel directory in the ‘xrootd’ user’s home –Stop the former, clean (eventually) stale ML-related processes –Start the new one Presentation Title - 9