Data transfers and storage Kilian Schwarz GSI

GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch & GSIAF) Directly attached disk storage (81 TB) 35 TB ALICE::GSI::SE ::xrootd PROOF/ Batch Grid CERN GridKa 150 Mbps GSI GSI batchfarm: Common batch queue (132 nodes) CE Grid Lustre Clustre 84 TB Soon 1 Gbs 3rd party copy test cluster 10 TB Local xrd Cluster 15 TB gStore backend

monitoring

Future for Alice Tier 2&3 at GSI: Remarks: 2/3 of that capacity is for the tier 2 (ALICE central, fixed via WLCG MoU) 1/3 for the tier 3 (local usage, may be used via Grid) currently: 10% of ALICE T2 proposal running: go for 20% of ALICE T2 capacities question: how to distribute among GSI storage facilities ? Year ramp-up CPU (kSI2k) 400/ / / / Disk (TB)120/80300/200390/260510/ WAN (Mb/s)

transfers Principal method: within AliEn mirror -t find_collection alice::gsi::se listTransfer -id master Before: find -c find_collection. file  after some initial difficulties it works fine, now !!!

ALICE::GSI::SE usage

(almost) all requested transfers DONE

Test cluster for 3rd party copy exercise Currently 2 file servers and 1 local redirector on seperate machine Current status: xrootd up and working. Data can be pulled via this cluster from CERN (voalice04). Plan: setup test SE with new FTD supporting 3rd party copy method Connect to global ALICE redirector See presentation of Fabrizio yesterday

GSI 1 Gb upgrade Current transfer method using AliEn FTD The global Grid ALICE vobox GSI Batch Farm and File Servers The whole traffic is tunneled via the vobox.  Only necessary to put vobox into seperate subnet with 1 Gb connection to outside world with safe connection via firewall or network bridge to internal GSI network.  No real bottleneck since modern machines should be able to handle 1 Gb in/out connection without problems 1 Gb should also be enough for GridKa to serve T2s

GSI 1 Gb upgrade Xrootd 3rd party copy The global Grid vobox ALICE::GSI::SE GSI Batchfarm/GSIAF Possibility: put vobox and SE in seperate subnet with 1 Gb connection to outside world. But how to handle safe connection to all WNs and GSIAF Without introducing unnecessary bottlenecks ? To seperate traffic within scientific net (ALICE) and other GSI traffic (800/200)

Technical issues Additional to the subnet „problem“ When using 3rd party copy and the AliEn SE as interface between GSI and the outside world we need to have –The possibility to delete files again in the SE, otherwise it will become pretty full (ev. sufficient during staging/cp process via SE) –In that context also: list content of 1 specific SE with AliEn methods –How to limit bandwidth via 3rd party transfer method ? Or will always everything offered be used ? I know that it is planned to introduce a machinery for (input+output) traffic coordination for globalized xrootd clusters. Does that solve the issue ?

T2 Opinion poll Opinion poll: how to other ALICE T2 centres configure their site with respect to network and firewall ? –Legnaro: no firewall, gLite + AliEn, no subnet, 1Gbs, WNs in private network, SE seen via xrd door to dCache –Subatech: 1 Gb/s, firewall covering the whole site, no subnet or DMZ, no proxy to connect to outside world, DPM –Catania: no firewall, no subnet, DPM, 1 Gb/s, 10 Gb/s next year, IPtables instead of hardware firewall, AliEn & gLite –NIHAM: WNs and data servers in same private subnet. Direct communication possible, xrootd SE, only software firewall, soon 10 Gb connection, 2/3 plain AliEn (32 and 64bit), PBS batch system