1. efi.uchicago.edu ci.uchicago.edu FAX status report Ilija Vukotic on behalf of the atlas-adc-federated-xrootd working group Computation and Enrico Fermi Institutes University of Chicago ADC Development Meeting March 17, 2014

2. efi.uchicago.edu ci.uchicago.edu 2 Content Deployment Status Tests Developments – Failover to FAX – Job overflow – User tools

3. efi.uchicago.edu ci.uchicago.edu 3 Deployment Cloud T1sT2DsT2 DoneTotalDoneTotalDoneTotal CA 010401 US 115612 FR 012806 DE 117925 IT 113311 ES 010402 NL 021219 UK 1181027 TW 11--01 ND 01--03 CERN 11---- RU 01---- Total 6132646737

4. efi.uchicago.edu ci.uchicago.edu 4 Deployment CA cloud – Main contact Asoka D S – Start with TRIUMF o Connected to ORAN o Has xrootd door o Not open for external traffic o Being tested NL cloud – No word yet from Sara and Nikhef – 3 sites in Israel o Storm o Have 10Gbps connection ES cloud – PIC will rejoin – Has to stay with dCache 2.2 New redirectors – Will reorganize North America redirection tree o West (TRIUMF, SLAC, McGill, Scinet) o Central (MWT2, AGLT2, OU, SWT2) o East (BNL, BU, Victoria,SFU) – Add NL for NL T1s and the Scandinavian T2s – Add IL for Israeli sites – The rest of ND cloud distributed over existing redirectors according to their geographical location

5. efi.uchicago.edu ci.uchicago.edu 5 Status Most sites running stably All monitoring tools running stably.

6. efi.uchicago.edu ci.uchicago.edu 6 Tests Will try to saturate a test 100Gbps link MWT2-BNL – Analysis jobs – High IO direct access jobs – Simple xrdcp jobs Wahid will test running UCL as a diskless T2 with redirection to QMUL Two additional stress test in US cloud – Collects all the FTS transfers done in the cloud – Stressing the doors – simply looks up the files – Stressing the links – repeats the transfers but discards the files transferred

7. efi.uchicago.edu ci.uchicago.edu 7 Developments Failover to FAX – Turned on for all of the queues o Sites belonging to a cloud with it’s own redirector redirect to it. o NL, ND sites redirect to EU (root://atlas-xrd-eu.cern.ch/) o CA to global (root://glrd.usatlas.org/) – Developed a code that can send mails in case of a lot of jobs failing over o This mail would go directly to site admins o That should help them find why jobs were unable to get the data in a “normal” way. o More than 100 failed over jobs in any one queue in last 6 hours will generate the mail.

8. efi.uchicago.edu ci.uchicago.edu 8 Developments

9. efi.uchicago.edu ci.uchicago.edu 9 Developments Overflow to FAX – Need to propagate additional information to schedconfigDB and then JEDI scheduler and pilot o Data source FAX endpoint address – will be used by pilot to get the data from the optimal source o wanlimitsource, wanlimitsink – Variables set for each queue separately – Unit is Gbps (integer) o Still not clear how scheduler will enforce the limits – Need changes in pilot.

10. efi.uchicago.edu ci.uchicago.edu 10 User tools Currently in version 16 of localSetupFAX Added FAX-get – equivalent of dq2-get but getting data from FAX – a number of options still to come All the commands renamed from FAX-xxx to fax-xxx