1. Status of the DESY Grid Centre Volker Guelzow & the Grid Crew DESY IT Hamburg, April 28th

2. Volker Guelzow | PRC | 28.04.2011 | Page 2 Outline > The 2011 DESY Grid centre status > The NAF@DESY > Requests and Pledges for WLCG > dCache > The LHCone project > The German Tier 2 situation > Conclusion

3. Volker Guelzow | PRC | 28.04.2011 | Page 3 GridCentre Resources as of 26.4.2011 DESY-HHDESY-ZNNAF CPU (#Slots)42247841620 CPU (HS06)33.9 kHS068.6 kHS0622 kHS06 Disk (ATLAS)890 TB (525 TB)750 TB (525 TB)135 TB Disk (CMS)1057 TB (640 TB)-58 TB Disk (LHCb)-180 TB47 TB Disk (other Grid)348 TB500 TB33 TB In red: WLCG T2 Pledges

4. Volker Guelzow | PRC | 28.04.2011 | Page 4 DESY-Grid Centre Usage

5. Volker Guelzow | PRC | 28.04.2011 | Page 5 The German T2‘s (Atlas, CMS, LHCb) HGF Alliance funding for Universities: Pledges for Germany http://lcg.web.cern.ch/LCG/Resources/WLCGResourc es-2010-2012_15DEC2010.pdf CPU 2011 [HS] CPU 2012 [HS] Disk 2011 [TB] Disk 2012 [TB] A DESY6200660010501350 C DESY1180012900640900 A Goettingen38004000400590 C Aachen66008700330435 A Munich92201156010401340 A FR/Wupp46334917633733 A FR/W Freiburg 46105780518668 Summe CMS18400216009701335 Summe Atlas284633285736414701 SumDESY180001950016902250 SumNonDESY288633495729213786 GrandTotAllT2 WW 7253247762036045471998

6. Volker Guelzow | PRC | 28.04.2011 | Page 6 Tier 2 Production: > ATLAS production, worldwide, finished and failed jobs. DE-Cloud

7. Volker Guelzow | PRC | 28.04.2011 | Page 7 > Summary of ATLAS production, stacked. of ATLAS of a DE-Cloud

8. Volker Guelzow | PRC | 28.04.2011 | Page 8 German Tier 2 usage From Computing Resources Scrutiny Group April 2011 (Cern-RRB-2011-019) (German Rep: Martin Gasthuber, DESY) AtlasCMS

9. Volker Guelzow | PRC | 28.04.2011 | Page 9 Atlas delivered vs. pledged CPU resources@DESY

10. Volker Guelzow | PRC | 28.04.2011 | Page 10 CMS delivered vs pledged computing resources@DESY

11. Volker Guelzow | PRC | 28.04.2011 | Page 11 Tier2 availability based on SAM tests

12. Volker Guelzow | PRC | 28.04.2011 | Page 12 CMS Analysis Jobs since beginning of 2011

13. Volker Guelzow | PRC | 28.04.2011 | Page 13 CMS MC production jobs since January 2011

14. Sue.Foffano@cern.ch14 Tier-2 Accounting 11/2010-02/2011 12 th April 2011

15. Sue.Foffano@cern.ch15 Tier-2 Accounting 11/2010-02/2011 12 th April 2011

16. Volker Guelzow | PRC | 28.04.2011 | Page 16 The DESY GridLab: Idea: > DESY Grid more than just a production site > Have dedicated machines to develop and test new products and components … representative for and integrated into production environment > Reusing old WNs from Grid, temporarily borrowing WNs from production Grid > Purchasing some dedicated HW (storage) > Contacts: D. Ozerov, Y. Kemp Activities: > Taking part in the WLCG storage technology demonstrators: > NFS v4.1 (pNFS) with dCache.org > Benchmarking LHC applications on a dedicated setup: HEPIX, CHEP, EMI conference contributions > Together with external physicists > Platform for Cloud & virtualization testing in Grid context > Platform for DPHEP prototype > Platform for external students work > …

17. Volker Guelzow | PRC | 28.04.2011 | Page 17 NAF usage shares 2011 Wall Clock Lustre Space

18. Volker Guelzow | PRC | 28.04.2011 | Page 18 NAF usage by VO‘s

19. Volker Guelzow | PRC | 28.04.2011 | Page 19 NAF: Current open questions and discussions > Some requests from the user community  Increase stability and reliability of NAF AFS  Lustre management tools (group quotas, old-file-deletion, synchronization with dCache)  Interactive and graphical software stack on the NAF  Faster X-access (other protocols like NX)  Install CernVM-FS for experiment software (NAF&Grid)  Faster reaction and fixing of problems, better user information  … > NAF provider view:  Many of these requests make sense, and we think could be useful  Some requests very difficult: e.g. Lustre product has deficiencies and lacks features  Other requests have to be rejected because of lack of manpower and difficult to integrate into current NAF setup as targeted to a national community

20. Volker Guelzow | PRC | 28.04.2011 | Page 20 NAF CPU Occupancy

21. Volker Guelzow | PRC | 28.04.2011 | Page 21 dCache.org dCache, Status Contact : Patrick Fuhrmann @ DESY dCache : a world wide recognized storage technology DESY provides the project infrastructure (headquarters) Development : Web Pages, Wikis and Documentation. Central Code Repositories Organization of developers meetings and workshops Services activities: Test infrastructure & performance (Grid-Lab) Quality Management Release Management Customer support : Tier I conferences, support@dcache.org Network Activities : DESY : dCache operations (DOT) and Grid-Lab Germany : HGF, DGI, German Support Europe : EMI, NDGF, Swedish National Infrastructure Worldwide : WLCG, Open Science Grid, Open Grid Forum Main communities WLCG HERA Photon Science (@ DESY) LOFAR (LOw Frequency ARray) : Amsterdam & Jülich Swedish academic storage e-infrastructure (SNIC)

22. Volker Guelzow | PRC | 28.04.2011 | Page 22 Kopenhagen Stockholm DESY Chicago Partners o DESY (Headquarters) DESY (lab) : 2 HGF & DGI : 3 European Middleware Initiative : 2 (DESY Grid-Lab : 1) o Nordics Nordic Data Grid Facility : 1 Swedish National Infrastructure : 1 o FERMIlab FERMI (lab) plus USCMS : 2 The European Middleware Initiative (EMI, 2010 – 2013 ) 12 Million € total EU funding plus 12 € by 22 partners. DESY gets 500.000 € over 3 years = 2 FTE plus a lot of traveling dCache is one of the 4 middle-wares (gLite, ARC, UNICORE, dCache) dCache.org provides the EMI data area leader (Patrick) EMI provides access to new communities EMI provides efforts for standards in dCache (more non HEP customers) dCache, People and Funding Contact : Patrick Fuhrmann @ DESY dCache provides a stable collaboration, important for HEP and strategically interesting for DESY. dCache success attracted 3. party money.

23. Volker Guelzow | PRC | 28.04.2011 | Page 23 dCache, The Deployment Contact : Patrick Fuhrmann @ DESY o 94 PB in total WLCG o 8 Tier I’s o 60 Tier II’s USA 28 PB Europe 44 PB Germany 16 PB East : 1 PB Barcelona Lyon Athens Pisa Roma NDGF Sweden London Madrid Amsterdam KIT DESY Aachen Wuppertal Munich FERMIlab BNL Florida Purdue Wisconsin Cambridge, MA Madison dCache Other Storage Systems WLCG Storage per SE type Göttingen Freiburg Mainz Dresden

24. Volker Guelzow | PRC | 28.04.2011 | Page 24 LHCone: proposed architecture (I) RENATER DFN GARR Other NRENs ESNET/ USLHCNet GEANT EU-US capacity: Several 10G links - demand oriented Capacity reserved for LHC and according to demand T1 centre T2 (or T3)

25. Volker Guelzow | PRC | 28.04.2011 | Page 25 LHCone: proposed architecture (II) HEPPI Prototyp Configuration DESY 20G RWTH 6G KIT 10G DES AAC U FFM (GSI) FRA 10G internat, GSI 10G FZK

26. Volker Guelzow | PRC | 28.04.2011 | Page 26 2011 CPU [HS06] 2012 CPU[HS0 6] SRC 2013 CPU [HS06] SRC 2011 Disk[TB] 2012 Disk [TB] SRC 2013 Disk [TB] SRC Atlas Total T2 278000295000315000342004700053000 CMS Total T2 319500350000 1990026000 CPU2011CPU 2012CPU 2013Disk 2011Disk 2012Disk 2013 Atlas27800 HS29500 HS31500 HS3420 TB4700 TB5300 TB CMS23960 HS26300 HS 1490 TB1950 TB Per centre: Av. Atlas9300 HS10000 HS10500 HS1240 TB1560 TB1800 TB Av. CMS12780 HS17600 HS 1000 TB1300 TB T2 requirements for Germany

27. Volker Guelzow | PRC | 28.04.2011 | Page 27 Required T2 Resources > Basic Factors: 1 HepSpec06 including Rackspace, Network, Infrastructure costs 26€ (2011) Invest, est.: 20€ (2012) > Storage: 400$/TB (2011) including space, network, infrastructure > lifetime for CPU: 3 years, storage: 5 years > For calculation: increase + 3 (5) year depreciation > Energy: 25W/TB online; 1,5 W/HS06 CPU 2011[€]2012[€]2013[€] Atlas cpu312.000290.000220.000 Atlas disk720.000760.000600.000 CMS cpu364.000260.000160.000 CMS disk376.000320.000240.000

28. Volker Guelzow | PRC | 28.04.2011 | Page 28 Required T2 Resources (closed session) > For DESY: Finance the NAF (~ 300-400 k€, size of a Tier 2), > Available: basic funding and „Ausbauinvestitionen“ from POF 2011[T€]2011 fund. 2012[T€]2012 fund 2013[T€]2013 fund Atlas cpu 312ok290Half year HA, Desy+ MPI ok 220NO HA funds, Desy+ MPI ok Atlas disk 720ok760600 CMS cpu 364ok260160 CMS disk 376ok320240 ~150 T€/Uni ~75 T€/Uni

29. Volker Guelzow | PRC | 28.04.2011 | Page 29 The German T2‘s HGF Alliance funding for Universities: Pledges for Germany http://lcg.web.cern.ch/LCG/Resources/WLCGResourc es-2010-2012_15DEC2010.pdf CPU 2011 [HS] CPU 2012 [HS] Disk 2011 [TB] Disk 2012 [TB] A DESY6200660010501350 C DESY1180012900640900 A Goettingen38004000400590 C Aachen66008700330435 A Munich92201156010401340 A FR/Wupp46334917633733 A FR/W Freiburg 46105780518668 Summe CMS18400216009701335 Summe Atlas284633285736414701 SumDESY180001950016902250 SumNonDESY288633495729213786 GrandTotAllT2 WW 7253247762036045471998

30. Volker Guelzow | PRC | 28.04.2011 | Page 30 Contribution of Tier 2 and Tier 3 Centres to EGI

31. Volker Guelzow | PRC | 28.04.2011 | Page 31 Summary > The DESY-Grid-Centre is one of the top centres in WLCG > The NAF is very helpfull and used nationwide > The NAF needs further (interactive) options > dCache is the major working horse for LHC datamanagement and DESY has the lead > LHCone is a great chance for changing computing models > DESY has take the leading role for LHCone in Germany > There is an open financing issue for the Universities Tier 2 after id 2012

32. Volker Guelzow | PRC | 28.04.2011 | Page 32 Zusatzslides, Verwendung noch offen.

33. Sue.Foffano@cern.ch 33 12 th April 2011 2011 pledge per experiment and summary status dated 04/10/10 shown at last C-RRB 2011 pledge per experiment and summary status dated 08/04/11 Evolution of pledges since last C-RRB

34. Volker Guelzow | PRC | 28.04.2011 | Page 34 DE-Cloud > ATLAS analysis, per Cloud, last year

35. Volker Guelzow | PRC | 28.04.2011 | Page 35 > Comparison of production (not stacked) DE-Cloud

36. Volker Guelzow | PRC | 28.04.2011 | Page 36 > ATLAS analysis in DE-Cloud  FZK major contribution  DESY HH+ZN strong contribution DESY (HH+ZN)

37. Volker Guelzow | PRC | 28.04.2011 | Page 37 > Production in DE-Cloud DESY (HH+ZN)

38. Volker Guelzow | PRC | 28.04.2011 | Page 38 Transfers TO DESYTransfers FROM DESY Rather good, some issues on dedicated connections

39. Volker Guelzow | PRC | 28.04.2011 | Page 39 Transfers TO DESY From T1 and T2 Transfers FROM DESY TO Tier2s