Download presentation
Presentation is loading. Please wait.
Published byEugene Briggs Modified over 8 years ago
1
14/03/2007A.Minaenko1 ATLAS computing in Russia A.Minaenko Institute for High Energy Physics, Protvino JWGC meeting 14/03/07
2
14/03/2007A.Minaenko2 ATLAS RuTier-2 tasks The main RuTier-2 task is providing facilities for physics analysis using mainly AOD, DPD and user derived data formats It includes also development of reconstruction algorithms using subsets of ESD and Raw All the data used for analysis should be stored on disks and some unique data (user, group DPD) to be saved on tapes also as well as previous AOD/DPD versions The second important task is production and storage of MC simulated data The ATLAS computing model implies that simulated data are stored mainly in Tiers-1 but for RuTier-2 model we assume to take the responsibility for the storage of locally produced MC data
3
14/03/2007A.Minaenko3 Data taking conditions and data sizes Luminosity – 0.5*10 33 cm -2 sec -1 in 2007 – 2.0*10 33 cm -2 sec -1 in 2008, 2009 – 10 34 cm -2 sec -1 in 1010 and after Event rate200 events/sec Event nums1 in 2007, 2 each next year (*10 9 ) 0.14 (2007), 0.8 ( 2008), 1.2 ( 2009) Raw 1.6 MB/event ESD0.5 MB/event AOD0.1 MB/event RawSim2.0 MB/event Reconstruction 15 kSI2k*sec/event Simulation200 kSI2k*sec/event 500 kSI2k*sec/event Analysis 0.5 kSI2k*sec/event Luminosity increase in 2010 leads to the event size increase by 50% and reconstruction time by 75%
4
14/03/2007A.Minaenko4 Evolution of RAW data, ESD, AOD sizes in ATLAS RuTier-2
5
14/03/2007A.Minaenko5 Cost table 2006 2007 2008 2009 2010 2011 2012 Disc (CHF/GB) 3.14 1.96 1.22 0.77 0.48 0.3 0.19 ATape (CHF/GB) 2.5 1.25 0.9 0.6 0.4 0.4 0.4 CPU (CHF/SI2k) 0.67 0.44 0.3 0.19 0.14 0.09 0.06 Used lifetimes for the different types of resources: CPU - 3 years Disk- 4 years Tape- 5 years Commissioning: 80% of the resources 2007 are moved to 2006 30% of the resources 2008 are moved to 2007
6
14/03/2007A.Minaenko6 Some input numbers to estimate simulation and analysis resources Simulation –Number of events – 20% of real data –Contribution of RuTier-2 to total statistics of all MC data – 10% –Efficiency of CPU usage – 85% –All types of data to be saved on automated tapes –All ESD, AOD and 20% of Raw simulated data to be kept on disks permanently Analysis –Number of active users – 50 – 5% of total Raw data and 10% of ESD are permanently kept of disks to be used for algorithm developments and analysis –Volume of group DPD data is equal to 50% of AOD data –Volume of user data – 1 TB per user for 2008 data only and varies proportionally to events number –CPU power needed to analyze 2*10 9 data only by one user – 15 kSI2k (20) –Total CPU power is proportional to the number of accumulated events and to the number of users
7
14/03/2007A.Minaenko7 Resources and costs for data simulation and analysis in ATLAS RuTier-2
8
14/03/2007A.Minaenko8 Evolution of total CPU (kSI2k), disk, tape resources in ATLAS RuTier-2
9
14/03/2007A.Minaenko9 Yearly added costs of total CPU, disk, tape resources in ATLAS RuTier-2
10
14/03/2007A.Minaenko10 ATLAS RuTier-2 now and plans for 2007-2008 The requested resources for 2007, 2008, 2009 are: –Disks 120 TB280 TB610 TB –Tapes 30 TB 70 TB170 TB –CPU 320 kSI2k780 kSI2k1500 kSI2k We have now for all 4 LHC experiments –Discs70-80 TB –Tapes 0 TB (?) –CPU250-300 kSI2k in use – 2000 kSI2k purchased but not installed yet Present CPU resources are almost sufficient even for 2008 Disc resources are a real problem: non-sufficient in volume, distributed non-uniformly, only part of them can be really used efficiently
11
14/03/2007A.Minaenko11 Usage of RuTier-2 CPU resources April06-March07
12
14/03/2007A.Minaenko12 ATLAS in RuTier2 April06-March07 The data obtained using RDIG Monitoring and Accounting System based on MonALISA For the period April06-March07 ATLAS VO consumed 12994 kSI2k*days (36% of total consumed RuTier-2 CPU resource) The main contribution to the ATLAS production is done by IHEP (47%) and PNPI (33%) The data include all ATLAS jobs. Official production ATLAS jobs consume only a minor part of total consumed CPU time.
13
14/03/2007A.Minaenko13 ATLAS RuTier-2 in SARA cloud The sites of RuTier-2 are associated with SARA ATLAS Tier-1 Now 4 sites IHEP, ITEP, JINR, SINP are included in TiersOfAtlas list and FTS channels are tuned for the sites The request to include PNPI was sent and this is in progress 3 sites (IHEP, ITEP, SINP) successfully participated in 2006 in data transfer functional tests. This is a coherent data transfer test Tier-0 →Tiers-1→Tiers-2 for all clouds, using existing SW to generate and replicate data and to monitor data flow. The activity will be continued in 2007 and more RuTier-2 sites will be involved Other current ATLAS activity is replication of produced AOD from Tiers-1 to Tiers-2 according to ATLAS computing model. It is done using FTS and subscription mechanism. Total AOD+NTUPs volume is 7.3 TB now. RuTier-2 sites (except ITEP) do not participate in the activity now because of the lack of free disk space. It is planned to begin the replication after the end of March data transfer tests (in a week or two)
14
14/03/2007A.Minaenko14 Tier-1 Tier-2s Sept 06 Oct 06 Nov 06 ASGC IPAS, Uni MelbourneFailed within the cloud Failed for Melbourne T1-T1 not testd BNL GLT2, NET2,MWT2,SET2, WT2done 2+GB & DPM CNAF LNF,Milano,Napoli,Roma165% failure rate done FZK CSCS, CYF, DESY-ZN, DESY-HH, FZU, WUPFailed from T2 to FZK dCache problem T1-T1 not testd LYON BEIIJING, CPPM, LAPP, LPC, LPHNE, SACLAY, TOKYOdonedone, FTS conn =< 6 NG not tested PIC IFAE, IFIC, UAMFailed within the cloud done RAL CAM, EDINBOURGH, GLASGOW, LANCS, MANC, QMUL Failed within the cloud Failed for Edinbrg. done SARA IHEP, ITEP, SINPFailedIHEP not tested IHEP in progress TRIUMF ALBERTA, TORONTO, UniMontreal, SFU, UVICFailed within the cloud FailedT1-T1 not testd ATLAS DDM functional tests in 2006
15
14/03/2007A.Minaenko15
16
14/03/2007A.Minaenko16
17
14/03/2007A.Minaenko17
18
14/03/2007A.Minaenko18
Similar presentations
© 2024 SlidePlayer.com Inc.
All rights reserved.