Presentation is loading. Please wait.

Presentation is loading. Please wait.

Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during 2010- 2016 V.V.

Similar presentations


Presentation on theme: "Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during 2010- 2016 V.V."— Presentation transcript:

1 Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during 2010- 2016 V.V. Ivanov Laboratory of Information Technologies, JINR Programme Advisory Committee for Particle Physics 30th meeting, 29-30 January 2009

2 V.V.Ivanov (LIT, JINR) Strategic items of LIT activity within JINR Roadmap A well developed, corresponding to the nowadays requirements, telecommunication, networking, and computing infrastructure A well developed, corresponding to the nowadays requirements, telecommunication, networking, and computing infrastructure The data analysis will require massive distributed CPU power with huge data storage facilities connected together through high bandwidth links, as well as new mathematical methods for extracting insightful information from experimental data. The data analysis will require massive distributed CPU power with huge data storage facilities connected together through high bandwidth links, as well as new mathematical methods for extracting insightful information from experimental data. The home made implementations of open software, together with their quality assessment through specific validation procedures, are cornerstones of an activity devoted to the minimization of the financial effort. This is particularly important for successful realization of JINR new home projects and participation of JINR in future large scale projects such as FAIR complex, Super-LHC, International Linear Collider (ILC), etc. The home made implementations of open software, together with their quality assessment through specific validation procedures, are cornerstones of an activity devoted to the minimization of the financial effort. This is particularly important for successful realization of JINR new home projects and participation of JINR in future large scale projects such as FAIR complex, Super-LHC, International Linear Collider (ILC), etc. Training of high-skilled IT specialists: Training of high-skilled IT specialists: - user training and support; - user training and support; - student specialization, preparation of diploma and master theses at the 2 MIREA chairs and 1 chair of Dubna University working on the LIT basis; - student specialization, preparation of diploma and master theses at the 2 MIREA chairs and 1 chair of Dubna University working on the LIT basis; - preparation of PhD and DSc theses; - preparation of PhD and DSc theses; - organization of dedicated periodic Schools, Conferences, Workshops, tutorials - organization of dedicated periodic Schools, Conferences, Workshops, tutorials

3 V.V.Ivanov (LIT, JINR) Development of the JINR Grid-environment The formation of a unified Grid- environment of the JINR Member States is a pillar of the 7-year plan within the direction “Networks. Computing. Computational Physics”. Three main levels within the Grid- environment: network, resource and applied.

4 V.V.Ivanov (LIT, JINR) Network level developments of the JINR Grid-infrastructure Telecommunication channels The development and upgrade of the JINR telecommunication links include a wide spectrum of activities focused on the growth of the cooperation with the Russian Satellite Communications Company (RSCC), the development of a high-speed network infrastructure in Russia, the improvement of the system of international computer channels for science and education in Russia, the data links with the JINR-participating countries. JINR partners networks – RBNet, RASNet, RUNNet, RUHEP in Russia, and GEANT2 JINR-Moscow channel In 2008, an agreement was concluded between JINR and RSCC on the rent of optical fiber cable for the provision of optical communication links between Moscow and Dubna on the basis of state-of-the-art technologies DWDM and 10Gb Ethernet. The channel is planned to be launched in 2009 with a capacity of 20 Gbps. The mentioned technologies allow one to create up to 72 channels of 10 Gbps each, and to raise the total throughput up to 720 Gbps.

5 V.V.Ivanov (LIT, JINR) Network level developments of the JINR Grid-infrastructure

6 V.V.Ivanov (LIT, JINR) Resource level developments of the JINR Grid-infrastructure Today the requirements of the LHC experiments stimulate the development of a global Grid- infrastructure, together with the resource centers of all the cooperating organizations. First of all, this is of primary concern for such large research centers as the JINR. To reach effective processing and analysis of the experimental data, further increase in the JINR CICC performance and disk space is needed. Computing clusters and data storage systems The kernel - the high-efficiency computing clusters and the data storage systems of the JINR Central Information and Computing Complex Center of primary Grid-services (CPGS): manage the joint Grid-infrastructure, manage the joint Grid-infrastructure, coordinate functioning of geographically distributed resource centers, coordinate functioning of geographically distributed resource centers, gLite middleware at the initial stage as a platform for the CPGS construction. gLite middleware at the initial stage as a platform for the CPGS construction. Information and primary software

7 Tier 0 – Tier 1 – Tier 2 Ian.Bird@cern.ch 7 Tier-0 (CERN): Data recording Initial data reconstruction Data distribution Tier-1 (11 centres): Permanent storage Re-processing Analysis Tier-2 (>200 centres): Simulation End-user analysis

8 V.V.Ivanov (LIT, JINR) Central Information and Computing Complex ( JINR Central Information and Computing Complex (CICC) Development of JINR CICC and Grid segment in accordance with experiment requirements Development of JINR CICC and Grid segment in accordance with experiment requirements Raising the computing cluster performance Raising the computing cluster performance Expansion of the disk storage system Expansion of the disk storage system Creation of the data storage system of Active tape type Creation of the data storage system of Active tape type Upgrade of the local CICC network up to 10 Gbps Upgrade of the local CICC network up to 10 Gbps Development of the servers maintaining the JINR Grid segment and computing cluster Development of the servers maintaining the JINR Grid segment and computing cluster Development and modernization of the servers of the JINR information structure and the general storage system (dCachе, WEB, database servers) Development and modernization of the servers of the JINR information structure and the general storage system (dCachе, WEB, database servers)

9 V.V.Ivanov (LIT, JINR) Central Information and Computing Complex In 2007, total CICC performance was 670 kSI2K, the disk storage capacity 100 TB At present, the CICC performance equals 1400 kSI2K and the disk storage capacity 100 TB Feb 2009 Dec 2009 CPU(kSI2K)20002400 Disk (TB)400800 Tapes(TB)-100 The unit of computing power 2.5 kSI2K corresponds to 1 core of Intel Xeon 2.8 GHz processor New CICC structure after the equipment installation New equipment was purchased at the end of 2008 under the FASI Contract “Working out the computing system for development of the Grid-complex RuTier2/RDIG for carrying out by the Russian institutes the distributed data analysis for the LHC experiments as a part of global Grid-system WLCG/EGEE”

10 V.V.Ivanov (LIT, JINR) Central Information and Computing Complex ( JINR Central Information and Computing Complex (CICC)

11 V.V.Ivanov (LIT, JINR) 594 Registered users Total registered 17 experiments Special groups for COMPASS (8), NA48(1), H1(1), ATLAS(77), CMS(31), ALICE(28), LHCb, HARP(9), COMPASS, DIRAC(7), D0(3), NEMO(7), OPERA(4), STAR(2), KLOD(1), FOTON-2(3), PANDA Statistics by Laboratories and groups (Jan-Dec 2008, Jobs number, batch mode)

12 V.V.Ivanov (LIT, JINR) CPU time Jobs Statistics by Laboratories and experiments (Jan-Мау 2008, CPU time, Jobs number, batch mode)

13 V.V.Ivanov (LIT, JINR) GRID USERS CPU TIME JOBS Statistics by Grid Virtual organizations (Jan-Мау 2008, CPU time, Jobs number, batch mode) Jan – May, 2008 Local jobs: 15777 Local CPU time: 636928,34 Grid-jobs: 166072 Grid CPU time: 465551,6

14 V.V.Ivanov (LIT, JINR) RDIG monitoring&accounting http://rocmon.jinr.ru:8080 Monitored values CPUs - total /working / down/ free / busy Jobs - running / waiting Storage space - used / available Network - Available bandwidth Accounting values Number of submitted jobs Used CPU time Totally sum in seconds Normalized (with WNs productivity) Average time per job Waiting time Totally sum in seconds Average ratio waiting/used CPU time per job Physical memory Average per job JINR CICC

15 V.V.Ivanov (LIT, JINR) JINR-LCG2 in RDIG January – December 2008 JINR - 40% of total RDIG CPU time Normalised CPU time per VO at JINR site

16 V.V.Ivanov (LIT, JINR) EGEE SITES: LHC VOs (ALICE, ATLAS, CMS and LHCb) Normalised CPU time by SITE January - December 2008 1 FZK-LCG 2 10 789 847 2FR-IN2P3-CC-T2 9 240 828 3 TRIUMF-LCG 2 8 943 436 4FR-GRIF 8 494 954 5IN2P3-CC 8 110 970 6CERN-PROD 7 338 478 7NIKHEF-ELPROD 5 911 178 8 RAL-LCG 2 5 697 630 9RWTH-Aachen 5 007 741 10NDGF-T1 4 340 753 11PIC 4 222 953 12JINR-LCG2 4 220 150 Statistics obtained from the EGEE Accounting Portal: http://www3.egee.cesga.es/gridsite/accounting/CESGA/egee_view.html

17 V.V.Ivanov (LIT, JINR) Further participation in the WLCG project Support and development of the JINR WLCG-segment in frames of global WLCG infrastructure; Support and development of the JINR WLCG-segment in frames of global WLCG infrastructure; Participation in Service/Data Challenges in coordination with LHC experiments; Participation in Service/Data Challenges in coordination with LHC experiments; WLCG middleware testing/evaluation; WLCG middleware testing/evaluation; Grid-monitoring the LCG-infrastructure at JINR and other sites of the Russian Tier2 cluster; Grid-monitoring the LCG-infrastructure at JINR and other sites of the Russian Tier2 cluster; Evaluation of new Grid technologies in context of their usage in WLCG; Evaluation of new Grid technologies in context of their usage in WLCG; MCDB development (data base structure; basic modules; MCDB development (data base structure; basic modules; Participation in ARDA activities in coordination with experiments; Participation in ARDA activities in coordination with experiments; JINR WLCG web-portal improvement; JINR WLCG web-portal improvement; User’s support to stimulate their active usage of WLCG resources (courses, lectures, trainings, publication of user guides in Russian); User’s support to stimulate their active usage of WLCG resources (courses, lectures, trainings, publication of user guides in Russian); Support of JINR member states in WLCG activities. Support of JINR member states in WLCG activities.

18 V.V.Ivanov (LIT, JINR) Resource level developments of the JINR Grid-infrastructure

19 V.V.Ivanov (LIT, JINR) Foreseen expenses during 2010–2016 States. The funding of the foreseen payments will be done at the expense of both the LIT budget provisions and within special purpose funding coming from the collaboration and international cooperation with the JINR Member States.

20 V.V.Ivanov (LIT, JINR) Applied level developments of the JINR Grid-environment (I) 1.The applied level covers the user applications working in a virtual organization (VO) environment which comprises both users and owners of computing resources. 2.In the existing Grid-systems, a VO defines a collaboration of specialists in some area, who combine their efforts to achieve a common aim. 3.The virtual organization is a flexible structure that can be formed dynamically and may have a limited life-time. VOs working within the WLCG project are the VOs on the LHC experiments - ATLAS, CMS, Alice, LHCb, the first three being carried out with the noticeable and direct participation of the JINR. Nowadays, as a Grid-segment of the EGEE/RDIG, the JINR CICC supports computations of the virtual organizations registered in RDIG ( LHC experiments, BioMed, PHOTON, eEarth, Fusion, HONE, Panda. VOs working within the WLCG project are the VOs on the LHC experiments - ATLAS, CMS, Alice, LHCb, the first three being carried out with the noticeable and direct participation of the JINR. Nowadays, as a Grid-segment of the EGEE/RDIG, the JINR CICC supports computations of the virtual organizations registered in RDIG ( LHC experiments, BioMed, PHOTON, eEarth, Fusion, HONE, Panda. In the future, as the interest arises at a large-scale level, VOs can be organized at JINR in the fields of nuclear physics and condensed matter physics and, most probably, in the new promising direction related to the research of the nanostructure properties. In the future, as the interest arises at a large-scale level, VOs can be organized at JINR in the fields of nuclear physics and condensed matter physics and, most probably, in the new promising direction related to the research of the nanostructure properties.

21 V.V.Ivanov (LIT, JINR) The creation of new VOs gets possible and necessary under maturation of the algorithmic approaches to the problem solution, the development of corresponding mathematical methods and tools: methods and tools for simulation of physical processes and analysis of experimental data software and computer complexes for experimental data processing; methods and tools for simulation of physical processes and analysis of experimental data software and computer complexes for experimental data processing; numerical methods, algorithms and software for modeling complex physical systems; numerical methods, algorithms and software for modeling complex physical systems; methods, algorithms and software of computer algebra; methods, algorithms and software of computer algebra; new computing paradigms; new computing paradigms; adaptation of specialized software for solving problems within the Grid- environment. adaptation of specialized software for solving problems within the Grid- environment. Applied level developments of the JINR Grid-environment (II)

22 V.V.Ivanov (LIT, JINR) Applied level developments of the JINR Grid-environment (III)

23 V.V.Ivanov (LIT, JINR) Formation of the Grid environment of the JINR-Member States Creation of the Grid environment of the JINR-participating countries. It will allow to bring out the research underway at JINR in the field of high energy physics, nuclear physics, solid state physics and condensed matter physics, biophysics, biosensor (nano)technologies, etc., on a qualitatively new level. Basic directions: Creation of a working group of the representatives of the JINR-participating countries for the development of the main directions of the activity toward forming a joint Grid environment. Creation of a working group of the representatives of the JINR-participating countries for the development of the main directions of the activity toward forming a joint Grid environment. Investigation, together with the JINR Member States, of the basic directions of activity toward forming the joint Grid environment. Investigation, together with the JINR Member States, of the basic directions of activity toward forming the joint Grid environment. Preparation of corresponding multi-side agreements. Preparation of corresponding multi-side agreements. Development of the network level of the Grid environment of the JINR Member States. Development of the network level of the Grid environment of the JINR Member States. Development of the resource level of the Grid environment of the JINR Member States. Development of the resource level of the Grid environment of the JINR Member States. Formation of the applied level of the Grid environment of the JINR Member States. Formation of the applied level of the Grid environment of the JINR Member States. Preparation and implementation of joint projects. Preparation and implementation of joint projects.

24 V.V.Ivanov (LIT, JINR) Staff Total 298 (http://pin.jinr.ru) Total 298 (http://pin.jinr.ru)http://pin.jinr.ru 225 - Scientific staff + engineers 225 - Scientific staff + engineers –25 doctor of science –63 candidate of science –44 from JINR Member States 73 - Technicians 73 - Technicians

25 V.V.Ivanov (LIT, JINR) Thank you for your attention !


Download ppt "Laboratory of Information Technologies Proposal of the Laboratory of Information Technologies to the plan for the JINR development during 2010- 2016 V.V."

Similar presentations


Ads by Google