Российский GRID для операций с большими массивами научных данных Ильин В.А. (НИИЯФ МГУ) проекты LCG (LHC Computing GRID) и EGEE (Enabling Grids for E_science in Europe) Таруса, 6 февраля 2004 г.

CERN

Online system Multi-level trigger Filter out background Reduce data volume Online reduction 10 7 Trigger menus Select interesting events Filter out less interesting level 1 - special hardware 40 MHz (40 TB/sec) level 2 - embedded processors level 3 - PCs 75 KHz (75 GB/sec) 5 KHz (5 GB/sec) 100 Hz (100 MB/sec) Data recording & offline analysis

Большой адронный коллайдер (БАК) потоки данных, этапы обработки и анализа ГБ/сек Архивное хранение ГБ/сек Интерактивный физический анализ Подготовка данных для анализа Подготовка данных для анализа детектор Суммарные данные по событию ESD сырые данные Реконструкция события Реконструкция события Моделиро- вание событий Моделиро- вание событий Данные для анализа (выделенные по физ. каналам) Отбор событий и первичная реконструкция Отбор событий и первичная реконструкция ~100 MБ/сек 1-6 ПБ/год тысячи ученых 200 TБ/год ПБ/год 200 MБ/сек РИВК БАК 5-10% Tier1 Tier2

LHC Challenges: Scale (in 2006) Data written to tape ~40 Petabytes/Year and UP (1 PB = 10**9 MBytes) Processing capacity TIPS and UP (1 TIPS = 10**6 MIPS) Typical networks Few Gbps Per Link Lifetime of experiment 2-3 Decades (start in 2007) Users ~ 5000 physicists Software developers ~ 300 (Four Experiments)

MONARC project regional group LHC Computing Model evolving CERN Tier3 physics department    Desktop Germany UK France Italy CERN Tier1 USA Tier1 The opportunity of Grid technology Tier2 Uni a Lab c Uni n Lab m Lab b Uni b Uni y Uni x Russia

Russian Tier2-Cluster Russian regional center for LHC computing Cluster of institutional computing centers with Tier2 functionality and summary resources at % level of the canonical Tier1 center for each experiment (ALICE, ATLAS, CMS, LHCb): analysis; simulations; users data support. Participating institutes: Moscow ITEP, KI, MSU, LPI, MEPhI… Moscow region JINR, IHEP, INR RAS St.Petersburg PNPI RAS, … Novosibirsk BINP SB RAS Coherent use of distributed resources by means of LCG (EDG, VDT, …) technologies. Active participation in the LCG Phase1 Prototyping and Data Challenges (at 5% level) Q42007 CPU kSI (15) Disk TB 712-(16) Tape TB (10)20-(50) Network Mbps /…Gbps/…

Russia in LCG We have started activity in LCG (LHC Computing GRID project) in autumn Russia is joining to the LCG-1 infrastructure now. First SINP MSU, then JINR, ITEP and IHEP. Goal – to have in Russia in Q4 operational segment of world-wide LCG infrastructure and be ready to DataChallenges in Manpower contribution to LCG (started in May 2003): the Agreement is under signing by CERN and Russia and JINR officials, 3 tasks for our responsibility: 1) testing new GRID mw to be used in LCG 2) evaluation of new-on-the-market GRID mw (first task – evaluation of GT3 and WebSphere) 3) common solutions for event generators (event data bases).

LHC Data Challenges Программы генерации модельных (Монте Карло) данных для будущих экспериментов на LHC. Типичная нагрузка на каналы связи сейчас – передача 100 Гбайт данных из Москвы в ЦЕРН за рабочий день  50 Мбит/сек ! Но это не средняя нагрузка – «пиковая»:

LCG is not a development project – F it relies on other grid projects for grid middleware development and support LCG - Goals The goal of the LCG project is to prototype and deploy the computing environment for the LHC experiments Two phases: –Phase 1: 2002 – 2005 –Build a service prototype, based on existing grid middleware –Gain experience in running a production grid service –Produce the TDR for the final system –Phase 2: 2006 – 2008 –Build and commission the initial LHC computing environment

Collaborating Computer Centres Building a Grid  The virtual LHC Computing organizations Grid Alice VO CMS VO

CEWN lhc01.sinp.msu.ru lhc02.sinp.msu.ru НИИЯФ МГУ SE lhc03.sinp.msu.ru Пример использования EDG (LCG) middleware (CMS VO) SINP MSU RB+ Information Index lhc20.sinp.msu.ru Пользователь lhc04.sinp.msu.ru ЦЕРН lxshare0220.cern.ch Падуя grid011.pd.infn.it

EGEE Timeline

Distribution of GRID Service Activities over Europe: Operations Management at CERN; Core Infrastructure Centres (CICs) in the UK, France, Italy, Russia and at CERN, responsible for managing the overall Grid infrastructure; Regional Operations Centres (ROCs), responsible for coordinating regional resources, regional deployment and support of services. Россия: CIC – МГУ, РНЦ КИ, ОИЯИ, ИТЭФ, ИПМ РАН ROC – ИФВЭ, ОИЯИ, ПИЯФ РАН, ИМПБ РАН

Pan-European Multi-Gigabit Backbone (33 Countries) January 2004 Planning Underway for “GEANT2” (GN2) Multi-Lambda Backbone, to Start In 2005

International Committee for Future Accelerators (ICFA) Standing Committee on Inter-Regional Connectivity (SCIC) ICFA SCIC Reports Networking for High Energy and Nuclear Physics - Feb/2004 ( Doc - A4 / Pdf - A4 )DocA4PdfA4 Report on the Digital Divide in Russia - Feb/2004 ( Doc - A4 / Pdf - A4 )DocA4PdfA4 Network Monitoring Report - Feb/2004 ( Doc - A4 / Pdf - A4 )DocA4PdfA4 Advanced Technologies Interim Report - Feb/2003 ( Doc )Doc Digital Divide Executive Report - Feb/2003 ( Doc )Doc

GLORIAD: Global Optical Ring (US-Ru-Cn) Also Important for Intra-Russia Connectivity “ Little Gloriad ” (OC3) Launched January 12; to OC192 in 2005

SCIC Monitoring WG – Throughput Improvements Bandwidth of TCP < MSS/(RTT*Sqrt(Loss)) (1) 1) Matthis et al., Computer Communication Review 27(3), July 1997 ( 1) Matthis et al., Computer Communication Review 27(3), July % annual improvement Factor ~100/10 yr Progress: but Digital Divide is Mostly Maintained Some Regions ~5-10 Years Behind SE Europe and Parts of Asia May be Catching Up (Slowly)

GLORIAD 10 Gbps Moscow 1 Gbps IHEP 8 Mbps (m/w), under construction 100 Mbps fiber-optic (Q1-Q2 2004?) JINR 45 Mbps, Mbps (Q1-Q2 2004), Gbps ( ) INR RAS 2 Mbps+2x4Mbps(m/w) BINP 1 Mbps, 45 Mbps (2004 ?), … PNPI 512 Kbps (commodity), and 34 Mbps f/o but budget is only for 2 Mbps (!) USA NaukaNET 155 Mbps GEANT 155 Mbps basic link, plus 155 Mbps additional link for GRID projects Japan through USA by FastNET, 512 Kbps Novosibirsk(BINP) - KEK REGIONAL and INTERNATIONAL CONNECTIVITY for RUSSIA High Energy Physics