Frédéric Hemmer, CERN, IT DepartmentThe LHC Computing Grid – September 2007 Wolfgang von Rüden, CERN, IT Department The LHC Computing Grid Frédéric Hemmer.

Slides:



Advertisements
Similar presentations
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Why Grids Matter to Europe Bob Jones EGEE.
Advertisements

Computing for LHC Dr. Wolfgang von Rüden, CERN, Geneva ISEF students visit CERN, 28 th June - 1 st July 2009.
INFSO-RI Enabling Grids for E-sciencE The EGEE project Fabrizio Gagliardi Project Director EGEE CERN, Switzerland Research Infrastructures.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
EGEE is proposed as a project funded by the European Union under contract IST The EGEE International Grid Infrastructure and the Digital Divide.
CERN IT Department CH-1211 Genève 23 Switzerland Visit of Professor Jerzy Szwed Under Secretary of State Ministry of Science and Higher.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Les Les Robertson WLCG Project Leader WLCG – Worldwide LHC Computing Grid Where we are now & the Challenges of Real Data CHEP 2007 Victoria BC 3 September.
Les Les Robertson LCG Project Leader LCG - The Worldwide LHC Computing Grid LHC Data Analysis Challenges for 100 Computing Centres in 20 Countries HEPiX.
1. 2 CERN European Organization for Nuclear Research Founded in 1954 by 12 countries – Norway one of them Today: 20 member states, around 2500 staff –
SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.
Z. Z. Vilakazi iThemba LABS / UCT-CERN Research Centre Curation in Natural sciences.
Frédéric Hemmer, CERN, IT DepartmentThe LHC Computing Grid – October 2006 LHC Computing and Grids Frédéric Hemmer IT Deputy Department Head October 10,
1 Introduction to EGEE-II Antonio Fuentes Tutorial Grid Madrid, May 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
Frédéric Hemmer, CERN, IT Department The LHC Computing Grid – June 2006 The LHC Computing Grid Visit of the Comité d’avis pour les questions Scientifiques.
INFSO-RI Enabling Grids for E-sciencE Geant4 Physics Validation: Use of the GRID Resources Patricia Mendez Lorenzo CERN (IT-GD)
A short introduction to the Worldwide LHC Computing Grid Maarten Litmaath (CERN)
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Related Projects Dieter Kranzlmüller Deputy.
EU-IndiaGrid (RI ) is funded by the European Commission under the Research Infrastructure Programme The EU-IndiaGrid Project Joining.
INFSO-RI Enabling Grids for E-sciencE V. Breton, 30/08/05, seminar at SERONO Grid added value to fight malaria Vincent Breton EGEE.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 25 th April 2012.
The Grid Beyond Physics Bob Jones, CERN EGEE project director.
Ian Bird LCG Deployment Manager EGEE Operations Manager LCG - The Worldwide LHC Computing Grid Building a Service for LHC Data Analysis 22 September 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction EGEE/EGEE-II transition meeting – day 2 Bob Jones, EGEE-II Project Director.
Non-HEP Grid Use of EGEE/GridPP IHEPCCC Meeting (June 06) Peter Watkins  EGEE Virtual Organisations  Grid Utilisation by VOs  Biomed Data Challenges.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE – paving the way for a sustainable infrastructure.
INFSO-RI Enabling Grids for E-sciencE Plan until the end of the project and beyond, sustainability plans Dieter Kranzlmüller Deputy.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
To the Grid From the Web Dr. Francois Grey IT Department, CERN.
1 The LHC Computing Grid – February 2007 Frédéric Hemmer, CERN, IT Department LHC Computing and Grids Frédéric Hemmer Deputy IT Department Head January.
CERN IT Department CH-1211 Genève 23 Switzerland Visit of Professor Karel van der Toorn President University of Amsterdam Wednesday 10 th.
1 e-Infrastructures e-Infrastructures Taking stock and looking ahead an European perspective Bernhard Fabianek European Commission - DG INFSO GÉANT & e-Infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE II: an eInfrastructure for Europe and.
Jürgen Knobloch/CERN Slide 1 A Global Computer – the Grid Is Reality by Jürgen Knobloch October 31, 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE WISDOM in EGEE-2, biomed meeting, 2006/04/28 WISDOM : Grid-enabled Virtual High Throughput.
Ian Bird LHC Computing Grid Project Leader LHC Grid Fest 3 rd October 2008 A worldwide collaboration.
The LHC Computing Grid – February 2008 The Challenges of LHC Computing Dr Ian Bird LCG Project Leader 6 th October 2009 Telecom 2009 Youth Forum.
INFSO-RI Enabling Grids for E-sciencE Porting Scientific Applications on GRID: CERN Experience Patricia Méndez Lorenzo CERN (IT-PSS/ED)
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ian Bird LCG Deployment Area Manager & EGEE Operations Manager IT Department, CERN Presentation to HEPiX 22 nd October 2004 LCG Operations.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
Service, Operations and Support Infrastructures in HEP Processing the Data from the World’s Largest Scientific Machine Patricia Méndez Lorenzo (IT-GS/EIS),
Ian Bird LCG Project Leader WLCG Update 6 th May, 2008 HEPiX – Spring 2008 CERN.
Dr. Andreas Wagner Deputy Group Leader - Operating Systems and Infrastructure Services CERN IT Department The IT Department & The LHC Computing Grid –
LHC Computing, CERN, & Federated Identities
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
EGEE is a project funded by the European Union under contract IST EGEE Summary NA2 Partners April
The LHC Computing Grid Visit of Dr. John Marburger
1 The LHC Computing Grid – April 2007 Frédéric Hemmer, CERN, IT Department The LHC Computing Grid A World-Wide Computer Centre Frédéric Hemmer Deputy IT.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE: Enabling grids for E-Science Bob Jones.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE project and the future of European.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
Top 5 Experiment Issues ExperimentALICEATLASCMSLHCb Issue #1xrootd- CASTOR2 functionality & performance Data Access from T1 MSS Issue.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Introduction to Grids and the EGEE project.
Dr. Ian Bird LHC Computing Grid Project Leader Göttingen Tier 2 Inauguration 13 th May 2008 Challenges and Opportunities.
Bob Jones EGEE Technical Director
WLCG Tier-2 Asia Workshop TIFR, Mumbai 1-3 December 2006
Physics Data Management at CERN
IT Department and The LHC Computing Grid
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Long-term Grid Sustainability
The LHC Computing Challenge
EGEE support for HEP and other applications
The LHC Computing Grid Visit of Her Royal Highness
Visit of US House of Representatives Committee on Appropriations
LHC Data Analysis using a worldwide computing grid
The LHC Computing Grid Visit of Prof. Friedrich Wagner
Overview & Status Al-Ain, UAE November 2007.
The LHC Computing Grid Visit of Professor Andreas Demetriou
Presentation transcript:

Frédéric Hemmer, CERN, IT DepartmentThe LHC Computing Grid – September 2007 Wolfgang von Rüden, CERN, IT Department The LHC Computing Grid Frédéric Hemmer Deputy Head, IT Department 25 October 2007 Visit of Dr Ronald Plasterk, Netherlands Minister of Education, Culture and Science

2 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department The LHC Data Challenge The accelerator will be completed in 2008 and run for years Experiments will produce about 15 Million Gigabytes of data each year (about 20 million CDs!) LHC data analysis requires a computing power equivalent to ~100,000 of today's fastest PC processors Requires many cooperating computer centres, as CERN can only provide ~20% of the capacity

3 The LHC Computing Grid – October 2007 CPU DiskTape

4 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department Solution: the Grid Use the Grid to unite computing resources of particle physics institutes around the world The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations The Grid is an infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe

5 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department How does the Grid work? It makes multiple computer centres look like a single system to the end-user Advanced software, called middleware, automatically finds the data the scientist needs, and the computing power to analyse it. Middleware balances the load on different resources. It also handles security, accounting, monitoring and much more.

6 The LHC Computing Grid – October 2007 Wolfgang von Rüden, CERN, IT Department View of the ATLAS detector (under construction) 150 million sensors deliver data … … 40 million times per second

7 The LHC Computing Grid – October 2007 Wolfgang von Rüden, CERN, IT Department

8 The LHC Computing Grid – October 2007 Wolfgang von Rüden, CERN, IT Department

9 The LHC Computing Grid – October 2007 Wolfgang von Rüden, CERN, IT Department

10 The LHC Computing Grid – October 2007 LHC Computing Grid project (LCG) More than 140 computing centres 12 large centres for primary data management: CERN (Tier-0) and eleven Tier-1s 38 federations of smaller Tier-2 centres 20 countries involved SARA-NIKHEF Frédéric Hemmer, CERN, IT Department

11 The LHC Computing Grid – October 2007 LCG Service Hierarchy Tier-0 – the accelerator centre Data acquisition & initial processing Long-term data curation Distribution of data  Tier-1 centres Canada – Triumf (Vancouver) France – IN2P3 (Lyon) Germany – Forschunszentrum Karlsruhe Italy – CNAF (Bologna) Netherlands – NIKHEF/SARA (Amsterdam) Nordic countries – distributed Tier-1 Spain – PIC (Barcelona) Taiwan – Academia SInica (Taipei) UK – CLRC (Oxford) US – FermiLab (Illinois) – Brookhaven (NY) Tier-1 – “online” to the data acquisition process  high availability Managed Mass Storage –  grid-enabled data service Data-heavy analysis National, regional support Tier-2 – ~120 centres in ~29 countries Simulation End-user analysis – batch and interactive

12 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department

13 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department The new European Network Backbone LCG working group with Tier-1s and national/ regional research network organisations New GÉANT 2 – research network backbone  Strong correlation with major European LHC centres Swiss PoP at CERN

14 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department WLCG Collaboration The Collaboration 4 LHC experiments ~140 computing centres 12 large centres (Tier-0, Tier-1) 38 federations of smaller “Tier-2” centres ~35 countries Memorandum of Understanding Agreed in October 2005, now being signed Resources Focuses on the needs of the four LHC experiments Commits resources each October for the coming year 5-year forward look Agrees on standards and procedures Relies on EGEE and OSG (and other regional efforts)

15 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department Ramp-up to First Physics Run 4x 6x Evolution of installed capacity from April 06 to June 07 Target capacity from MoU pledges for 2007 (due July07) and 2008 (due April 08)

16 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department Impact of the LHC Computing Grid in Europe LCG has been the driving force for the European multi- science Grid EGEE (Enabling Grids for E-sciencE) EGEE is now a global effort, and the largest Grid infrastructure worldwide Co-funded by the European Commission (Cost: ~130 M€ over 4 years, funded by EU ~70M€) EGEE already used for >20 applications, including… Medical Imaging Education, Training Bio-informatics

17 The EGEE project EGEE –Started in April 2004, now in 2 nd phase with 91 partners in 32 countries –3 rd phrase ( ) in preparation Objectives –Large-scale, production-quality grid infrastructure for e-Science –Attracting new resources and users from industry as well as science –Maintain and further improve “gLite” Grid middleware Partners in the Netherlands: FOM/NIKHEF, SARA, UvA, Groningen

18 Applications on EGEE More than 25 applications from an increasing number of domains –Astrophysics –Computational Chemistry –Earth Sciences –Financial Simulation –Fusion –Geophysics –High Energy Physics –Life Sciences –Multimedia –Material Sciences –….. Summary of applications report:

Increasing workloads 32% Still expect factor 5 increase for LHC experiments over next year 19

20 Example: EGEE Attacks Avian Flu EGEE used to analyse 300,000 possible potential drug compounds against bird flu virus, H5N computers at 60 computer centres in Europe, Russia, Asia and Middle East ran during four weeks in April - the equivalent of 100 years on a single computer. Potential drug compounds now being identified and ranked. Neuraminidase, one of the two major surface proteins of influenza viruses, facilitating the release of virions from infected cells. Image Courtesy Ying-Ta Wu, AcademiaSinica.

21 Example: Geocluster industrial application The first industrial application successfully running on EGEE Developed by the Compagnie Générale de Géophysique (CGG) in France, doing geophysical simulations for oil, gas, mining and environmental industries. EGEE technology helps CGG to federate its computing resources around the globe.

22 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department Sustainability Need to prepare for permanent Grid infrastructure Ensure a high quality of service for all user communities Independent of short project funding cycles Infrastructure managed in collaboration with National Grid Initiatives (NGIs) European Grid Initiative (EGI)

23 The LHC Computing Grid – October 2007 Frédéric Hemmer, CERN, IT Department For more information about the Grid: Thank you for your kind attention!

24 The LHC Computing Grid – October 2007 High level services and middleware perspectives Scientific results using grid Application porting and deployment Demos

25 The LHC Computing Grid – October :00 Gridification: Porting New Communities onto the WLCG/EGEE Infrastructure MENDEZ LORENZO, Patricia 09:15 Supporting High Performance Computing Applications over gLite WANG, Chi- Wei 09:30 Performance Analysis of Atmosphere and Ocean Model on EU-IndiaGrid Infrastructure COZZINI, Stefano 09:45 Experiences on Grid Production for GEANT4 LECHNER, Anton 10:00 Status of Fusion Activities in the Grid CASATEJóN, Francisco 11:00 Experience of the running HEP experiments in using the EGEE/LCG infrastructure 11:30 Using the Grid - the BaBar Perspective. WILSON, Fergus 11:50 Experience of the LHC experiments in using the EGEE/LCG infrastructure 14:00 Structural Biology in the context of EGEE CARRERA, Germán 14:20 CSTGrid: a whole genome comparison tool for the identification of coding and non-coding conserved sequences. MIGNONE, Flavio 14:40 Alternative Splicing Prediction on EGEE infrastructure DONVITO, Giacinto 15:00 "High throughput" protein structure prediction application in EUChinaGRID MINERVINI, Giovanni

26 The LHC Computing Grid – October :00 The CompChem VO and a Grid application for spacecraft reenty simulations LAGANA', Antonio 09:20 Application of Gaussian package on the EGEE Grid to chemical reaction study STERZEL, Mariusz 09:40 Modeling star evolution on the GRID CASSISI, Santi 10:00 PSNC Virtual Laboratory system as implementation of remote instrumentation idea MARCIN, Lawenda 11:00 Dissemination and Exploitation of Grids in Earth Science SOM DE CERFF, Wim 11:20 CNES GRID EXPERIENCES AND PLANS FOR SPACE APPLICATIONS COURQUET, Joel 11:40 Large Earthquakes Source & Mechanism Determination CLéVéDé, Eric WEISSENBACH, David 12:00 Simulations and Offline Data Processing for the Auger Experiment CHUDOBA, Jiri