Grid Computing at NIKHEF Shipping High-Energy Physics data, be it simulated or measured, required strong national and trans-Atlantic.

Slides:



Advertisements
Similar presentations
EU DataGrid progress Fabrizio Gagliardi EDG Project Leader
Advertisements

Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
Grid Computing Test beds in Europe and the Netherlands David Groep, NIKHEF
Large-Scale Distributed Computing in the Netherlands a status overview.
Large-Scale Distributed Computing in the Netherlands an overview David Groep, NIKHEF,
The DutchGrid Platform Collaboration of projects from –Computer Science, HEP and service providers Participating and supported projects –Virtual Laboratory.
NIKHEF Testbed 1 Plans for the coming three months.
February 12, 2002 DØRACE 1 Grid activities in NIKHEF Willem van Leeuwen.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Large-Scale Distributed Computing in the Netherlands an overview David Groep, NIKHEF.
CERN Krakow 2001 F. Gagliardi - CERN/IT 1 RTD efforts in Europe by Kyriakos Baxevanidis Foster cohesion, interoperability, cross- fertilization of knowledge,
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
The LHC Computing Grid Project Tomi Kauppi Timo Larjo.
1 Developing Countries Access to Scientific Knowledge Ian Willers CERN, Switzerland.
Exploiting the Grid to Simulate and Design the LHCb Experiment K Harrison 1, N Brook 2, G Patrick 3, E van Herwijnen 4, on behalf of the LHCb Grid Group.
High Energy Physics At OSCER A User Perspective OU Supercomputing Symposium 2003 Joel Snow, Langston U.
November 7, 2001Dutch Datagrid SARA 1 DØ Monte Carlo Challenge A HEP Application.
NIKHEF Test Bed Status David Groep
23 Oct 2002HEPiX FNALJohn Gordon CLRC-RAL Site Report John Gordon CLRC eScience Centre.
8th November 2002Tim Adye1 BaBar Grid Tim Adye Particle Physics Department Rutherford Appleton Laboratory PP Grid Team Coseners House 8 th November 2002.
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
Jan. 17, 2002DØRAM Proposal DØRACE Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Remote Analysis Station ArchitectureRemote.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Dutch Tier Hardware Farm size –now: 150 dual nodes + scavenging 200 nodes –buildup to ~1500 up-to-date nodes in 2007 Network –now: 2 Gbit/s internatl.
Data Grid projects in HENP R. Pordes, Fermilab Many HENP projects are working on the infrastructure for global distributed simulated data production, data.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
7April 2000F Harris LHCb Software Workshop 1 LHCb planning on EU GRID activities (for discussion) F Harris.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
WP8 Meeting Glenn Patrick1 LHCb Grid Activities in UK Grid WP8 Meeting, 16th November 2000 Glenn Patrick (RAL)
D0RACE: Testbed Session Lee Lueking D0 Remote Analysis Workshop February 12, 2002.
The DutchGrid Platform – An Overview – 1 DutchGrid today and tomorrow David Groep, NIKHEF The DutchGrid Platform Large-scale Distributed Computing.
The Scaling and Validation Programme PoC David Groep & vle-pfour-team VL-e Workshop NIKHEF SARA LogicaCMG IBM.
Key prototype applications Grid Computing Grid computing is increasingly perceived as the main enabling technology for facilitating multi-institutional.
CERN What Happens at CERN? "In the matter of physics, the first lessons should contain nothing but what is experimental and interesting to see. A pretty.
J.J.Blaising April 02AMS DataGrid-status1 DataGrid Status J.J Blaising IN2P3 Grid Status Demo introduction Demo.
…building the next IT revolution From Web to Grid…
NIKHEF Test Bed Status David Groep
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
WLCG and the India-CERN Collaboration David Collados CERN - Information technology 27 February 2014.
NIKHEF CT/ Status NIKHEF (NL). NIKHEFDataGrid/Oxford/July DutchGrid Participation of High-energy Physics Earth observation Computer.
Tiziana FerrariThe DataTAG Projct, Roma Nov DataTAG Project.
119 May 2003HEPiX/HEPNT National Institute for Nuclear Physics and High Energy Physics Coordinates all (experimental) subatomic physics research in The.
Feb. 14, 2002DØRAM Proposal DØ IB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) Introduction Partial Workshop Results DØRAM Architecture.
Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.
LHCb Data Challenge in 2002 A.Tsaregorodtsev, CPPM, Marseille DataGRID France meeting, Lyon, 18 April 2002.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 The EU DataGrid Project Three years.
Feb. 13, 2002DØRAM Proposal DØCPB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Partial Workshop ResultsPartial.
LHC Computing, SPC-FC-CC-C; H F Hoffmann1 CERN/2379/Rev: Proposal for building the LHC computing environment at CERN (Phase 1) Goals of Phase.
EU DataGrid Tutorial NIKHEF, Amsterdam, December 12, 13
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.
Research organization technology David Groep, October 2007.
DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,
J. Templon Nikhef Amsterdam Physics Data Processing Group Large Scale Computing Jeff Templon Nikhef Jamboree, Utrecht, 10 december 2012.
(BiG) Grid: from research to e-Science David Groep, NIKHEF Graphics: Real Time Monitor, Gidon Moont, Imperial College London, see
WLCG Tier-2 Asia Workshop TIFR, Mumbai 1-3 December 2006
“A Data Movement Service for the LHC”
A Dutch LHC Tier-1 Facility
Grid related projects CERN openlab LCG EDG F.Fluckiger
UK GridPP Tier-1/A Centre at CLRC
NIKHEF Data Processing Fclty
High Energy Physics Computing Coordination in Pakistan
LHC Data Analysis using a worldwide computing grid
Gridifying the LHCb Monte Carlo production system
Grid activities in NIKHEF
Proposal for a DØ Remote Analysis Model (DØRAM)
Presentation transcript:

Grid Computing at NIKHEF Shipping High-Energy Physics data, be it simulated or measured, required strong national and trans-Atlantic networking. Within the Netherlands SURFnet, the Adacemic and Research Internet Service Provider, boasts a 10 Gbit/s national backbone. SURFnet interconnects with Géant at 2.5 Gbit/s, and run several links to New York and Chicago’s STARtap. SURFnet also strongly supports network research. In their effort for all-optical net- works, they provide a 2.5 Gbit/s link or lambda to STARLight (Chicago). This link brings us close to major US Laboratories like FermiLab and is an important piece in the research of the EU DataTAG project. It also provides excellent facilities for the experiments running at FNAL. Data shipped over our link to NIKHEF collaborates with various universities and research labs, both in the Netherlands and abroad. Since 1991 we have operated Condor Clusters. Grid research was started in 1999 as part of the WTCW Virtual Laboratory Project, in collaboration with the University of Amsterdam, SARA and AMOLF. Current projects include LHC Computing Grid, DataGrid, DataTAG, CrossGrid and Virtual Lab for E-Science (VL-E). DutchGrid is the platform for Large-Scale Distributed Computing in the Netherlands. It include KNMI, UvA, Free University, SARA, CWI, AMOLF, CMBI, LUMC, leiden, TU Delft, UU, and others. Rev , David Groep, NIKHEF,

More than a decade ago, NIKHEF was one of the first five sites in the world to be on the Web. Developed by Tim Berners-Lee at CERN, Geneva, the web was meant to ease communications within the large High- Energy Physics collaboration emerging at that time. Nowadays, NIKHEF is one of the five first DataGrid centres. Were the web was limited to sharing information, the Grid goes further: sharing computational resources, data storage and large databases without bothering the users with the how and when. Once plugged-in to the Grid, all resources in the world are instantly available to the user. The Grid is widely regarded as the most viable solution to the LHC Computing Challenge. When the Large Hadron Collider (LHC) becomes operational in five years, a unprecedented amount of data not only has to be stored, but also analysed. The estimated amount of data is a few petabyte (10 15 bytes) every year. We estimate that around computers will be needed to process these data. No single computer centre in the world will be able to handle the amount of data produced by LHC. Therefore, the EU DataGrid project has embarked on a research and development project to solve the computational and storage problems on the Grid. As of March 2002, a functional test bed for Grid computing has been deployed around Europe. This test bed was extremely successful for the first Review of the DataGrid project by the EU Commissioners. The current application test bed spans five institutions: CERN (Geneva), NIKHEF (Amsterdam), RAL (UK), IN2P3 (Lyon) and CNAF (Bologna). For this test bed, NIKHEF offered a full suite of services: data storage, gatekeepers to accept jobs, a user interface machine for our users and a network monitoring system. The back-end farm consists of 22 worker CPUs, with more machines on order. In total NIKHEF can avail over more than 500 CPUs and 200 TByte of permanent storage. The Grid Application Cluster in use for DØ Monte-Carlo production and for “external” use by the EU DataGrid (EDG) test bed. This farm is fully installed using EDG fabric management tools: adding a brand- new system is as easy as pressing the power button. A new system, complete with all application software, is up and running in 15 minutes. EU DataGrid sites participating in Test Bed 1