CERN LCG1 to LCG2 Transition Markus Schulz LCG Workshop March 2004.

Slides:



Advertisements
Similar presentations
LCG WLCG Operations John Gordon, CCLRC GridPP18 Glasgow 21 March 2007.
Advertisements

Alessandro Italiano INFN – CNAF 26/09/2003 1/5 Status of the INFN - EDG testbeds Alessandro Italiano 7th DataGrid Conference.
1 User Analysis Workgroup Update  All four experiments gave input by mid December  ALICE by document and links  Very independent.
1 Seven Steps to Test Automation Success by Bret Pettichord Presented by Wen Yin.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
Stefano Belforte INFN Trieste 1 CMS SC4 etc. July 5, 2006 CMS Service Challenge 4 and beyond.
Term 2, 2011 Week 3. CONTENTS The physical design of a network Network diagrams People who develop and support networks Developing a network Supporting.
RLS Tier-1 Deployment James Casey, PPARC-LCG Fellow, CERN 10 th GridPP Meeting, CERN, 3 rd June 2004.
Overview of day-to-day operations Suzanne Poulat.
Monitoring in EGEE EGEE/SEEGRID Summer School 2006, Budapest Judit Novak, CERN Piotr Nyczyk, CERN Valentin Vidic, CERN/RBI.
11/30/2007 Overview of operations at CC-IN2P3 Exploitation team Reported by Philippe Olivero.
Steve Traylen Particle Physics Department EDG and LCG Status 9 th December 2003
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid Monitoring Tools Alexandre Duarte CERN.
INFSO-RI Enabling Grids for E-sciencE Integration and Testing, SA3 Markus Schulz CERN IT JRA1 All-Hands Meeting 22 nd - 24 nd March.
CERN Using the SAM framework for the CMS specific tests Andrea Sciabà System Analysis WG Meeting 15 November, 2007.
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
Preparation for Integration Organized access to the code WP6 infrastructure (MDS-2, RC, …) Input from WPs on requirements,... Acquire experience with Globus.
Grid Deployment Board – 10 February GD LCG Workshop Goals Give overview where we are Stimulate cooperation between the centres Improve the communication.
DataGRID Testbed Enlargement EDG Retreat Chavannes, august 2002 Fabio HERNANDEZ
Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Site Management & Support for 1.2 Technical Problems Other Problems What is a Sysadmin? What is wrong with the way we work? Me as a Site Manger Me as an.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
8 th CIC on Duty meeting Krakow /2006 Enabling Grids for E-sciencE Feedback from SEE first COD shift Emanoil Atanassov Todor Gurov.
Site Validation Session Report Co-Chairs: Piotr Nyczyk, CERN IT/GD Leigh Grundhoefer, IU / OSG Notes from Judy Novak WLCG-OSG-EGEE Workshop CERN, June.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
The following is a collection of slides from a few recent talks on computing for ATLAS in Canada, plus a few new ones. I might refer to all of them, I.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Certification and test activity ROC/CIC Deployment Team EGEE-SA1 Conference, CNAF – Bologna 05 Oct
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Last update 31/01/ :41 LCG 1 Maria Dimou Procedures for introducing new Virtual Organisations to EGEE NA4 Open Meeting Catania.
Service Availability Monitor tests for ATLAS Current Status Tests in development To Do Alessandro Di Girolamo CERN IT/PSS-ED.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
Site Certification Process (Round Table) Fabio Hernandez IN2P3 Computing Center - Lyon October
CERN Running a LCG-2 Site – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
INFSO-RI Enabling Grids for E-sciencE gLite Certification and Deployment Process Markus Schulz, SA1, CERN EGEE 1 st EU Review 9-11/02/2005.
TP: Grid site installation BEINGRID site installation.
CERN Deployment & Experiment Integration Flavia Donno & Markus Schulz LCG LCG Review 24 November 2003.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
INFN GRID Production Infrastructure Status and operation organization Cristina Vistoli Cnaf GDB Bologna, 11/10/2005.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
The GridPP DIRAC project DIRAC for non-LHC communities.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
II EGEE conference Den Haag November, ROC-CIC status in Italy
– n° 1 Grid di produzione INFN – GRID Cristina Vistoli INFN-CNAF Bologna Workshop di INFN-Grid ottobre 2004 Bari.
WP3 WP3 at Budapest 2/9/2002 Steve Fisher / RAL. WP3 Steve Fisher/RAL - 2/9/2002WP3 at Budapest2 Summary News –EDG Retreat –EDG Tutorials –Quality –Release.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
INFSO-RI Enabling Grids for E-sciencE FTS Administrators Tutorial for Tier-2s Paolo Badino
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
5/12/06T.Kurca - D0 Meeting FNAL1 p20 Reprocessing Introduction Computing Resources Architecture Operational Model Technical Issues Operational Issues.
The CMS Beijing Tier 2: Status and Application Xiaomei Zhang CMS IHEP Group Meeting December 28, 2007.
SRM v2.2: service availability testing and monitoring SRM v2.2 deployment Workshop - Edinburgh, UK November 2007 Flavia Donno IT/GD, CERN.
Regional Operations Centres Core infrastructure Centres
NGI and Site Nagios Monitoring
Operations Status Report
Brief overview on GridICE and Ticketing System
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
WARNING These slides are not optimized for printing or exam preparation. These are for lecture delivery only. These slides are made for PowerPoint 2010.
Pierre Girard ATLAS Visit
The EU DataGrid Fabric Management Services
Site availability Dec. 19 th 2006
Presentation transcript:

CERN LCG1 to LCG2 Transition Markus Schulz LCG Workshop March 2004

CERN Overview LCG2 what is different LCG1 -> LCG2 Discussion

CERN LCG2 Software –Some changes in the data management –Improved stability in the services –Switch to radical different Ses (SRM) (soon) Operation –Focus now on production quality –Focus on total amount of resources –Focus on stability during the experiment’s data challenges –Focus not primary on number of sites. Installation/Configuration –Now the sites can choose between manual and LCFGng based procedures makes integrating existing resources easier WN, UI, CE, SE, RB, lcg-BDII,(missing PROXY)

CERN LCG2 This lead to the concept of CORE Sites –Well supported sites that can initially follow early releases quickly –Experienced staff that quickly can locate configuration problems –Each site committed to provide significant resources (storage, CPU) –Sites integrate their local computing facilities with LCG Current Core Sites: –CNAF,CERN,FNAL,FZK,NIKHEF,PIC-Barcelona,RAL,Taipei –Total of > 1800CPUs –Improved communications: Core site mailing list weekly phone conference (not workable with 30+ sites)

CERN LCG1->LCG2 Only well tested sites should be added to the core –More testing –Testing by the experiments –Tested and non tested sites should not live in the same environment This avoids faulty sites to atract jobs. Based on the new LCG-BDII we can separate LCG2 into different views. –A view is represented by a configuration file for the BDII –A view can be shared and centrally managed (http) –A site can be present in different views –An RB submits only to sites that are present in the view –Experiments can provide their own configuration files and add/remove resources

CERN LCG1->LCG2 Currently: Views for CMS, LCG2 Production, and LCG2 TestZone. Moving a site from LCG1->LCG2 –Site contacts primary site (CERN in case of an independent sites) –Site installs given tag using the preferred procedure Initially the site installs CEs, WNs, and SEs only using the testZone RB and BDII –Site contacts primary site –Primary sites sends site GIIS name and hostname to the deployment team deployment team adds the site to the TestZone configuration –primary site runs initial checks and solves problems with the site –do simple jobs run? –can the site access storage (local, remote)? –do the datamanagement tools work? –is the experiment software installation mechanism working? –The deployment team runs a test suite on the new site –The experiments will be invited to run their test jobs on the site –The deployment team repeats their tests. –Site is added to the core sites.

CERN New Sites Contact a suitable primary site first Primary site walks the new site through the process There is a problem for new sites to find the correct place to enter the game. We need a link from the top page of LCG

CERN LCG1->LCG2 When? –Should have started last week –Some sites started on their own –Documentation needs to be updated –Validation jobs need to be added to the release Why delayed? –Limited number of persons –Data challenges required a lot of on demand work

CERN Discussion What specific part of the documentation needs improvement? Primary/Secondary sites Initial Testing………..