LNL CMS M.Biasotto, Bologna, 29 aprile 2002 1 LNL Analysis Farm Massimo Biasotto - LNL.

Slides:



Advertisements
Similar presentations
INFN & Globus activities Massimo Sgaravatto INFN Padova.
Advertisements

CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.
LNL CMS M.Biasotto, Padova, 24 aprile Farm monitoring Massimo Biasotto - LNL.
LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
CMS HLT production using Grid tools Flavia Donno (INFN Pisa) Claudio Grandi (INFN Bologna) Ivano Lippi (INFN Padova) Francesco Prelz (INFN Milano) Andrea.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
LNL M.Biasotto, Bologna, 20 novembre Providing the Grid Information Service with information of local farms Massimo Biasotto – INFN LNL Massimo.
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
The EDG Testbed Deployment Details The European DataGrid Project
Physicists's experience of the EGEE/LCG infrastructure usage for CMS jobs submission Natalia Ilina (ITEP Moscow) NEC’2007.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
KNMI Applications on Testbed 1 …and other activities.
DATAGRID ConferenceTestbed0 - resources in Italy Luciano Gaido 1 DATAGRID WP6 Testbed0 resources in Italy Amsterdam March,
F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;
Computational grids and grids projects DSS,
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
ScotGRID:The Scottish LHC Computing Centre Summary of the ScotGRID Project Summary of the ScotGRID Project Phase2 of the ScotGRID Project Phase2 of the.
Grid Workload Management Massimo Sgaravatto INFN Padova.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
May http://cern.ch/hep-proj-grid-fabric1 EU DataGrid WP4 Large-Scale Cluster Computing Workshop FNAL, May Olof Bärring, CERN.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania
DataTAG Work Package 4 Meeting Bologna Simone Ludwig Brunel University 23rd and 24th of May 2002.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
DataTAG: Glue schema test C.Vistoli DataTAG Wp4 Meeting 23/5/2002.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid2Win: Porting of gLite middleware to.
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Daniele Spiga PerugiaCMS Italia 14 Feb ’07 Napoli1 CRAB status and next evolution Daniele Spiga University & INFN Perugia On behalf of CRAB Team.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
WP1 Status and plans Francesco Prelz, Massimo Sgaravatto 4 th EDG Project Conference Paris, March 6 th, 2002.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
Quattor installation and use feedback from CNAF/T1 LCG Operation Workshop 25 may 2005 Andrea Chierici – INFN CNAF
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win Porting of gLite middleware to Windows XP platform
First proposal for a modification of the GIS schema
BaBar-Grid Status and Prospects
The EDG Testbed Deployment Details
Real Time Fake Analysis at PIC
INFNGRID Monitoring Group report
Grid2Win: Porting of gLite middleware to Windows XP platform
Sergio Fantinel, INFN LNL/PD
Scalability Tests With CMS, Boss and R-GMA
CMS report from FNAL demo week Marco Verlato (INFN-Padova)
Gri2Win: Porting gLite to run under Windows XP Platform
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
The EU DataGrid Fabric Management Services
GRID Workload Management System for CMS fall production
Presentation transcript:

LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL

LNL CMS M.Biasotto, Bologna, 29 aprile Hardware available  3 data servers, each with 1.2TB SCSI disk –ready: just to copy DBs as soon as available  Computing nodes for analysis jobs –58 computing nodes available in the farm: use LSF queues to dedicate some of them only for analysis jobs –with LSF, the number of analysis nodes can be easily changed at any time, depending on current needs

LNL CMS M.Biasotto, Bologna, 29 aprile User access to Analysis Farm  How to grant user access to the Analysis Farm?  Short term solution: –local accounts on the farm –immediately feasible, provided a not too high number of users (~20?)  Long term solution: –Grid tools –to be implemented at LNL after tests/developments on Padova CMS testbed –june/july 2002?

LNL CMS M.Biasotto, Bologna, 29 aprile Layout farm CMS: production + analysis FastEth 32 – GigaEth 1000 BT SWITCH N1 FastEth SWITCH S1 S10 N24 N1 FastEth SWITCH N1 N24 S9 To WAN 34 Mbps 2001 ~ 1Gbps 2002 S11 S12 Production computing nodes Analysis computing nodes Production servers Analysis servers GW G1 G2

LNL CMS M.Biasotto, Bologna, 29 aprile Local accounts  User Federation, with all the dataset produced at LNL, is ready and available: cmsfarm012.lnl.infn.it::/data1/MuonUserFed/muon0102/m uon0102.boot  All the data copied on 3 dedicated servers, independent from production servers  2 “gateway” machines for analysis users ready: cmsfarm-agw1.lnl.infn.it cmsfarm-agw2.lnl.infn.it  Analysis Farm web page: http: //cmsfarmgw.lnl.infn.it/analysis_farm/  Still missing: analysis software (ORCA 6.1.0, etc.)

LNL CMS M.Biasotto, Bologna, 29 aprile LNL Grid implementation  Grid components like gatekeeper and storage elements should be setup on dedicated machines, indipendent from production farm –at least 1 of the 3 analysis server could be a storage element –other service machines, like the gatekeeper, taken from current pool of computing nodes –if possible, worker nodes should be in common, or easily switchable from production to grid/analysis  In this way the Grid components can be managed with LCFG and tools provided by WP6, without interferences on the production farm

LNL CMS M.Biasotto, Bologna, 29 aprile Layout farm CMS: production + analysis + grid FastEth 32 – GigaEth 1000 BT SWITCH N1 FastEth SWITCH S1 S10 N24 N1 FastEth SWITCH N1 N24 S9 To WAN 34 Mbps 2001 ~ 1Gbps 2002 S11 S12 Production computing nodes Analysis computing nodes Production servers Analysis servers GW G1 G2 CE S10 S11 SE N1 N24 N1 N1 UI

LNL CMS M.Biasotto, Bologna, 29 aprile CMS Testbed  Setup at LNL of a “CMS dedicated” Grid Testbed (like in Padova) –setup almost completed –it will be used for test/development of CMS Analysis tools  During development it will be completely independent from the farm. In production phase it will be merged with the farm (see previous slide)

LNL CMS M.Biasotto, Bologna, 29 aprile Expected outcome  Identify the best strategy for submitting analysis jobs, for example: –1. send a “compilation job” which creates the executable and stores it on a SE –2. send N analysis jobs (to the same CE), which retrieve the executable and run it  Produce guidelines and all necessary documentation needed by users to effectively carry out analysis in a grid environment  Produce a set of tools to automate the process (scripts, JDL templates,...) –These tools could later be integrated in a Web User Interface (like Genius)