SPGrid Status in Ferrara and beyond Concezio Bozzi INFN Ferrara La Biodola, May 20th 2003 On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora.

Slides:



Advertisements
Similar presentations
SPGrid Activities in Italy Daniele Andreotti - Enrica Antonioli - Paolo Veronesi BaBarGrid Workshop Padova, Nov 2003.
Advertisements

Claudio Grandi INFN Bologna DataTAG WP4 meeting, Bologna 14 jan 2003 CMS Grid Integration Claudio Grandi (INFN – Bologna)
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
11th December 2002Tim Adye1 BaBar UK Grid Work Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting SLAC 11 th December 2002.
Deployment Team. Deployment –Central Management Team Takes care of the deployment of the release, certificates the sites and manages the grid services.
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL.
INFN - Ferrara BaBarGrid Meeting SPGrid Efforts in Italy BaBar Collaboration Meeting - SLAC December 11, 2002 Enrica Antonioli - Paolo Veronesi.
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
1 Use of the European Data Grid software in the framework of the BaBar distributed computing model T. Adye (1), R. Barlow (2), B. Bense (3), D. Boutigny.
Andrew McNab - Manchester HEP - 26 June 2001 WG-H / Support status Packaging / RPM’s UK + EU DG CA’s central grid-users file grid “ping”
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
BaBar Grid Computing Eleonora Luppi INFN and University of Ferrara - Italy.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
Computational grids and grids projects DSS,
Distribution After Release Tool Natalia Ratnikova.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
Nadia LAJILI User Interface User Interface 4 Février 2002.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
ScotGRID:The Scottish LHC Computing Centre Summary of the ScotGRID Project Summary of the ScotGRID Project Phase2 of the ScotGRID Project Phase2 of the.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
The huge amount of resources available in the Grids, and the necessity to have the most up-to-date experimental software deployed in all the sites within.
CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.
WNoDeS – Worker Nodes on Demand Service on EMI2 WNoDeS – Worker Nodes on Demand Service on EMI2 Local batch jobs can be run on both real and virtual execution.
EDG Testbed installation and configuration with LCFGng Maite Barroso - WP4
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
DataGRID WPMM, Geneve, 17th June 2002 Testbed Software Test Group work status for 1.2 release Andrea Formica on behalf of Test Group.
Ariel Garcia LCG cluster installation, EGEE training, Ariel Garcia - IWR LCG Cluster Installation Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
Portal Update Plan Ashok Adiga (512)
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
August 30, 2002Jerry Gieraltowski Launching ATLAS Jobs to either the US-ATLAS or EDG Grids using GRAPPA Goal: Use GRAPPA to launch a job to one or more.
2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6
Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.
EGEE-0 / LCG-2 middleware Practical.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
Certification and test activity ROC/CIC Deployment Team EGEE-SA1 Conference, CNAF – Bologna 05 Oct
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
INFN - Ferrara BaBar Meeting SPGrid: status in Ferrara Enrica Antonioli - Paolo Veronesi Ferrara, 12/02/2003.
The EDG Testbed The European DataGrid Project Team
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
User Interface UI TP: UI User Interface installation & configuration.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
BaBar-Grid Status and Prospects
The EDG Testbed Deployment Details
Real Time Fake Analysis at PIC
SPGrid Status in Ferrara
Eleonora Luppi INFN and University of Ferrara - Italy
Summary on PPS-pilot activity on CREAM CE
Tim Barrass Split ( ?) between BaBar and CMS projects.
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
First Latin-american Grid Workshop
Alice Software Demonstration
gLite Job Management Christos Theodosiou
The EU DataGrid Fabric Management Services
MonteCarlo production for the BaBar experiment on the Italian grid
Presentation transcript:

SPGrid Status in Ferrara and beyond Concezio Bozzi INFN Ferrara La Biodola, May 20th 2003 On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas Smith

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Hardware status in Ferrara EDG is installed on RH6.2 and RH7.3 nodes PBS queue specific for RedHat 7.3 nodes is defined BaBar VO is authorized to access the INFN RBs in Bologna (cnaf009g.cnaf.infn.it) Resources in Ferrara are visible from the IC RB as well (thanks to David Colling!) RH7.3 resources are accessible by using in your JDL: Requirements=isMember(other.RunTimeEnvironment,"FERRARA") && other.QueueName == "wn73"; An SP5 federation is installed and available: babarbecue.fe.infn.it:: /babar/databases/SP5/BKG/bbrprod/9195/BaBar.BOOT Contains conditions + Dec2001 background collection

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Integration into EDG Pack software in relocable rmps Pack software in relocable rmps Give a tag to software, will be published as RunTimeEnvironment and used in JDL files. Give a tag to software, will be published as RunTimeEnvironment and used in JDL files. Send RPMs and tag to the EDG Integration Team, that will test the rpms on a micro-testbed. If everything OK, they will include them in a new EDG software release. Send RPMs and tag to the EDG Integration Team, that will test the rpms on a micro-testbed. If everything OK, they will include them in a new EDG software release. Each sitemanager will be notified of the new release, and will upgrade his testbed farm. Each sitemanager will be notified of the new release, and will upgrade his testbed farm. Accessory parts to install software via LCFGng are also needed, and are ready since some time (we showed them in Karlsruhe) Accessory parts to install software via LCFGng are also needed, and are ready since some time (we showed them in Karlsruhe)

La Biodola - May 20th Concezio Bozzi - INFN Ferrara An RPM to run Moose has been built and installed “by hand” on RH7.3 worker nodes: An RPM to run Moose has been built and installed “by hand” on RH7.3 worker nodes: ls /opt/babar/ Roo tcl Roo tcl8.0 Contents: Contents: ls /opt/babar/ Roo/ ls /opt/babar/ Roo/ bin etc library shlib src bin etc library shlib src bin: MooseApp (77MB) etc: site.sh (setup envvar like BFROOT, OO_FD_BOOT, LD_LIBRARY_PATH) library: a link to init.tcl (tcl error otherwise…) shlib: shared libraries (37MB) src: tcl files and flat files (16MB)Total RPM: 136MB Building an rpm for Moose Babar release: 1.4GB

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Determining required parts Naively, MooseApp + tcl file obtained with dump mechanism Naively, MooseApp + tcl file obtained with dump mechanism For a number of reasons, we could not obtain the latter For a number of reasons, we could not obtain the latter Shared libraries are also needed Shared libraries are also needed Anything else? Anything else? Use strace/ldd Use strace/ldd The answer is: The answer is: 475 tcl files 475 tcl files 165 flat files 165 flat files 42 shared libraries 42 shared libraries

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Moose was successfully run on RH7.3 worker nodes by using both the INFN-CNAF and IC Resource Brokers Moose was successfully run on RH7.3 worker nodes by using both the INFN-CNAF and IC Resource Brokers JDL script: JDL script: ~/testSPGrid]$ more Moose.jdl Executable = "Moose.csh"; StdOutput = "Moose.out"; StdError = "Moose.err"; InputSandbox = {"Moose.csh", "MooseProductionOptions.tcl", "B0B0bar_generic.dec"}; OutputSandbox = {"Moose.out", "Moose.err"}; Requirements = IsMember(other.RunTimeEnvironment,"FERRARA") && other.QueueName == "wn73"; Assuming Options,.dec and.csh files are built by someone else Assuming Options,.dec and.csh files are built by someone else Running Moose

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Submission via Genius Genius under evaluation by BaBar Genius under evaluation by BaBar Genius portal installed in Ferrara (including MyProxyserver) Genius portal installed in Ferrara (including MyProxyserver) Moose jobs submitted to Ferrara with Genius via IC RB: Moose jobs submitted to Ferrara with Genius via IC RB:

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Next steps Include RPM in EDG release (2.0 by end of the month?) Include RPM in EDG release (2.0 by end of the month?) Upgrade from Roo to roo-X Upgrade from Roo to roo-X This allows us to use virtually any CPU with EDG software installed. This allows us to use virtually any CPU with EDG software installed. Bottleneck: access conditions Bottleneck: access conditions Solution: at least a conditions DB per country/region/Babar site Solution: at least a conditions DB per country/region/Babar site Extend metodology to sites already running Babar software (Wahid Bhimji, Tim Barrass), or to sites using Globus+VDT (Dirk Hufnagel) Extend metodology to sites already running Babar software (Wahid Bhimji, Tim Barrass), or to sites using Globus+VDT (Dirk Hufnagel) Start working on bookkeeping and production tools (Douglas Smith, Marc Kelly, Daniele Andreotti), integration with Grid portals like Genius (Daniele, Concezio) Start working on bookkeeping and production tools (Douglas Smith, Marc Kelly, Daniele Andreotti), integration with Grid portals like Genius (Daniele, Concezio)

Backup

La Biodola - May 20th Concezio Bozzi - INFN Ferrara ~]# rpm -qpi Moose i386.rpm Name : Moose Relocations: /opt/babar Version : 0.1 Vendor: INFN - Ferrara Release : 1 Build Date: Wed 05 Mar :25:32 PM CET Install date: (not installed) Build Host: print.fe.infn.it Group : SPGrid/BaBar Source RPM: Moose src.rpm Size : 2560 License: GNU General Public License (GPL) Packager : INFN - Ferrara URL : Summary : Moose Description : A simple Test RPM for BaBarSPGrid Default Installation creates: /opt/babar/bin/MooseAppFake Installation with --prefix creates: /bin/MooseAppFake Packager : INFN - Ferrara URL : Summary : Moose Description : A simple Test RPM for BaBar SPGrid Default Installation creates: /opt/babar/bin/MooseAppFake Installation with --prefix creates: /bin/MooseAppFakehttp:// Test rpm (1/3)

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Test rpm (2/3) ls /opt/local/linux/6.2/RPMS/WP8/BaBar/ Makefile Moose i386.rpm Makefile Moose i386.rpm more /opt/local/linux/6.2/rpmcfg/BaBar-rpm.h /* BaBar SOFTWARE RPM LIST */ Moose Made some changes to the EDG standard config files on the LCFGng server : Added the WP8/BaBar/ repository Created the BaBar-rpm.h containing the rpm-list for BaBar software.

La Biodola - May 20th Concezio Bozzi - INFN Ferrara Test rpm (3/3) Added to redhat62-cfg.h a BaBar line to set the related repository for automatic updating. RPMDIR/WP8/BaBar:\ rpm -qa |grep Moose Moose ls /opt/babar/bin/ MooseAppFake On the Worker Nodes and Computing Element: Added the following lines to WN-rpm and CE-rpm of LCFGng server config files, in order to install this rpm on the Computing Element and Worker Node: /* BaBar software */ #include "BaBar-rpm.h"