13/05/2004Janusz Martyniak Imperial College London 1 Using Ganga to Submit BaBar Jobs Development Status.

Slides:

Advertisements

Similar presentations

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.

Advertisements

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.

4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.

CERN LCG Overview & Scaling challenges David Smith For LCG Deployment Group CERN HEPiX 2003, Vancouver.

CSF4, SGE and Gfarm Integration Zhaohui Ding Jilin University.

Computing Lectures Introduction to Ganga 1 Ganga: Introduction Object Orientated Interactive Job Submission System –Written in python –Based on the concept.

GRID INTEROPERABILITY USING GANGA Soonwook Hwang (KISTI) YoonKee Lee and EunSung Kim (Seoul National Uniersity) KISTI-CCIN2P3 FKPPL Workshop December 1,

Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.

Batch Production and Monte Carlo + CDB work status Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.

BaBarGrid: Some UK developments Roger Barlow Imperial College 13th September 2002.

Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.

1 Use of the European Data Grid software in the framework of the BaBar distributed computing model T. Adye (1), R. Barlow (2), B. Bense (3), D. Boutigny.

Status of Globus activities within INFN (update) Massimo Sgaravatto INFN Padova for the INFN Globus group

Israel Cluster Structure. Outline The local cluster Local analysis on the cluster –Program location –Storage –Interactive analysis & batch analysis –PBS.

DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.

Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

K. Harrison CERN, 15th May 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Development strategy - Ganga prototype - Release plans - Conclusions.

Ashok Agarwal 1 BaBar MC Production on the Canadian Grid using a Web Services Approach Ashok Agarwal, Ron Desmarais, Ian Gable, Sergey Popov, Sydney Schaffer,

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

K.Harrison CERN, 21st November 2002 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Background and scope - Project organisation - Technology survey - Design -

Tech talk 20th June Andrey Grid architecture at PHENIX Job monitoring and related stuff in multi cluster environment.

K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.

K.Harrison CERN, 6th March 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Aims and design - Progress with low-level software - Progress with Graphical User.

Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.

INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.

CHEP 2003Stefan Stonjek1 Physics with SAM-Grid Stefan Stonjek University of Oxford CHEP th March 2003 San Diego.

INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.

K. Harrison CERN, 25th September 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Project news - Ganga release 1 - Work towards Ganga release 2 - Interaction.

Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.

Ganga A quick tutorial Asterios Katsifodimos Trainer, University of Cyprus Nicosia, Feb 16, 2009.

Andrey Meeting 7 October 2003 General scheme: jobs are planned to go where data are and to less loaded clusters SUNY.

Production Tools in ATLAS RWL Jones GridPP EB 24 th June 2003.

Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.

1 Condor BirdBath SOAP Interface to Condor Charaka Goonatilake Department of Computer Science University College London

© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.

Part Five: Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.

Resource Management Task Report Thomas Röblitz 19th June 2002.

GridPP Dirac Service The 4 th Dirac User Workshop May 2014 CERN Janusz Martyniak, Imperial College London.

The DZero/PPDG Test Bed Test bed composition as of Feb 2002: 3 PC at Fermilab (sammy, samadams, sameggs) Contact: Gabriele Garzoglio 1 PC at Imperial College.

Portal Update Plan Ashok Adiga (512)

INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.

April 27, 2006 The New GANGA GUI 26th LHCb Software Week C L Tan

MICE Configuration DB Janusz Martyniak, Imperial College London MICE CM39 Software Paralell.

© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.

K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.

K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.

INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.

Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group

Manchester Computing Supercomputing, Visualization & eScience Seamless Access to Multiple Datasets Mike AS Jones ● Demo Run-through.

Ganga development - Theory and practice - Ganga 3 - Ganga 4 design - Ganga 4 components and framework - Conclusions K. Harrison CERN, 25th May 2005.

K. Harrison CERN, 21st February 2005 GANGA: ADA USER INTERFACE - Ganga release Python client for ADA - ADA job builder - Ganga release Conclusions.

INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.

The GridPP DIRAC project DIRAC for non-LHC communities.

Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)

First evaluation of the Globus GRAM service Massimo Sgaravatto INFN Padova.

A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.

INFSO-RI Enabling Grids for E-sciencE Status of BLAH Francesco Prelz ( ) JRA1 All-Hands meeting, Nicosia,

Practical using C++ WMProxy API advanced job submission

Data Management and Database Framework for the MICE experiment

BOSS: the CMS interface for job summission, monitoring and bookkeeping

Data Management and Database Framework for the MICE Experiment

BOSS: the CMS interface for job summission, monitoring and bookkeeping

Globus Job Management. Globus Job Management Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.

The Ganga User Interface for Physics Analysis on Distributed Resources

Module 01 ETICS Overview ETICS Online Tutorials

Status and plans for bookkeeping system and production tools

Production Manager Tools (New Architecture)

The DZero/PPDG D0/PPDG mission is to enable fully distributed computing for the experiment, by enhancing SAM as the distributed data handling system of.

Presentation transcript:

13/05/2004Janusz Martyniak Imperial College London 1 Using Ganga to Submit BaBar Jobs Development Status

13/05/2004Janusz Martyniak Imperial College London 2 What is Ganga? It’s a flexible GUI and CLI job submission system designed for Atlan and LHCb experiments It uses Python as the programming language and wxPython graphics toolkit (portable) It’s well structured so adding new code is easy which makes it possible to use in other experiments like BaBar by designing new modules.

13/05/2004Janusz Martyniak Imperial College London 3 Ganga Basics Ganga supported (extendable) set of ‘batch systems’, like pbs, lsf, edg. GLOBUS and Condor support have been added Babar specific application types have been implemented to allow job submission under edg/lcg and GLOBUS

13/05/2004Janusz Martyniak Imperial College London 4 AliBaBar – Job Submission for GLOBUS A command line submission system based on GLOBUS and AFS has been developed at Manchester. The user is supposed to create a standard BaBar setup on AFS and submit a job using a gsub command line tool. A job is submitted to a user specified gatekeeper

13/05/2004Janusz Martyniak Imperial College London 5 GUI for AliBaBar A GUI panel has been designed to facilitate a usage of the alibabar submission tool It allows the user to specify important alibabar parameters necessary to submit a job. It adds multiple job handling using the BaBar specific metadata index which allows to submit jobs to many gatekeepers

13/05/2004Janusz Martyniak Imperial College London 6 GUI for AliBaBar, contd. Jobs can be configured and saved for later submission Standard GANGA job monitoring is available stdout and stderr are saved with a job Jobs may be copied and resubmitted

13/05/2004Janusz Martyniak Imperial College London 7

13/05/2004Janusz Martyniak Imperial College London 8 Current status and plans The system works and is currently being tested Available for user testing soon Future plans include creation of an ‘index editor’, which would allow job selection (at present all jobs in the index/data directory are submitted)

13/05/2004Janusz Martyniak Imperial College London 9 wsGanga ? An experimental version of Ganga based on Web Services has been created It uses Globus GSI enabled SOAP implemented in Python (pyGlobus), a proxy is send from the client to the service along with a remote function call. It’s able to submit “Hello World” jobs.