5. Job Submission goncalo@lip.pt Grid Computing.

Slides:



Advertisements
Similar presentations
Workload Management David Colling Imperial College London.
Advertisements

SARA Reken- en NetwerkdienstenToPoS | 3 juni 2007 More efficient job submission Evert Lammerts SARA Computing and Networking Services High Performance.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
Workload management Owen Maroney, Imperial College London (with a little help from David Colling)
INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
FESR Consorzio COMETA - Progetto PI2S2 The gLite Workload Management System Annamaria Muoio INFN Catania Italy
The Grid Constantinos Kourouyiannis Ξ Architecture Group.
Job Submission The European DataGrid Project Team
EGEE is funded by the European Union under contract IST Elena Slabospitskaya IHEP NA3 manager for Russia An inroduction to services provided.
Riccardo Bruno, INFN.CT Sevilla, 10-14/09/2007 GENIUS Exercises.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
Enabling Grids for E-sciencE Grid Computing Back to basics: the concept, the model, the infrastructure… Gonçalo Borges, Mário David, Jorge.
Job Submission The European DataGrid Project Team
Computational grids and grids projects DSS,
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – M. Sgaravatto – n° 1 The EU DataGrid Workload Management System: towards.
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
Enabling Grids for E-sciencE Workload Management System on gLite middleware Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi (Vietnam)
M. Sgaravatto – n° 1 The EDG Workload Management System: release 2 Massimo Sgaravatto INFN Padova - DataGrid WP1
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.
Job Submission The European DataGrid Project Team
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite job submission Fokke Dijkstra Donald.
INFSO-RI Enabling Grids for E-sciencE The gLite Workload Management System Elisabetta Molinari (INFN-Milan) on behalf of the JRA1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Submission Fokke Dijkstra RuG/SARA Grid.
Job Management DIRAC Project. Overview  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you have learned? KEK 10/2012DIRAC Tutorial.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
Enabling Grids for E-sciencE Workload Management System on gLite middleware - commands Matthieu Reichstadt CNRS/IN2P3 ACGRID School, Hanoi.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
EGEE-0 / LCG-2 middleware Practical.
Workload Management System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Command Line Grid Programming Spiros Spirou Greek Application Support Team NCSR “Demokritos”
INFSO-RI Enabling Grids for E-sciencE Job Description Language (JDL) Giuseppe La Rocca INFN First gLite tutorial on GILDA Catania,
INFN - Ferrara BaBar Meeting SPGrid: status in Ferrara Enrica Antonioli - Paolo Veronesi Ferrara, 12/02/2003.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMS tricks & tips – further scripting Giuseppe.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
Job Submission The European DataGrid Project Team
User Interface UI TP: UI User Interface installation & configuration.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
Introduction to Computing Element HsiKai Wang Academia Sinica Grid Computing Center, Taiwan.
FESR Consorzio COMETA - Progetto PI2S2 Jobs with Input/Output data Fabio Scibilia, INFN - Catania, Italy Tutorial per utenti e.
Enabling Grids for E-sciencE Work Load Management & Simple Job Submission Practical Shu-Ting Liao APROC, ASGC EGEE Tutorial.
EU 2nd Year Review – Feb – WP1 Demo – n° 1 WP1 demo Grid “logical” checkpointing Fabrizio Pacini (Datamat SpA, WP1 )
Grid Computing: Running your Jobs around the World
Architecture of the gLite WMS
Job Management Exercises
Workload Management System on gLite middleware
Practical: The Information Systems
EGEE tutorial, Job Description Language - more control over your Job Assaf Gottlieb Tel-Aviv University EGEE is a project.
Job Submission in the DataGrid Workload Management System
Introduction to Grid Technology
Workload Management System
OpenGATE meeting/Grid tutorial, mars 9nd 2005
Job Management with DATA
The EU DataGrid Job Submission Services
The gLite Workload Management System
EGEE Middleware: gLite Information Systems (IS)
The GENIUS portal and the GILDA t-Infrastructure
gLite Job Management Christos Theodosiou
GENIUS Grid portal Hands on
Hands on Session: DAG Job Submission
Job Submission M. Jouvin (LAL-Orsay)
Presentation transcript:

5. Job Submission goncalo@lip.pt Grid Computing – Grid Tutorial 1

JDL language [i2g-ui02.lip.pt ~]# cat onesimple.jdl Jobs are sent to the Resource Broker (RB) by the user and Job specifications are encoded in the “Job Description Language” [i2g-ui02.lip.pt ~]# cat onesimple.jdl JobType = “Normal”; Executable = "./myexecutable"; Arguments = "--config small-file.cfg --data BIG-file.dat"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"small-file.cfg"}; OutputSandbox = {"std.out","std.err","run.log"}; InputData = {“lfn:/grid/VO/user/BIG-file.dat"}; DataAccessProtocol = {"gridftp"}; [i2g-ui02.lip.pt ~]# i2g-job-submit onesimple.jdl goncalo@lip.pt Grid Computing – Grid Tutorial 2

A job submission example Replica Catalogues (RC) Information Service (IS) UI JDL Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 3 3

Job Status: Submitted Replica Catalogues (RC) Information Service (IS) UI JDL Input Sandbox Job Submit Event Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 4 4

Job Status: Waiting Replica Catalogues (RC) Information Service (IS) submitted Information Service (IS) UI JDL waiting Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 5 5

Job Status: Ready Replica Catalogues (RC) Information Service (IS) submitted Information Service (IS) UI JDL waiting ready Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 6 6

Job Status: Scheduled Replica Catalogues (RC) Information Service (IS) submitted Information Service (IS) UI JDL waiting ready scheduled Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 7 7

Job Status: Running Replica Catalogues (RC) Information Service (IS) submitted Information Service (IS) UI JDL waiting ready scheduled Input Sandbox running Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 8 8

Job Status: Done Replica Catalogues (RC) Information Service (IS) submitted Information Service (IS) UI JDL waiting ready scheduled running done Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 9 9

Job Status: OutputReady Replica Catalogues (RC) submitted Information Service (IS) UI JDL waiting ready scheduled running done Resource Broker (RB) outputready Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Output Sandbox Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 10 10

Job Status: Cleared Example1; Example2 Replica Catalogues (RC) submitted Information Service (IS) UI JDL waiting ready scheduled Output Sandbox running done Resource Broker (RB) outputready cleared Job Submission Service (JSS) Storage Element (SE) Logging & Book-keeping (LB) Computing Element (CE) goncalo@lip.pt Grid Computing – Grid Tutorial 11 11

Contacts and Further Info LIP http://www.lip.pt The EGEE Project http://www.eu-egee.org The LCG Project http://cern.ch/lcg The gLite middleware http://www.glite.org The Globus Project http://www.globus.org goncalo@lip.pt Grid Computing – Grid Tutorial 12