1. Corso di Calcolo Parallelo Grid Computing
Catania - ITALY
25-29 September 2006
Introduction to the Command Line Interface for Job Submission Alessandro Costa INAF Catania

2. How to find the right resources on the grid
Job List Match
It is possible to see which CEs are eligible to run a job specified by a given JDL using the glite-job-list-match (for gLite WMS)
$ glite-job-list-match [options] <jdl_file>
where <jdl file> is a file containing the job description, usually with extension .jdl.
--rank : This option can be used to display the ranking value of each matching resource
--o : option can be used to store the CE list on a file, which can later be used with the –i<file path> option of glite-job-submit.

3. [inafoact01@glite-tutor prova_mpi]$ glite-job-list-match mpi.jdl
Selected Virtual Organisation name (from proxy certificate extension): gilda
Connecting to host glite-rb2.ct.infn.it, port 7772
***************************************************************************
COMPUTING ELEMENT IDs LIST
The following CE(s) matching your job requirements have been found:
*CEId*
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short
…..

4. Connecting to host glite-rb2.ct.infn.it, port 7772
prova_mpi]$ glite-job-list-match --rank -o ce_list mpi2-glite.jdl
Selected Virtual Organisation name (from proxy certificate extension): gilda
Connecting to host glite-rb2.ct.infn.it, port 7772
======================= glite-job-list-match output =======================
Computing Element(s) matching your job requirements have been stored in the file:
/home/inafoact01/prova_mpi/ce_list
==================================================================
prova_mpi]$ cat ce_list
***************************************************************************
COMPUTING ELEMENT IDs LIST
The following CE(s) matching your job requirements have been found:
*CEId* *Rank*
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite22
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long 22
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short 22
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite 14
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short
…..

5. Job Submission I Job Submission
$ glite-job-submit [options] <jdl_file>
Perform the job submission to the Grid.
where <jdl file> is a file containing the job description, usually with extension .jdl.
--vo <vo name> : perform submission with a different VO than the UI default one.
--output, -o <output file> save the jobId on a file.
--resource, -r <resource value> specify the resource for execution.
--input, -i <input_file> if this option is specified, the user ill be asked to choose a CEId from a list of CEs contained in the file_path. Once a CEId has been selected the command behaves as explained for the --resource option.

6. Customization
--config-vo: this option allows a a greater control on the submission. You can customize the Resource Broker, VO & MyProxyServer.
A template configuration file (for the 'gilda' VO) is the following:
$ cat /opt/edg/etc/gilda/edg_wl_ui.conf
[ VirtualOrganisation = "gilda";
NSAddresses = {"glite-rb.ct.infn.it:7772"};
LBAddresses = {"glite-rb.ct.infn.it:9000"};
MyProxyServer = grid001.ct.infn.it; ]
RB consists of two components, a Network Server to receive the JDL and a Logging & Bookkeeping server to manage the job logging, but these are normally on the same machine.

7. --config: if the command is launched with this option, the configuration
file pointed to by file_path is used instead of the standard
configuration file.
03]$ cat /opt/edg/etc/edg_wl_ui_cmd_var.conf [
rank = - other.GlueCEStateEstimatedResponseTime;
requirements = other.GlueCEStateStatus == "Production";
RetryCount = 3;
ErrorStorage = "/tmp";
OutputStorage = "/tmp/jobOutput";
ListenerPort = 44000;
ListenerStorage = "/tmp";
LoggingTimeout = 30;
LoggingSyncTimeout = 30;
LoggingDestination = "glite-rb.ct.infn.it:9002";
NSLoggerLevel = 0;
DefaultLogInfoLevel = 0;
DefaultStatusLevel = 0;
DefaultVo = "unspecified"; ]

8. Choosing a VO
The following precedence rule is followed for determining the user's VO
the default VO from the user proxy (if it contains VOMS extensions),
the VO specified through the --vo or --config-vo options,
the VO specified in the configuration file pointed by the GLITE_WMSUI_CONFIG_VO environment variable,
the VirtualOrganisation attribute in the JDL
the default VO specified in the $GLITE_WMS_LOCATION/etc/glite_wmsui_cmd_var.conf (DefaultVO field) configuration file.

9. [inafoact01@glite-tutor prova_mpi]$ glite-job-submit -i ce_list mpi-glite.jdl
Selected Virtual Organisation name (from proxy certificate extension): gilda
…….
3 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite22
4 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long 22
5 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short 22
6 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite 14
7 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
8 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short
9 : trigriden00.unime.it:2119/jobmanager-lcgpbs-infinite 8
10: trigriden00.unime.it:2119/jobmanager-lcgpbs-long …. ..
q : quit
Choose a CEId in the list - [1-18]1:

10. How about my jobs? I $ glite-job-status [options] <Job Id(s)>
Displays bookkeeping information about submitted jobs
--input, -i <file_path>: displays bookkeeping info about jobid contained in the input file. When using this option the user is interrogated for choosing among all, one or a subset of the listed job identifiers.

11. A job can be canceled before it ends using the command
glite-job-cancel.
glite-job-cancel
Are you sure you want to remove specified job(s)? [y/n]n :y
=================== glite-job-cancel Success====================
The cancellation request has been successfully submitted for the following job(s) -
===========================================================

12. Questions…