GENIUS Grid portal Hands on Domenico Vicinanza CERN

Practical Information GENIUS Tutorial website: https://glite-tutor.ct.infn.it Tutorial accounts on glite-tutor: Username: santiagoXX where XX goes from 01 to 60 Password: GridSANXX where XX goes from 01 to 60 when issuing the myproxy-init command Myproxy password: SANTIAGO for all the accounts Santiago, Chile, EELA Tutorial, 09.2006

Introduction: the two-layers Authentication 1. Authentication with the User Interface 2. Authentication to the Grid. Input password of the user account: GridSANXX Input password of the proxy (specified when you shall execute myproxy-init) Santiago, Chile, EELA Tutorial, 09.2006

GENIUS logging in and base settings Preliminary Exercise GENIUS logging in and base settings Santiago, Chile, EELA Tutorial, 09.2006

Outline of the exercise 1/2 Login at your UI account (passwd: GridSANXX) Store a proxy on a remote Myproxy Server machine with the command (using the passphrase SANTIAGO): >myproxy-init --voms gilda Retrieve a local proxy from MyProxy server: > myproxy-get-delegation (must use your new MyProxy passphrase) Verify your new local proxy: >voms-proxy-info --all Santiago, Chile, EELA Tutorial, 09.2006

myproxy-init --voms gilda Password: SANTIAGO Choose a new password; This password will be referred as myproxy password Santiago, Chile, EELA Tutorial, 09.2006

Get credentials from the MyProxy server Santiago, Chile, EELA Tutorial, 09.2006

GRID authentication Santiago, Chile, EELA Tutorial, 09.2006

Launch a job described by a JDL which already exists in the UI First Exercise Launch a job described by a JDL which already exists in the UI We suppose to have the JDL file and all the other required data (input sandbox files) on the UI and we shall try to submit the job on the GRID Santiago, Chile, EELA Tutorial, 09.2006

Selecting job Santiago, Chile, EELA Tutorial, 09.2006

Submitting job Santiago, Chile, EELA Tutorial, 09.2006

Submitting job Santiago, Chile, EELA Tutorial, 09.2006

Submitting job Santiago, Chile, EELA Tutorial, 09.2006

Checking the status Santiago, Chile, EELA Tutorial, 09.2006

Retrieving job results 3/3 Santiago, Chile, EELA Tutorial, 09.2006

Preapare a job described by a JDL and store it on the UI Second Exercise Preapare a job described by a JDL and store it on the UI In this exercise we are going to create a new file on the UI called helloworld.jdl describing a simple job Santiago, Chile, EELA Tutorial, 09.2006

First step: create the JDL file [ JobType = "Normal"; Executable = "/bin/echo"; Arguments = "Hello World !"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"}; ] Santiago, Chile, EELA Tutorial, 09.2006

Inspecting our JDL Santiago, Chile, EELA Tutorial, 09.2006

Submit the job described by the JDL created in the previous exercise Third Exercise Submit the job described by the JDL created in the previous exercise In this exercise we are going to submit the job described by the JDL file edited in the previous step Santiago, Chile, EELA Tutorial, 09.2006

Submitting the JDL 1/4 Santiago, Chile, EELA Tutorial, 09.2006

Submitting the JDL 2/4 Santiago, Chile, EELA Tutorial, 09.2006

Submitting the JDL 2/4 Santiago, Chile, EELA Tutorial, 09.2006

Retrieving job results Santiago, Chile, EELA Tutorial, 09.2006

Fourth Exercise Preparing a job described by the JDL with a file to ship in the input sandbox In this exercise we are going prepare the JDL description for a job which executes a shell script. The .sh file will be shipped to the CE through the input sendbox Santiago, Chile, EELA Tutorial, 09.2006

Step 1: Create the shell script #!/bin/sh MY_NAME="Your name" WORKER_NODE_NAME=glite-tutor.ct.infn.it echo "Hello $MY_NAME, from $WORKER_NODE_NAME" ls -a echo "This job is running on this CE: " /opt/edg/bin/edg-brokerinfo getCE Santiago, Chile, EELA Tutorial, 09.2006

Step2: create the JDL file [ Executable = "startScript.sh"; StdOutput = "std.out"; StdError = "std.err"; VirtualOrganisation = "gilda"; InputSandbox = {"startScript.sh"}; OutputSandbox = {"std.out","std.err",".BrokerInfo"}; RetryCount = 7; ] Santiago, Chile, EELA Tutorial, 09.2006

Submitting the job prepared in the previous exercise Fifth Exercise Submitting the job prepared in the previous exercise In this exercise we are going submit the job which executes a shell script, prepared in the previous exercise. The .sh file will be shipped to the CE through the input sendbox Santiago, Chile, EELA Tutorial, 09.2006

(List of available resources) Santiago, Chile, EELA Tutorial, 09.2006

Step 3: submitting job Santiago, Chile, EELA Tutorial, 09.2006

Step 4: retrieving the results Santiago, Chile, EELA Tutorial, 09.2006

Sixth Exercise Preparing a set of three aggregated jobs with dependencies (DAG) and submitting it In this exercise we are going prepare the JDL description for a three-jobs aggregate with dependencies (Directed Acyclic Graph, or DAG) and submit it to the GRID Santiago, Chile, EELA Tutorial, 09.2006

DAG execution Node2 Node1 {node1, {node2, node3}} Node3 Each node carries out a job described by its own JDL file node1=[        file=“myjob.jdl";       ]; Santiago, Chile, EELA Tutorial, 09.2006

DAG JDL file [ Type = "dag"; VirtualOrganisation="GILDA"; nodes = [ file="helloworld.jdl"; ]; node2=[ node3=[ dependencies = {{node1, {node2, node3}}}; ] Santiago, Chile, EELA Tutorial, 09.2006

DAG file creation Node2 Node1 Node3 Santiago, Chile, EELA Tutorial, 09.2006

DAG job submission Santiago, Chile, EELA Tutorial, 09.2006

Running according to dependecies Node1 Click on “dagman” link to Inspect the DAG execution Since we have specified a dependency among the nodes: {node1, {node2, node3}} the job execution on node2 and node3 will start right after the end of the node1 job Santiago, Chile, EELA Tutorial, 09.2006