1. 1 2010-04-27 EDGI European Desktop Grid Initiative http://edgi-project.eu Have you ever submitted 10.000 jobs to gLite in one run? If not, I will show you how I did it…. Demonstration on the EGI User Forum Vilnius, Lithuania 12/04/2011 EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556

2. Here is the receipt for you…. Step 1: Choose an application you want to run Step 1: Choose an application you want to run Step 2: EDGI project performs the necessary preparations for you => application appears in the EDGI application repository Step 2: EDGI project performs the necessary preparations for you => application appears in the EDGI application repository Step 3: Collect info from the EDGI AR Step 3: Collect info from the EDGI AR Step 4: Prepare your inputs, create and submit jdl Step 4: Prepare your inputs, create and submit jdl Step 5: Query the status and download the outputs Step 5: Query the status and download the outputs Be happy with the results! Be happy with the results! Need more details? Let us see… Need more details? Let us see… 2

3. Step 3: Collect information from EDGI AR (authorized vos, ces) 3

4. Step 3: Collect information from the EDGI AR (files) 4

5. Step 4a: prepare your inputs Upload your individual input files to web server: Upload your individual input files to web server: http://somewhere.com/pools1.txt http://somewhere.com/pools1.txt … http://somewhere.com/pools10000.txt http://somewhere.com/pools10000.txt Create the description of your metajob: Create the description of your metajob: %Required 100% %SuccessAt 100% %Comment pools1.txt Arguments = "-i 0 -n pools.txt -f 22 -p 723“ Input = pools.txt=http://somewhere.com/pools1.txt=7b7eb86bf50c58cbf92dc12ff5adf7f4=9652 Queue[….] %Comment pools10000.txt Input = pools.txt=http://somewhere.com/pools10000.txt=7b7eb86bf50c58cbf92dc12ff5adf7f4=9652 Queue 5

6. Step 4b: create and submit jdl Create your jdl: Create your jdl: Executable = "dsp"; Arguments = "-f 22 -i 22 -p 723 -n pools.txt"; InputSandbox = { "gsiftp://dev17-portal.cpc.wmin.ac.uk:2811/srv/edgi/1001/1102/dsp", "pools.txt", "_3gb-metajob-dsp-10000" }; OutputSandbox = {"cost.txt"}; SubmitTo = "cr1.edgi-grid.eu:8443/cream-pbs-edgidemo"; Submit: Submit: glite-wms-job-submit -o id my-metajob-10000.jdl 6 Reference to the app in the EDGI AR Basic input file Extra input file

7. Step 5a: Query the status 7 Location of the status description

8. Step 5b: Query the status 8 Metajob handling rules Actual status of jobs Location of the mapping

9. Step 5b: Download the results 9 Download result as usual: glite-wms-job-output -i id --dir outputs =>./outputs/cost.txt Extract it: tar zxvf cost.txt =>./outputs/ /cost.txt See the mapping between your individual job definition and the jobids (which gives the name of directories storing the output files of your app) => one subjob id one job

10. And now, Step 1 and 2: Contact the EDGI project. The project will Contact the EDGI project. The project will Analyse and port your application to the EDGI infrastructure with your assistance Analyse and port your application to the EDGI infrastructure with your assistance Register the ported application on one or several EDGI DGs Register the ported application on one or several EDGI DGs Upload and configure your application in the EDGI AR Upload and configure your application in the EDGI AR Give access to you for using the EDGI services Give access to you for using the EDGI services 10

11. Volunteer/ Institutional Resources ARC grid gLite grid Eucalyptus/ Amazon What is behind: The EDGI infrastructure 11 ARC MCE atticmonitorAR CREAM MCE atticmonitorAR 3GBridge attic monitor AR User IF Bridge IF Attic FS DG client attic Monitor UI DG Pro- ject submit inspect upload down- load submit cloud DG client attic Demonstrated!

12. And finally here comes the live demonstration… 12