OpenGATE meeting/Grid tutorial, mars 9nd 2005 GATE Applications on EGEE Lydia Maigne & Cheick O. Thiam LPC – PCSV Clermont Ferrand CNRS-IN2P3 www.eu-egee.org EGEE is a project funded by the European Union under contract IST-2003-508833

Contents GATE installations on biomedical resources Description of the tests Test of computing time on LPC and CC-IN2P3 CE Stability test over the period conclusion and prospects OpenGATE meeting, Grid tutorial, 09-03-05 - 2

Biomedical VO resources on EGEE Concerning RBs 4 RBs: CNAF, IFAE, LAPP, UPV RLS, VO LDAP Server: CC-IN2P3 OpenGATE meeting, Grid tutorial, 09-03-05 - 3

Biomedical VO resources on EGEE Concerning CEs 21 CEs: 5 sites with >50Wnds CCIN2P3, LPC, Bari, Padova, Taiwan OpenGATE meeting, Grid tutorial, 09-03-05 - 4

Biomedical VO resources on EGEE Concerning SEs 24 SEs: 8 sites with > 1 TB CCIN2P3, Marseille, Greece, Italy (CNAF, Catania, Padova), Taiwan OpenGATE meeting, Grid tutorial, 09-03-05 - 5

GATE installations For an easy installation on sites without being root=> RPMs creation RPMs G4.5.2.p02 gate_v1.0.0 Redhat 7.3 (current installation) gate_v1.0.2 SL3 RPMs G4.6.2.p02 gate_v1.0.2 SL3 (current installation) gate_v1.1.0 SL3 RPMs G4.7 gate_v1.2.0 SL3 Sites: CCIN2P3 SL3 Clermont-Ferrand RH7.3 HGRNET (Greece) RH7.3 CNB (Madrid) RH7.3 OpenGATE meeting, Grid tutorial, 09-03-05 - 6

Tests description We start from a GATE macro defining an example of radiotherapy treatment S U B M I T E D RB Macro Gate 20 000 000 particles 10 jobs 20 jobs We have tested the computing times on EGEE sites (CCIN2P3 Lyon and LPC Clermont). We divided a long simulation in a series of 10, 20, 50 and 100 simulations on multiple processors 50 jobs Computing times are compared to user time of initial GATE job 100 jobs the jobs are submitted in sequential way, which implies an important launching time for a wide distribution of GATE job OpenGATE meeting, Grid tutorial, 09-03-05 - 7

CE Characteristics CE : CC-IN2P3 CE : LPC Clermont CE_node = cclcgceli01.in2p3.fr Destination = cclcgceli01.in2p3.fr:2119/jobmanager-bqs-A 50 dual-processors Pentium 3/4 CE : LPC Clermont CE_node = clrce01.in2p3.fr - clrce02.in2p3.fr Destination= clrce01.in2p3.fr:2119/jobmanager-lcgpbs-long clrce02.in2p3.fr:2119/jobmanager-lcgpbs-long dual-processors Xeon 3GHz clrce01 : 42 machines clrce01 : 22 Local machine : Intel® Xeon™ CPU 3.06GHz OpenGATE meeting, Grid tutorial, 09-03-05 - 8

About job submission Replica Information Location System (IS) Service Server collecting information concerning grid functionalities Keep information concerning files registrations on SEs Replica Location Service (RLS) Information System (IS) UI JDL Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Database collecting jobs status Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 9

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) Job Submit Event Input Sandbox UI JDL Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 10

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 11

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready Resource Broker (RB) Storage Element (SE) Job Status Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 12

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready scheduled Resource Broker (RB) running Storage Element (SE) BrokerInfo Logging & Bookkeeping (LB) Job Status Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 13

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready Input Sandbox running scheduled Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 14

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready scheduled Resource Broker (RB) Job Status running Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 15

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready scheduled Resource Broker (RB) running Storage Element (SE) Job Status done Logging & Bookkeeping (LB) Job Submission Service (JSS) Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 16

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready scheduled Resource Broker (RB) running Storage Element (SE) done Logging & Bookkeeping (LB) Job Status Job Submission Service (JSS) outputready Output Sandbox Computing Element (CE) OpenGATE meeting, Grid tutorial, 09-03-05 - 17

Replica Information Location System (IS) Service (RLS) UI JDL Resource Job Status submitted Replica Location Service (RLS) Information System (IS) UI JDL waiting ready scheduled Output Sandbox Resource Broker (RB) running Storage Element (SE) Job Status done Logging & Bookkeeping (LB) Job Submission Service (JSS) outputready Computing Element (CE) cleared OpenGATE meeting, Grid tutorial, 09-03-05 - 18

Comparison of the jobs various states CC-IN2P3 Lyon OpenGATE meeting, Grid tutorial, 09-03-05 - 19

Comparison of computing time between a local and parallel submission Max Gain = 7 for 20 partitions CC-IN2P3 Lyon OpenGATE meeting, Grid tutorial, 09-03-05 - 20

Comparison of the jobs various states LPC- Clermont Ferrand OpenGATE meeting, Grid tutorial, 09-03-05 - 21

Comparison of computing time between a local and parallel submission Max Gain = 24 for 100 partitions LPC- Clermont Ferrand OpenGATE meeting, Grid tutorial, 09-03-05 - 22

Total Time Comparison LPC / CCIN2P2 OpenGATE meeting, Grid tutorial, 09-03-05 - 23

Total Computing times of a set 100 jobs over a period of 22 days CE_LPC Clermont OpenGATE meeting, Grid tutorial, 09-03-05 - 24

Discussion The computing time is not proportional with the number of jobs running in parallel. This is in part due to three parameters: the launching time of the jobs, the numbers of machines on the CE CE load and performance the RB managing of the jobs Evolution of GATE evaluation on different infrastructures GATE is now installed on: EGEE nodes: LPC (France), CC-IN2P3 (France), CNB (Spain) & HG-01-GRNET (Greece) CINES: SGI Origin 3800 (768 proc.), IBM SP Power 3 (452 proc.) & IBM P1600 Power 4+ (256 proc.) IDRIS: IBM Regatta Power 4 (256+ 2 X 384 proc.) OpenGATE meeting, Grid tutorial, 09-03-05 - 25

Conclusion The computing grids give promising results and meet a definite need: reach acceptable computing time for a future use of GATE simulations for treatment planning in brachytherapy and radiotherapy Successful deployment of GATE on EGEE Significant impact on computing time These figures are good due to the fact clusters are in production mode submission and repatriation times are very important using sequential submission (need to use multithreaded submission) Test performance are ongoing at CINES and IDRIS sites (Supers calculators contribution for GATE Application) OpenGATE meeting, Grid tutorial, 09-03-05 - 26