Integration of heterogeneous computational resources in EGEE: a live demo Istanbul, Turkey, September Integration of heterogeneous computational resources in EGEE infrastructure: a live demo A. Santoro, C. Scio*, G. Bracco, S. Migliori, S. Podda, A. Quintiliani, A. Rocchi ENEA FIM, C.R. ENEA Frascati V. E. Fermi 45 Frascati ROMA (Italy) (*) Esse3Esse, Roma, Italy

Integration of heterogeneous computational resources in EGEE: a live demo Motivations Currently standard EGEE infrastructure offers only resources based on HW/OS platforms supported by gLite (SL IA32/x86_64). SPAGO ( Shared Proxy Approach for GRID Objects ) concept now provides access from EGEE to Worker Nodes using other HW/OS platforms Implementation tested on several infrastructures available on ENEA-GRID: –Shared filesystems: AFS, NFS, investigation of GPFS –Resource managers: LSF Multicluster, scripted SSH, investigation on PBS –Worker nodes: AIX (production), IRIX, MACOS, Altix 350, Cray XD-1 This demo shows: –job submission to 5 different non-standard Platforms –how fast a Worker Node can be configured to be used with SPAGO –a user case from the POLY-SPAN project

Integration of heterogeneous computational resources in EGEE: a live demo ENEA- GRID

Integration of heterogeneous computational resources in EGEE: a live demo Limitation: gLite must be available on each WN CE WN gLite WN LSF/PBS Job I/O Job I/O gLite Resource Restrictions Only x86/SL3/4 machines participate to EGEE Serious restrictions on computational resources available! Reduced appeal for external realities (e.g. industry sites)

Integration of heterogeneous computational resources in EGEE: a live demo Shared Proxy Approach for GRID Objects (SPAGO) CE WN/UNIX gLite WN/UNIX Proxy gLite Shared Filesystem (AFS, NFS, GPFS,...) I/O Files Resource manager (LSF or PBS) Worker nodes do not mount gLite Required additional gLite machine (“proxy”) Resource Manager (LSF or scripted SSH)

Integration of heterogeneous computational resources in EGEE: a live demo Demo: Part I Job submission to non-standard platforms We show job submission (and results) to five different, non standard platforms: –AIX –IRIX –MACOS –Altix 350 –Cray XD-1 The jobs are submitted to the GRID, without explicitly specifying the destination computing element Selection of the Architecture is done by the use of the “Requirements” field in the JDL file

Integration of heterogeneous computational resources in EGEE: a live demo Demo: Part II Connection of a non-standard platform into the GRID a standalone laptop is put on the GRID in just three steps! Assumptions: –The Computing Element and the Proxy have already been configured –A shared filesystem can be mounted on the Worker Node. In our case we mount NFS The installation takes place by running a single script as root. No other intervention is required.

Integration of heterogeneous computational resources in EGEE: a live demo Demo: Part III A user case: submission of a multiplatform job to non-standard platforms POLY-SPAN is a project exploring the open problem of the span < 4 for polynomials with integer coefficients. The numerical exploration : a multicase submission of a large number of independent jobs, well adapted for the GRID environment Implementation: code PariGP/GP (Multiplatform) The DEMO –A “Parigp” tag has been added on the CEs –JDL with Parigp requirement –Jobs run on the various available OS/Platforms polynomial degree cpu time (s)

Integration of heterogeneous computational resources in EGEE: a live demo Wrapping up... For gLite Site Admins –No need to offer only WN based on IA32/x86_64/SL platform: any UNIX-like WN can be supported using SPAGO. –e.g. we plan to bring into EGEE a CE with 2500 x86_64 cores based on RH 5.1 (CRESCO project, #125 in the top 500/2008). For gLite users –It is possible to run software not specifically designed for IA32/x86_64/SL. Feel free to contact us: –if you have to support non-standard UNIX system in gLite. –if you have AIX code that should be run in EGEE infrastructure. –

Integration of heterogeneous computational resources in EGEE: a live demo SPAGO [Shared Proxy Approach for GRID Objects] Connect now any UNIX WN to the GRID with a loose but solid solution. NO requirements for WN except SSH and NFS! AI X IRIX MacOS CRAY Altix Any Linux