INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC, 8 th December 2004

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 2 Overview GILDA The GILDA Testbed –What is a Grid Testbed? –What is the GILDA Testbed? –Where is the GILDA Testbed? The GENIUS Portal –What is a Portal? –What is the GENIUS Portal? –How it works. –Advanced Functionalities The Practical

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 3 GILDA Grid INFN Laboratory for Dissemination Activities A virtual laboratory to demonstrate/disseminate the strong capabilities of grid computing. Run by the EGEE team at INFN Catania (Sicily) under Roberto Barbera GILDA incorporates: The Gilda Testbed GENIUS A monitoring system using GridICE (not covered here) Its own Virtual Organization and Certificate Authority (not covered here)

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 4 The GILDA home page (

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 5 What is a Testbed Grid? A testbed (according to Google): –A platform on which an assortment of experimental tools and products may be deployed and allowed to interact in real-time. Successful tools and products may be identified and developed in an interactive, evolutionary, interdependent process. –Experimental proof of concept, technology demonstration, pre-prototype. The GILDA “Testbed Grid”: –Provides a safe environment for new users and communities to gain early experience and training in grids. –New applications can be developed in an environment isolated from already running stable grid applications.

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 6 The GILDA Testbed An EGEE testbed. Running the latest stable EGEE middleware Used for initial porting of new applications into EGEE. Supports existing and potential new EGEE user communities. Supports the EGEE training activities.

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 7 GILDA Sites 12 Sites 5 Countries

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 8 Using the Grid without a Portal ReplicaCatalogue Logging & Book-keeping ResourceBroker StorageElement ComputingElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Output “sandbox” Publish SE & CE info “User interface” edg-job-list-match HelloWorld.jdl edg-job-submit -o job.id HelloWorld.jdl edg-job-status -v 1 -i job.id edg-job-get-output -i job.id --dir. ??????

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December 04 9 Using the Grid with a Portal ReplicaCatalogue Logging & Book-keeping ResourceBroker StorageElement ComputingElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Output “sandbox” Publish SE & CE info “User interface”

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December Introducing GENIUS GENIUS – the full version: Grid Demonstrator – an ‘open to all’ 24/7 available version: Grid Tutor – a version designed for training purposes: Several versions of the portal exist:

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December GENIUS: A grid portal A Portal provides a gateway via a web site to grid/internet functionalities. GENIUS is a Portal that: –Provides access to the functionality and resources of the grid. –Hides the use of the command line. –Avoids users needing a deep understanding of grid middleware –Accessible from anywhere by desktop, laptop, PDA or mobile phone. –Protects the user from changes to the grid middleware. –Provides the user with a secure environment at all levels –Is simple to use. Grid Enabled web eNvironment for site Independent User job Submission

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December The GENIUS hourglass model OS & Net services Basic Services High level GRID middleware Applications INFN/NICEsrl collaboration (EGEE Services) (VDT)

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December tier model GENIUS: how it works Grid Services Browser Portal Development Kit Web Server Portal User interface

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December Problem: A web server and hence the portal must run with the lowest possible privileges. How then can it run jobs for the user? The best answer is to extend the GSI delegation system so that the user can delegate the rights to run the job to the portal. The MyProxy service provides this extension by: –temporarily storing the users credentials. –starting a proxy service on behalf of the user. –providing a separate passphrase for the portal. Portal Security

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December Advanced Functionalities Interactive ServicesApplication Specific Interfaces Graphic Workflow EditorPeer to Peer Services

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December Summary GILDA is a testbed with a complete suite of grid elements and applications. GILDA runs and will run the last production (stable) version of the grid middleware (currently Grid.it based on LCG 2.2.0). GILDA is the dissemination tool which will be used during induction courses and tutorials GENIUS is a well established portal which is fundamental in the process of interfacing new applications with the EGEE middleware GENIUS hides the complex internals of the EGEE middleware from new and non-experts users.

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December The Practical 1 Running Jobs on GILDA by the use of the GENIUS (grid-tutor) portal. –Submission –Monitoring –Retrieving output Editing the job description file. –Job inputs and outputs –Job Requirements Basic Data Management –Retrieving data from the grid.

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December The Practical 2 Log in to your workstation –UserName: student –Password: G05Cu53r (that’s a zero) Open a web browser and go to Your GENIUS identification is: –UserName: edinburghXX where XX is the number of the lab PC you are sat in front of (e.g. edinburgh05) –Password: GridEDIXX where XX is as above –MyProxy passphrase: EDINBURGH Follow the instructions from there on in.

Enabling Grids for E-sciencE INFSO-RI GENIUS and GILDA, NeSC, 8 th December Acknowledgements Some of the slides used in this talk are based on slides originally given by Roberto Barbera of INFN, Catania