The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th

Portals & Portlets The PROGRESS project Duration: December 2001 – May 2003 (R&D) Budget: ~4,0 MEuro Project Partners –SUN Microsystems Poland –PSNC IBCh Poznań –Cyfronet AMM, Kraków –Łódź Technical University Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

Portals & Portlets PROGRESS (2) Cluster of 80 processors Networked Storage of 1,3 TB Software: ORACLE, HPC Cluster Tools, Sun ONE, Sun Grid Engine

Portals & Portlets PROGRESS architecture

Portals & Portlets PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM GRID SERVICE PROVIDER 4-tier new grid-portal environment Grid-Portal Environment PORTAL HPC RESOURCES GRID MANAGEMENT SYSTEM 3-tier classical grid-portal environment

Portals & Portlets Grid Service Provider (1) Features Use of grid resources most comfortable to end users. Easy building of numerous portals and other user interfaces. Users can switch between various interfaces and use the same GSP services. Various thematic scientific web portals sharing the same grid resources. Possibility to provide all GSP clients (user interfaces) with computing resources belonging to two or more different grids.

Portals & Portlets Grid Service Provider (2) Necessary services to provide: –Job Submission Service managing the creation of user jobs, submission to the grid and execution monitoring (typically through reverse reporting, performed by the Grid Management System about events connected with job execution) –Application Management Service storing information about applications available for running in the grid assisting application developers in adding new applications to the application factory –Provider Management Service keeping up-to-date information on the services available within the provider

Portals & Portlets GSP within PROGRESS Content Provider Webservice Session Bean Entity Beans

Portals & Portlets Job Submission Service (1) Creating computational jobs, submitting them to the grid for execution and viewing the results Job description is prepared using the XRSL language and is transferred to the Grid Resource Broker for the execution of the job Grid Resource Broker reverse reports on grid events connected with the job „Workflowed” jobs: sequences and parallels

Portals & Portlets Job Submission Service (2) Web Services interface –Create, modify, delete and submit computing jobs (single and "workflowed” task), copy jobs –Manage job tasks, including: setting application parameters, adding references to input and output files, setting task resource requirements –Monitoring job execution –Change task status (used by the Grid Resource Broker)

Portals & Portlets Application Management Srv. (1) Application repository management Application descriptor contains a reference to the application executable: a reference to a file stored in the DMS or a path to a binary on grid computing server filesystems Also included in the application descriptor: available (required or optional) arguments, required environment variables and required input and output files PROGRESS applications may be unconfigured or configured: one executable -> multiple configured applications Virtual applications

Portals & Portlets Application Management Srv. (2) Web Services interface –Add and remove applications, modify application definitions –Manage virtual applications

Portals & Portlets Provider Management Service Enables keeping up-to-date information on services available in the grid service provider Service descriptor contains information on the Web Service interface: URL at which the service is available, the service namespace reference (URN) and the service WSDL reference Services may have multiple instances: informational services Web Services interface –Add and delete services, modify their descriptors –Add and delete instances of services

Portals & Portlets Informational Services Examples of instance enabled services Intended for use by web portals PROGRESS example: short news service Other: document directory, discussion forum (under development)

Portals & Portlets Short News Service Web Services interface –Add, modify, delete and read news –Add and delete own instances (informational services are examples of multiple instance services)

Portals & Portlets XRSL Language Extended Resource Specification Language (XRSL) is an XML based language designed for description of computing jobs The XML documents describing grid computing jobs are passed to the Grid Resource Broker, which analyzes them and executes jobs in accordance with requirements included

Portals & Portlets Web Services Communication HPC Portal Grid Service Provider Data Management System Grid Resource Broker saveJob() getApplications() getTemplates() saveTaskOfJob() saveStdOfTask() submitJob() getUserJobs() getJobStatus() listUserDirectory() addUserFile() getUserFileLocation() submitJob() changeTaskStatus()

Portals & Portlets Authentication & authorization Utilize the services available within the Sun One Portal Server 6.0 package: authentication techniques, user database, portlet access control, identity server Authorization system for the Grid Service Provider and the Data Management System: based on the RAD model Apply a Single Sign-On mechanism

Portals & Portlets Authorization scheme Portal GRID SERVICE PROVIDER Identity server RAD based authorization system Logon Authentication Request Method invocation Token validation Resource access authorization

Portals & Portlets Other PROGRESS modules User interfaces –Web Portal: grid job management, application management, provider management, short news reading and editing, DMS file system management –Migrating Desktop: grid job management and DMS file system management Grid Resource Broker: enables the execution of PROGRESS grid jobs in the PROGRESS grid; uses the XRSL language for grid job descriptions Data Management System: storing the input and output files, metadata, multiple media data containers

Portals & Portlets Visualization of job results

Portals & Portlets PROGRESS HPC Portal

Portals & Portlets SC2002 Demo

Portals & Portlets PROGRESS future R&D finished within the project, test and deployment phase now With the Grid Service Provider: –numerous thematic scientific portals possible to deploy (PROGRESS HPC Portal is a bioinformatic portal) –users may be provided with resources belonging to two or more grids – the Grid Service Provider may be equipped with means of communicating with multiple grids PROGRESS HPC Portal contents: adding new applications, adding new visualization applets, bioinformatic society building

Portals & Portlets PROGRESS