Enabling Grids for E-sciencE EGEE-III INFSO-RI Workflow management tool for Earth science applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak Academy of Sciences

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania KwfGrid Workflow Workflow management system from KwfGrid project –Workflow representation based on Petri net –Dynamic workflow composition –Different level of abstractions –Strongly service oriented (every activity is a web service) –Knowledge management and personal assistant

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania URLs of services Descriptions of jobs Semantics of each component: -What type of data it produces -Its input-output transformation description -Its output-input transformation description For each component: -Transformation of input tokens into input data -Transformation of output data into output tokens All existing tokens (both created by users and produced by jobs/services Semantic description of all tokens in token database – based on required data parameters, it allows to identify the proper token Components and token databases

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania We start with the semantic description of the required outputWe look for a token which would satisfy the requirementsNo such token is found; we look for a service or job which can produce token of such type We have found a service which is able to produce the required token; however, it requires two input tokens, and the search continues Now we have found services which need only existing input tokens; so we have a workflow and input data, and the application may start We have produced the required output token (which represents the output data), the workflow has finished Workflow composition

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania Output placesActivityInput places map data config animation timedata 1. We need input data map317.tif dispData.bin Input tokens are combined into input data for the service or grid job map317.tif dispData.bin This input data is used to call the service, or execute the grid job 4. The service/job returns output data simul-out.txt spread.avi 5. The output data is divided into tokens; these are annotated by metadata and stored into the database simul-out.txt spread.avi Token processing

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania Porting KwfGrid system to EGEE Benefit: –Advanced workflow management system –Dynamic workflow construction based on user’s request –Personal assistant helps users to choose best options during workflow construction Issues during porting to EGEE: –KwfGrid is entirely service oriented: everything are web services (activities, metadata catalogs, …) –System information are based on WSDL (URL, input/output data) –Knowledge management module is tailored to web service (semantics of WSDL, web service monitoring)

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania Porting KwfGrid system to EGEE Actual status: –Workflow engine is ported to EGEE  New type of activity for gLite  New service adaptor  Credential management –Users now can execute KwfGrid workflows on EGEE Ongoing work –GUI interface is being adapted to EGEE  Monitoring real gLite job status  Editing additional gLite options (JDL options) Long-term –Knowledge management module –Token/metadata catalogs

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania

Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE User forum, Catania Summary Kwf-Grid workflow management tool has several advanced features: –Advanced workflow management system –Dynamic workflow construction based on user’s request Porting Kwf-Grid to EGEE allows users to take advantages of the systems