Porting workflows for the Heliophysics Community Dr. Gabriele Pierantoni Trinity College Dublin

Content The ER-FLOW project Porting workflows in ER-FLOW Workflows in Heliophysics Why porting workflows ? Future work

3 University of WestminsterUoWUnited Kingdom Magyar Tudomanyos Akademia Szamitastechnikai es Automatizalasi Kutato Intezete MTA-SZTAKIHungary Centre National de la Recherche ScientifiqueCNRSFrance Stichting European Grid InitiativeEGI.euThe Netherlands Academic Medical Center of the University of Amsterdam AMCThe Netherlands Technische Universität DresdenTUDGermany Ludwig-Maximilians-Universität MünchenLMUGermany University College LondonUCLUnited KIngdom Trinity College DaudublinTCDIreland Istituto Nazionale di AstrofisicaINAFItaly Partners: Technology providers: CNRS, EGI.eu, MTA-SZTAKI, UoW Research Communities: Astro-physicsINAF Computational ChemistryLMU + TUD HeliophysicsTCD + UCL Life ScienceAMC Duration: September 2012 – August 2014 ER-flow Project

Coarse-Grained Interoperability: submitting non-native workflow Submitting a workflow to Its natural engine Submitting any workflow to one engine

5 WF submission client SHIWA Submission Service Taverna Workflow Engine Workflow of Workflow Engine B Workflow Engine A Coarse-Grained Interoperability: submitting non-native workflow Web Services non-native workflow:Taverna WF -non-native workflows are embedded in WS-PGRADE workflows -they are black boxes which are managed as legacy code applications WS-PGRADE Workflow Engine Workflow Engine B

Coarse-Grained Interoperability: submitting non-native workflow

7 gLite DCI Globus DCI DCIs ARC DCI Unicore DCI Kepler WE GWES WE Taverna WE Triana WE MOTEUR WE ASKALON WE PGRADE WE SHIWA Portal GEMLCA admin SHIWA Science Gateway WE1WEp GEMLCA Repository WF1WFm SHIWA Repository WF1WFn WS-PGRADE Workflow engine WS-PGRADE Workflow editor GEMLCA Service GEMLCA with GIB SHIWA Proxy Server Proxy Server Galaxy WE Pegasus WE ProActive WE Workflow Engines SHIWA CGI Infrastructure

Importing Taverna workflows

CGI User Scenario: Running Taverna Workflows RepositoryPortal

10 CGI User Scenario: Running Taverna Workflows SHIWA Repository SHIWA Portal WF1 SHIWA Science Gateway GEMLCA Service WFn WE1WEp GEMLCA Repository WF1WFm GEMLCA with GIB WS-PGRADE Workflow engine WS-PGRADE Workflow editor WF list e-scientists SHIWA Proxy Server Proxy Server step 2 download WF Taverna WE Workflow Engine Web Services step 7 run WF WE + WF step 7 retrieve WF step 6 submit WF step 5 get WF data WF1WFn myExperiment Repository step 1 search repo step 2 download WF step 3 platform enable WF step 4 edit WF step 3 upload WF

Heliophysics Applications on the SHIWA Simulation Platform HELIO PHYSICS short descriptionWEmiddleware finding the origins of Solar Wind events at EarthTaverna 2web service identifying the fastest type II CME in timeTaverna 2web service finding events in Xray and radioTaverna 2web service retrieving solar monitor urls for votable eventsTaverna 2web service retrieving dpas data for all ICS instruments for HEC event dataTaverna 2web service associating flares with active regionsTaverna 2web service

Heliophysics In heliophysics, we are interested in how an event on or near the solar surface can propagate through the heliosphere and affect a planetary environment Searches should identify interesting time intervals based on a combination of event, features, etc. metadata There are concerns about the quality and integrity of the metadata and whether it is adequate to support the searches we would like to undertake

Heliophysics Automated searches are difficult when major events can be “missed” and searches for long duration events would yield spurious results

Title Location is important  Effects depend on type of emission  Propagation is influenced by the interplanetary magnetic field for particles  Propagation models are fundamental ! Heliophysics

Heliophysics, the old way.

Heliophysics, the NEW way.

Web Services GUI API Workflow Engine (Server) Workflow Engine (Server) Workflow Engine (Desktop) Workflow Engine (Desktop) Resources Heliophysics, the NEW way. Web Services Data Catalogues

Title How it all fits together... WS-Pgrade Workflows Development of HELIOGate Portal Access to DCIs Web Services TAVERNA workflows

Title Future work Solve some technical problems.. Develop new workflows, break down bigger workflows in smaller component Develop dedicated portlets in the HelioGate portal Try to encompass related projects.