Designing, Executing, Reusing and Sharing Workflows: Taverna and myExperiment Supporting the in silico Experiment Life Cycle Katy Wolstencroft Paul Fisher.

Slides:



Advertisements
Similar presentations
The e-Framework Bill Olivier Director Development, Systems and Technology JISC.
Advertisements

David De Roure Social Networking and Workflows in Research.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik University of Manchester.
European Life Sciences Infrastructure for Biological Information Rafael C Jimenez ELIXIR CTO EMBL-EBI workshop networks and pathways.
Designing, Executing and Reusing Scientific Workflows Katy Wolstencroft, Paul Fisher, myGrid.
Accelerating Time to Experiment – The myExperiment Approach to Open Science David De Roure Carole Goble Jiten Bhagat.
Taverna and myExperiment: Designing, Exchanging and Sharing of Scientific Workflows Katy Wolstencroft University of Manchester.
IBM Watson Research © 2004 IBM Corporation BioHaystack: Gateway to the Biological Semantic Web Dennis Quan
Microsoft Research Faculty Summit David De Roure University of Southampton, UK.
Software for the Data-Driven Researcher of the Future Dr. Paul Fisher
Jiten Bhagat University of myExperiment A Social VRE for Research Objects JISC Roadshow | February.
What is workflow?  A workflow is a structured way of defining and automating structures and procedures within an organization. What is workflow management.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.
Provenance in my Grid Jun Zhao School of Computer Science The University of Manchester, U.K. 21 October, 2004.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik University of Manchester materials by Dr Katy Wolstencroft and Dr Aleksandra.
Composing Models of Computation in Kepler/Ptolemy II
Taverna and my Grid Basic overview and Introduction Tom Oinn
Software from Science for Science Steven Newhouse, Director.
CONTENTS Arrival Characters Definition Merits Chararterstics Workflows Wfms Workflow engine Workflows levels & categories.
An Introduction to Designing and Executing Workflows with Taverna Katy Wolstencroft University of Manchester.
Taverna and my Grid Open Workflow for Life Sciences Tom Oinn
Taverna Workflow. A suite of tools for bioinformatics Fully featured, extensible and scalable scientific workflow management system – Workbench, server,
Protein Molecule Simulation on the Grid G-USE in ProSim Project Tamas Kiss Joint EGGE and EDGeS Summer School.
Semantic Professor Carole Goble
A portal interface to my Grid workflow technology Stefan Rennick Egglestone University of Nottingham
Taverna Workflows for Systems Biology Katy Wolstencroft School of Computer Science University of Manchester.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik materials by: Katy Wolstencroft University of Manchester.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
SCAP E SCAPE Project EU project aimed at building a scalable platform for planning and execution of computation intensive processes for ingestion or migration.
Professor Carole Goble
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
Data provenance in biomedical discovery Donald Dunbar Queen’s Medical Research Institute University of Edinburgh Workshop on Principles of Provenance in.
Technology behind using Taverna in caGrid caGrid user meeting Stian Soiland-Reyes, myGrid University of Manchester, UK
Association of variations in I kappa B-epsilon with Graves' disease using classical and my Grid methodologies Peter Li School of Computing Science University.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Stian Soiland-Reyes myGrid, School of Computer Science University of Manchester, UK UKOLN DevSci: Workflow Tools Bath,
© Geodise Project, University of Southampton, Knowledge Management in Geodise Geodise Knowledge Management Team Barry Tao, Colin Puleston, Liming.
WHIP - Workflow Hosted in Portals Kurt Mueller and Andrew Harrison School of Computer Science, Cardiff And Ian Taylor School of Computer Science, Cardiff.
Bioinformatics Workflows Chris Wroe (based on material from the myGrid team & May Tassabehji / Hannah Tipney Medical Genetics, St Marys)
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
An Introduction to Designing, Executing and Sharing Workflows with Taverna Katy Wolstencroft myGrid University of Manchester IMPACT/Taverna Hackathon 2011.
6 February 2009 ©2009 Cesare Pautasso | 1 JOpera and XtremWeb-CH in the Virtual EZ-Grid Cesare Pautasso Faculty of Informatics University.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Services for advanced workflow programming.
Issues of concern  Lack of a formalized data pipeline approach to feed computational platforms  Resulting in data sets consisting.
An approach to carry out research and teaching in Bioinformatics in remote areas Alok Bhattacharya Centre for Computational Biology & Bioinformatics JAWAHARLAL.
Introduction to Taverna Online and Interaction service Aleksandra Pawlik University of Manchester.
Scientific Workflows for the Sensor Web ICT for Earth Observation Anwar Vahed.
Portals and my Grid Stefan Rennick Egglestone Mixed Reality Laboratory University of Nottingham.
ISMB Demo, 01 July 2009 Franck Tanoh University of Manchester, UK.
IPlant Collaborative Tools and Services Workshop Overview of the iPlant Discovery Environment Sriram Srinivasan.
Jiro Sumitomo, James M. Hogan, Felicity Newell, Paul Roe Microsoft QUT eResearch Centre
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Designing, Executing and Sharing Workflows with Taverna 2.2 Katy Wolstencroft myGrid University of Manchester.
Introduction to Workflows with Taverna and myExperiment Aleksandra Pawlik University of Manchester materials by Dr Katy Wolstencroft.
CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.
Norman Morrison Senior Research Fellow, The University of Manchester Biodiversity Virtual e-Laboratory An e-Infrastructure and e-Science environment supporting.
Exploring Taverna 2 Katy Wolstencroft myGrid University of Manchester.
Aleksandra Pawlik Alan Williams University of Manchester.
The Influence and Impact of Web 2.0 on e-Research Infrastructure, Applications and Users User Day.
CyVerse Discovery Environment
Professor Carole Goble University of Manchester, UK
An Introduction to Designing and Executing Workflows with Taverna
GIFT / Fiscal Data Package Iteration 3
Taverna workflow management system
An Introduction to Designing, Executing and Sharing Workflows with Taverna and myExperiment Katy Wolstencroft University of Manchester.
Shim (Helper) Services and Beanshell Services
An Introduction to Designing and Executing Workflows with Taverna
Presentation transcript:

Designing, Executing, Reusing and Sharing Workflows: Taverna and myExperiment Supporting the in silico Experiment Life Cycle Katy Wolstencroft Paul Fisher University of Manchester

Workflow Environments Taverna Workflow design and execution environment Access to local and remote resources and analysis tools Automation of data flow Iteration over large data sets 50,000 downloads Used by 350+ organisations myExperiment Workflow sharing and publishing environment Web 2.0 Social network Sharing workflows, expertise, knowledge and/or data 964 users 301 workflows

Taverna For bioinformaticians, NOT biologists Used for Data gathering annotation pipelines, data integration, model population Data analysis microarray, proteomics, Data mining and knowledge integration Ontology building

myExperiment Supports bioinformaticians but also enables biologists to run ready-made workflows Intended for ANY workflows, not just Taverna Already working with Triana Allows “just enough” sharing between groups/communities Who can look at your workflow Who can download your workflow Who can modify your workflow Who can run your workflow

Google Gadgets

In Silico Life Cycle

Taverna In Silico Life Cycle

my Grid Development Started 2001 – EPSRC E-Science project 2005 – OMII-UK myExperiment - started 2007 Open Source Funded until after 2010

my Grid Development

Demo

Current work

Speed and Scalability Taverna 2 enactor Support for long running workflows Large scale data – industrial bioinformatics Data streaming Passing data by reference Integration with established computing platforms

Extensibility and Ease of Use Drag and drop workflow building More content – greater pool of workflows in myExperiment More components – gathering together commonly used groups of services Shim libraries – for combining incompatible services Service and workflow annotation checking

Curation by Experts Curation by the Community Automated Curation refine validate refine validate Curation by Developers seed refine validate seed BioCatalogue Joint Manchester-EBI

Toolkits “Taverna Inside” Workflows under the hood e-Laboratories (portals) Systems Biology, e-Health Dashboards configurable platforms for small biological communities Visualisation clients that call workflows in the background

UTOPIA Pettifer, Kell, University of Manchester

Toolkits “Taverna Inside” Workflow development pipeline Workflows developed by bioinformaticians Enacted locally E-Labs, Dashboards and 3 rd party clients Social support for bioinformaticians to find and reuse workflows and expertise Access to ready made workflows for biologists Workflows enacted locally Taverna remote execution service (T-Rex) Social support to find and reuse workflows and expertise CONFIGURABLE access to ready made workflows for biologists Workflows embedded in applications and combined with data management systems

Come and see us Booth 20 Manchester Bioinformatics Development is user driven – we need your input! Try out myExperiment Try out Taverna and T2 Try out the new drag and drop interface Do you want workflows behind your tools? ….and come and tell us what you think