Distributed Computing With Triana A Short Course Matthew Shields, Ian Taylor & Ian Wang.

Slides:



Advertisements
Similar presentations
Pulan Yu School of Informatics Indiana University Bloomington Web service based Varuna.Net.
Advertisements

A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Under the Hood of a Workflow Manager Matthew Shields, BiodiversityWorld GRID workshop, NeSC, 30 June - 1 July T r a ai n.
Programming Workflow with Triana Services Matthew Shields, SC4DEVO Workshop, July 2004.
National Alliance for Medical Image Computing Anatomy of a plugin Common architecture for interactive and batch processing.
® IBM Software Group © 2006 IBM Corporation Rational Software France Object-Oriented Analysis and Design with UML2 and Rational Software Modeler 04. Other.
MATLAB Presented By: Nathalie Tacconi Presented By: Nathalie Tacconi Originally Prepared By: Sheridan Saint-Michel Originally Prepared By: Sheridan Saint-Michel.
SSP Re-hosting System Development: CLBM Overview and Module Recognition SSP Team Department of ECE Stevens Institute of Technology Presented by Hongbing.
Computational Physics Kepler Dr. Guy Tel-Zur. This presentations follows “The Getting Started with Kepler” guide. A tutorial style manual for scientists.
Data streaming, collaborative visualization and computational steering using Styx Grid Services Jon Blower 1 Keith Haines 1 Ed Llewellin 2 1 Reading e-Science.
Learning Objectives Understanding the difference between processes and threads. Understanding process migration and load distribution. Understanding Process.
System-Level Types for Component-Based Design Paper by: Edward A. Lee and Yuhong Xiong Presentation by: Dan Patterson.
Chapter 2 Introduction to Systems Architecture. Chapter goals Discuss the development of automated computing Describe the general capabilities of a computer.
Tutorial 7 Working with Multimedia. XP Objectives Explore various multimedia applications on the Web Learn about sound file formats and properties Embed.
Programming Scientific and Distributed Workflow with Triana Services Matthew Shields, GGF10 Workflow Workshop, 9th March.
Computer for Health Sciences
Computer Organization Review and OS Introduction CS550 Operating Systems.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
Grid Workflow within Triana Ian Wang Cardiff University.
PROCESS MODELING Chapter 8 - Process Modeling
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
Triana Dr Matthew Shields, School of Computer Science, Cardiff University A Problem Solving Environment and Grid Workflow Tool.
GRAPPA Part of Active Notebook Science Portal project A “notebook” like GRAPPA consists of –Set of ordinary web pages, viewable from any browser –Editable.
Introduction to M ATLAB EE 100 – EE Dept. - JUST.
Copyright © 2012 Pearson Education, Inc. Chapter 1: Introduction to Computers and Programming 1.
Microsoft ® Official Course Module XA Using Windows PowerShell ®
CONTENTS Arrival Characters Definition Merits Chararterstics Workflows Wfms Workflow engine Workflows levels & categories.
Tutorial 7 Working with Multimedia. XP Objectives Explore various multimedia applications on the Web Learn about sound file formats and properties Embed.
Triana: Service-Oriented Examples Ian Taylor Cardiff University, and the Center for Computation and Technology LSU.
Workflow Project Luciano Piccoli Illinois Institute of Technology.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Kuali Enterprise Workflow Presented at ITANA October 2009 Eric Westfall – Kuali Rice Project Manager.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
Workflow and Triana Services Matthew Shields, e-Science Workflow Services, 3-5 December T r a ai n.
© Geodise Project, University of Southampton, Workflow GUI and SMS Fenglian Xu May 2003
Tutorial 7 Working with Multimedia. New Perspectives on HTML, XHTML, and XML, Comprehensive, 3rd Edition 2 Objectives Explore various multimedia applications.
Tutorial 7 Working with Multimedia. New Perspectives on HTML, XHTML, and XML, Comprehensive, 3rd Edition 2 Objectives Explore various multimedia applications.
Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana
© 2004 Mercury Computer Systems, Inc. FPGAs & Software Components Graham Bardouleau & Jim Kulp Mercury Computer Systems, Inc. High Performance Embedded.
Composing workflows in the environmental sciences using Web Services and Inferno Jon Blower, Adit Santokhee, Keith Haines Reading e-Science Centre Roger.
Introducing BPEL Concepts Oracle BPEL Process Manager.
GSFL: A Workflow Framework for Grid Services Sriram Krishnan Patrick Wagstrom Gregor von Laszewski.
Ian Taylor, Cardiff Work-Flow Application Toolkit Eger Meeting Ian Taylor & Ian Wang Cardiff University, UK.
What is Triana?. GAPGAP Triana Distributed Work-flow Network Action Commands Workflow, e.g. BPEL4WS Triana Engine Triana Controlling Service (TCS) Triana.
Enterprise Integration Patterns CS3300 Fall 2015.
WHIP - Workflow Hosted in Portals Kurt Mueller and Andrew Harrison School of Computer Science, Cardiff And Ian Taylor School of Computer Science, Cardiff.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
Using Federated Services with Triana Matthew Shields Cardiff University.
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
1 The EDIT System, Overview European Commission – Eurostat.
CPS120: Introduction to Computer Science Compiling a C++ Program From The Command Line.
1 Galatea: Open-Source Software for Developing Anthropomorphic Spoken Dialog Agents S. Kawamoto, et al. October 27, 2004.
LQCD Workflow Project L. Piccoli October 02, 2006.
The GEO Online Detector Characterization System David Churches Cardiff University 21 st August 2003 LSC meeting – Hannover – 18,21 August 2003 LIGO-G Z.
© Geodise Project, University of Southampton, Workflow Application Fenglian Xu 07/05/03.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Holding slide prior to starting show. Processing Scientific Applications in the JINI-Based OGSA-Compliant Grid Yan Huang.
SE 548 Process Modelling WEB SERVICE ORCHESTRATION AND COMPOSITION ÖZLEM BİLGİÇ.
V7 Foundation Series Vignette Education Services.
Business Process Execution Language (BPEL) Pınar Tekin.
MIK 2.1 DBNS - introduction to WS-PGRADE, 2013
Computational Physics Kepler
A General Approach to Real-time Workflow Monitoring
Introduction To MATLAB
Scientific Workflows Lecture 15
Presentation transcript:

Distributed Computing With Triana A Short Course Matthew Shields, Ian Taylor & Ian Wang

Course Outline Introduction History and Overview Tools and Toolboxes, Components and Groups How to compose a workflow Triana as a workflow editor

Course Outline cont. Service-oriented Components Web services as components Web service workflow Peer 2 Peer services as components Distributed service workflow Grid-oriented Components Grid file and job primitives as components Complex Grid workflow

Install Triana Unpack the triana.tar.gz to a location of your choice Set env $TRIANA (Unix) or %TRIANA% (Windows) to the unpacked directory Run $TRIANA/bin/triana (Unix) or %TRIANA/bin/triana.bat (Windows) Course website

About Triana Distributed Problem Solving Environment Workflow Based Multiple Component Domains Signal Processing (original domain) Image Processing Text Processing Audio Composite Components

Research Scope Triana is currently funded through 2 main research projects: GridOneD: to investigate P2P and integrating visual distributed programming for Gravitational Wave applications GridLab: one of the 2 project applications (other is Cactus) used to shape the Grid Application Toolkit (GAT)

Components and Definitions Component is unit of execution Components are defined in XML files: Naming information Input and output ports Parameter information Why Components? To simplify the application design process and to speed up application development

Triana Workflow Triana is inherently flow based Data flow - data arriving at component triggers execution Control flow - control commands trigger execution Decentralised execution Data or Control messages sent along communication “pipes” from sender to receiver causes receiver to execute Synchronous or Asynchronous messaging (Implementation dependant) Multiple inputs can block or trigger immediately (Component designer defined)

Taskgraph Internal object based workflow graph representation Taskgraph - DAG Tasks Connections External XML representation Simple XML syntax List of participating Task definitions Parent/Child connection Hierarchical (Compound components)

Simple Workflow Example

Example Continued Image is converted to Grey scale and then thresholded (set image less than 136 to black and everything higher to white). difference is then taken between this image and a image where the white lines are thinned out (i.e. detail is taken away). The resulting image is basically the detail of the white parts which were pruned by the ShrinkWhite unit which gives an outline of an image. Group the unit and save it as a new compound component

Coalescing Binary Search GEO 600 Coalescing Binary Search Algorithm implemented as a Triana workflow

Triana Pluggable Architecture Application’s Insert Points Triana TaskGraph Writer Triana Command Writer XML Writer Other Writer TCom Writer Other Writer Triana TaskGraph Reader Triana Command Reader XML Reader WSFL Reader TCom Reader Other Reader Interactive Interactive/OfflineCommunication Channels Triana Engine Command Service Control Plug-in Applications - flexible: apps can use Triana in various ways, as a: - GUI - remote control GUI - or in full inc. GAP/GAT 3 rd Party Application 3 rd Party Application

VDT Reader and Writer