What is Triana?. GAPGAP Triana Distributed Work-flow Network Action Commands Workflow, e.g. BPEL4WS Triana Engine Triana Controlling Service (TCS) Triana.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Under the Hood of a Workflow Manager Matthew Shields, BiodiversityWorld GRID workshop, NeSC, 30 June - 1 July T r a ai n.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
TSpaces Services Suite: Automating the Development and Management of Web Services Presenter: Kevin McCurley IBM Almaden Research Center Contact: Marcus.
Programming Workflow with Triana Services Matthew Shields, SC4DEVO Workshop, July 2004.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 12 Slide 1 Distributed Systems Design 2.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
1 Virtual Machine Resource Monitoring and Networking of Virtual Machines Ananth I. Sundararaj Department of Computer Science Northwestern University July.
JXTA P2P Platform Denny Chen Dai CMPT 771, Spring 08.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
Client/Server Architecture
Middleware for P2P architecture Jikai Yin, Shuai Zhang, Ziwen Zhang.
Programming Scientific and Distributed Workflow with Triana Services Matthew Shields, GGF10 Workflow Workshop, 9th March.
Lecture 2 – MapReduce CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
Grid Workflow within Triana Ian Wang Cardiff University.
Time-critical gravitational wave searches Craig Robinson Cardiff University LIGO-G Z.
Triana Dr Matthew Shields, School of Computer Science, Cardiff University A Problem Solving Environment and Grid Workflow Tool.
Cli/Serv.: JXTA/151 Client/Server Distributed Systems v Objective –explain JXTA, a support environment for P2P services and applications ,
RUNNING PARALLEL APPLICATIONS BEYOND EP WORKLOADS IN DISTRIBUTED COMPUTING ENVIRONMENTS Zholudev Yury.
Application Web Service Toolkit Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University July
GridLab WP12 Access for mobile users GridLab Review, Brussels, Sept What's new in mobile user support Bartek Lewandowski, Piotr Grabowski
A Distributed Computing System Based on BOINC September - CHEP 2004 Pedro Andrade António Amorim Jaime Villate.
DISTRIBUTED COMPUTING
5th GridLab Review, 8 April 2005, Amsterdam WP12: Access for mobile users What's new in mobile user support Piotr Grabowski, Bartek Lewandowski
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
WP9 Resource Management Current status and plans for future Juliusz Pukacki Krzysztof Kurowski Poznan Supercomputing.
Triana: Service-Oriented Examples Ian Taylor Cardiff University, and the Center for Computation and Technology LSU.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Orchestration of an OGSI-enabled scientific application using the Business Process Execution Language Ben Butchart Wolfgang Emmerich University College.
Workflow and Triana Services Matthew Shields, e-Science Workflow Services, 3-5 December T r a ai n.
11 CORE Architecture Mauro Bruno, Monica Scannapieco, Carlo Vaccari, Giulia Vaste Antonino Virgillito, Diego Zardetto (Istat)
Interoperability between Scientific Workflows Ahmed Alqaoud, Ian Taylor, and Andrew Jones Cardiff University 10/09/2008.
Constructing Data Mining Applications based on Web Services Composition Ali Shaikh Ali and Omer Rana
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Interactive task invocation in the Virtual Laboratory M. Okoń, M. Lawenda, T. Rajtar, D. Stokłosa, D. Kaliszan, P. Mierzyński, N. Meyer, M. Stroiński 4.
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Dr. Ian Wang Cardiff University, U.K.. Ian Wang, Cardiff University Peer-to-Peer and Grids What does the Peer-to-Peer paradigm offer Grids? Scalable Decentralized.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Ian Taylor, Cardiff Work-Flow Application Toolkit Eger Meeting Ian Taylor & Ian Wang Cardiff University, UK.
1 A Steering Portal for Condor/DAGMAN Naoya Maruyama on behalf of Akiko Iino Hidemoto Nakada, Satoshi Matsuoka Tokyo Institute of Technology.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Distributed Computing With Triana A Short Course Matthew Shields, Ian Taylor & Ian Wang.
Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking.
Grid Computing Environment Shell By Mehmet Nacar Las Vegas, June 2003.
Marwan Al-Namari 1 Digital Representations. Bits and Bytes Devices can only be in one of two states 0 or 1, yes or no, on or off, … Bit: a unit of data.
Using Federated Services with Triana Matthew Shields Cardiff University.
A GRID solution for Gravitational Waves Signal Analysis from Coalescing Binaries: preliminary algorithms and tests F. Acernese 1,2, F. Barone 2,3, R. De.
INFORMATION TECHNOLOGY
Tool Integration with Data and Computation Grid “Grid Wizard 2”
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
LIGO: The Laser Interferometer Gravitational-wave Observatory Sarah Caudill Louisiana State University Physics Graduate Student LIGO Hanford LIGO Livingston.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Developing GRID Applications GRACE Project
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
MATLAB Distributed, and Other Toolboxes
What's New in eCognition 9
The Design of a Grid Computing System for Drug Discovery and Design
What's New in eCognition 9
GGF10 Workflow Workshop Summary
Presentation transcript:

What is Triana?

GAPGAP Triana Distributed Work-flow Network Action Commands Workflow, e.g. BPEL4WS Triana Engine Triana Controlling Service (TCS) Triana Service & Engine Triana Service & Engine Triana Service & Engine Other Engine Distributed Triana Work-flow - flexible distribution: based around Triana Groups - HPC and Pipelined distribution Triana Gateway

GAP Overview based around a series of Java interface classes with Concrete implementations that form the GAP bindings. The core interface is the –Service Creation and Discovery –Pipe Creation and Discovery –Message Communication –Information

The GAP

Triana Distribution Policies Distributed Triana Prototype –Based around Triana Groups i.e. aggregate tools –Each group can be distributed –Distribution policies: HTC - high throughput/task farming Peer to Peer - allow node to node communication –Each service can be a gateway to finer granularities of distribution: Pipeline Distribution Task-Farming Distribution Triana Service

Distributing Using the GAP Distribution units are standard Triana tools, enabling users to create their own custom distributions –Deploying Triana services –Connecting Triana services Distribution Unit WaveGrapher Gaussian FFT Gaussian FFT Remote Services Local Triana The workflow is cloned/split/rewired to achieve the required distribution topology Custom distribution units allow sub-workflows to be distributed in parallel or pipelined

Remote Deployment User can distribute any task or group of tasks (sub-workflow) Using the GAP Interface, Triana automatically launches a remote service providing that sub-workflow. Input, Output and Control Pipes are connected using the current GAP binding (e.g. JXTA Pipes)

Deploying and Connecting To Remote Services Running services are automatically discovered via the GAP Interface, and appear in the tool tree User can drag remote services onto the workspace and connect cables to them like standard tools (except the cables represent actual JXTA/P2PS pipes) Remote Services

Web Services Binding: Discovery… Triana allows uses the GAP discovery calls to query UDDI repositories Alternatively, users can import services directly from WSDL

Viewing Discovered Services Discovered/Imported Web Services are converted into Triana tools (service name = tool name) (input message parts = in nodes) (output message parts = out nodes) etc… Web Service tools are displayed in the user’s Tool Tree (alongside local tools)

Connecting Workflows Web Service tools can be dropped onto the user’s workspace and connected like local tools A workflow can contain both local and Web Service tools

Red Boxes – Web Services Simple but powerful example: read_bible - extracts verses from the bible BabelFish - translates between English and French (and other languages) Result = The Bible translated into French ! Converting the Bible into French

GEO 600 Inspiral Search Background –Compact binary stars orbiting each other in a close orbit among the most powerful sources of gravitational waves –As the orbital radius decreases a characteristic chirp waveform is produced - amplitude and frequency increase with time until eventually the two bodies merge together Computing –Need 10 Gigaflops to keep up with real time data (modest search..) Data 8kHz in 24-bit resolution (stored in 4 bytes) -> Signal contained within 1 kHz = 2000 samples/second divided into chunks of 15 minutes in duration (i.e. 900 seconds) = 8MB Algorithm –Data is transmitted to a node –Node initialises i.e. generates its templates (around 10000) –fast correlates its templates with data takes 5 hours on a 2 GHz PC running a C program need 20 dedicated PC’s to keep up

Coalescing Binary Search

Triana Prototype GEO 600 Coalescing Binary Search

Coalescing Binary Scenario Gridlab Test-bed GW Data Distributed Storage Logical File Name CB Search Controller GAP web services to GRMS) GW Data Gridlab data management Submit Job Optimised Mapping , SMS notification

Triana Submits Itself … GAP (using GRMS service) Gridlab Testbed

Jxtaserve GSI Enabled NS-2 And more.. The GAP Future: Java Grid Application Prototype Jxta GridLab GAT ( Advertising Discovery Communication GAP Web Services P2PS Job Submission (GRMS) Generic Job Submission Virtual filename data access Data Management Set of generic Java interfaces high level abstractions to Grid services Factory design – dynamic pluggable services OGSA (planned)