Presentation is loading. Please wait.

Presentation is loading. Please wait.

Grid Workflow within Triana Ian Wang Cardiff University.

Similar presentations


Presentation on theme: "Grid Workflow within Triana Ian Wang Cardiff University."— Presentation transcript:

1 Grid Workflow within Triana Ian Wang Cardiff University

2 Ian Wang, Cardiff University GridLab E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components Information Services (iGrid) …

3 Ian Wang, Cardiff University GridLab GAT Application-level API Abstract ‘Common’ Capabilities required by Grid Applications Resource Discovery Job Submission File Transfer Capabilities extracted through a number of Grid Application Scenarios. Makes life as a Grid programmer easier … Motivation for the GGF SAGA research group (Simple API for Grid Applications)

4 Ian Wang, Cardiff University GAT Architecture GRMSGRAM Local File Service GridFTP HTTP Local Resource Broker File GridLab GAT API Application (e.g. Triana) Adaptors Services GRMS iGridMercury File Transfer GRAM Grid FTP HTTP

5 Ian Wang, Cardiff University Using the GAT GATContext context = new GATContext(); Preferences prefs = new Preferences(); prefs.put("ResourceBroker.adaptor.name", "grms"); URI exe = new URI("file:////bin/hostname"); File outFile = GAT.createFile(context, prefs, new URI("file:///out") SoftwareDescription sd = new SoftwareDescription(); sd.setLocation(exe); sd.setStdout(outFile); ResourceDescription rd = new HardwareResourceDescription(); rd.put("hostname", "bouscat.cs.cf.ac.uk"); JobDescription jd = new JobDescription(sd, rd); ResourceBroker broker = GAT.createResourceBroker(context, prefs); Job job = broker.submitJob(jd);

6 Ian Wang, Cardiff University Visual GAT GAT Primitives represented as Workflow Objects Job Tasks File Tasks Grid Data Flow implicit in Workflow Connections File Task -> File Task = Data Transfer File Task -> Job Task = Pre-Stage File File Task -> Local Task = File Read Grid Operations handled by GAT Adaptors Grid File -> Grid File = GridFTP HTTP File -> Local Task = HTTP Grid File -> GRMS Job = GRMS Pre-Stage

7 Ian Wang, Cardiff University Grid Workflow in Triana Local Java Unit File (Local/Remote) Temporary File Job (Local/Remote) File WritePre-StagePost-StageFile Read

8 Ian Wang, Cardiff University Visual GAT Alternative Grid Operations Expressed Explicitly GridFTP Tasks File Write Tasks File Read Tasks Not Intuitive Not Future Proof

9 Ian Wang, Cardiff University File Input (HTTP) GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Triana WaveToy.par

10 Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed Triana File Staging (GridFTP) WaveToy.par

11 Ian Wang, Cardiff University Mercury GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed GRMS Data Mvment Testbed Triana Delphoi GAS iGrid Job Submission 1 WaveToy.par Cactus

12 Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed GRMS Data Mvment Portal Triana GAS Job Submission 2 Testbed Cactus Instant Mess MercuryDelphoi iGrid

13 Ian Wang, Cardiff University GridLab GAT File CPI GridFTP Adaptor HTTP Adaptor Data Movement Resource Broker CPI Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor www. gridlab. org Testbed Portal Triana Job Submission (GRAM) Testbed Cactus Instant Mess GRAM

14 Ian Wang, Cardiff University GridMonSteer User Side Grid Side WSPeer User Interface Web Service GridMonSteer (gms) cactus phi_xy.jpg phi_yz.jpg submit Application (e.g. Triana) run monitor invoke using SOAP Resource Broker (e.g. GRMS) gms http://www.xyx.org:4802/axis/gms cactus phi_xy.jpgphi_yz.jpg rundir http://www.xyz.org/axis/gms

15 Ian Wang, Cardiff University Triana Grid Workflow Summary GridLab GAT Application-level API Abstracts Common Capabilities required by Grid Applications such as Triana Visual GAT GAT Primitives represented in Triana as Workflow Objects Grid Data Flow implicit in Workflow Connections GridMonSteer Generic Architecture for Monitoring and Steering Legacy Applications


Download ppt "Grid Workflow within Triana Ian Wang Cardiff University."

Similar presentations


Ads by Google