Presentation is loading. Please wait.

Presentation is loading. Please wait.

SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.

Published byKimberly Tyler Modified over 8 years ago

Similar presentations

Presentation on theme: "SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking."— Presentation transcript:

1 SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking Center, Poland

2 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 What can you do with the Grid? Access: secure, transparent, remote, wireless, … Visualization: access to computers and services, not server… On demand: get resources you need, when you need, … Sharing: share data & resources over the net, … Failover: migrate and restart applications, … Balance between distributed and central control… (by Brian Hammond 4.30 p.m., 21 June 2004, Heidelberg)

3 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GridLab Project Funded by the EU (5+ M€), January 2002 – March 2005 SUN is our commercial partner Open source license for our software Main goal: to develop a Grid Application Toolkit (a set of high level tools and libraries) together with a set of grid middleware services/systems for: resource management (GRMS), data management, monitoring, adaptive components, mobile user support, security services, portals, mobile access.... and test all GridLab technologies/applications on real testbeds...

4 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GridLab Project and GRMS (1)

5 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GridLab Project and GRMS (2)

6 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GridLab Project and GRMS (3)

7 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS and Core Services

8 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS and Core Services GRMS is using C/Java APIs to Globus 2.X and Pre WS, namely GRAM, GridFTP, GRIS/GISS GRMS stores all historic data in database and various logs Mercury Monitoring System is the most low-level service in GridLab (generic monitoring framework for the grid) Provides instant information about the state of hosts, services and jobs Provides monitoring data represented as metrics via both pull and push model data access semantics and also supports steering by controls. Based on the Grid Monitoring Architecture (GMA) as proposed by the GGF Support application steering (SIGNALS)

9 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS and Middleware Services

10 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS and Middleware Services MORE...

11 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 Various clients to GRMS

12 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 Various clients to GRMS

13 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 Applications and GRMS Example Pegasus/Chimera work-flow

14 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS Job Description XML based language Job executable File location Arguments File argument (files which have to be present in working directory of running executable) Environment variables Standard input Standard output Standard error Checkpoint file (user-level checkpoint)

15 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS Job Description Resource requirements Name of host for job execution (if provided no scheduling algorithms would be used) Operating system Required local resource manager Network parameters Lots of constraints: Minimum memory required Minimum CPUs required Minimum speed of CPUs...

16 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 What is the functionality of the GRMS? 11th May, 2004, GRMS v 1.9.0 released !!! to act in behalf of users on resources and meet application requirements concerning resources, data, etc... to stage-in and stage-out files required by jobs before and after executions using Core Services (GridFTP/GASS/FTP) or GridLab Middleware Services (Replica Catalog Service and Data Movement Service). to use GAS for more advanced security scenarios, to run and control batch jobs remotely, to run and control MPI batch jobs remotely, to run Java applications remotely, to register GAT applications and receive unique JOB IDs, to checkpoint GAT applications remotely, to migrate GAT applications remotely, to store all historic information about job statuses and resources which have been used during a job submission process, to contact the Information Service to receive static and dynamic information about resources, to contact an Adaptive Components Service to get additional information about distributed resources and networks,

17 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 GRMS statistics

18 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 Who is using our software? N*Grid, Cactus, UCoMS, GriPhyN, Griphyn The Grid Infrastructure, Geon, EPhysics Portal, CLUSTERIX, CASPer, GridOneD, GEO 600, Einstein@home, VL- E, GriKS, NRL Protean Group, GEMSS, Ibis, and more...

19 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 What can you do with the Grid? Access: secure (GSI, GAS), transparent (GridLab Middleware), remote, wireless, (portal, mobile phone) Visualization: access to computers and services, not server (Vis service, mobile client to GRMS) On demand: get resources you need, when you need (Job description) Sharing: share data & resources over the net, (GRMS and data management services) Failover: migrate and restart applications (user-level checkpointing and migration)

20 Krzysztof Kurowski, PSNC HPC SUN Consortium, Heidelberg 2004 Please visit: www.gridlab.org www.gridlab.org/WorkPackages/wp-9/ Thank you! More Information / Summary

Download ppt "SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking."

Similar presentations

PIONIER 2003, Poznan, 11.04.2003, PROGRESS Grid Access Environment for SUN Computing Cluster Poznań Supercomputing and Networking Center Cezary Mazurek.

PIONIER 2003, Poznan, , PROGRESS Grid Access Environment for SUN Computing Cluster Poznań Supercomputing and Networking Center Cezary Mazurek.
DATE: 2008/03/11 NCHC-Grid Computing Portal (NCHC-GCE Portal) Project Manager: Dr. Weicheng Huang Developed Team: Chien-Lin Eric Huang Chien-Heng Gary.

DATE: 2008/03/11 NCHC-Grid Computing Portal (NCHC-GCE Portal) Project Manager: Dr. Weicheng Huang Developed Team: Chien-Lin Eric Huang Chien-Heng Gary.
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.

W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
National Institute of Advanced Industrial Science and Technology Ninf-G - Core GridRPC Infrastructure Software OGF19 Yoshio Tanaka (AIST) On behalf.

National Institute of Advanced Industrial Science and Technology Ninf-G - Core GridRPC Infrastructure Software OGF19 Yoshio Tanaka (AIST) On behalf.
Experiences with GridWay on CRO NGI infrastructure / EGEE User Forum 2009 Experiences with GridWay on CRO NGI infrastructure Emir Imamagic, Srce EGEE User.

Experiences with GridWay on CRO NGI infrastructure / EGEE User Forum 2009 Experiences with GridWay on CRO NGI infrastructure Emir Imamagic, Srce EGEE User.
Interaction model of grid services in mobile grid environment Ladislav Pesicka University of West Bohemia.

Interaction model of grid services in mobile grid environment Ladislav Pesicka University of West Bohemia.
EGC 2005, CrossGrid technical achievements, Amsterdam, Feb. 16th, 2005 WP2-3 New Generation Environment for Grid Interactive MPI Applications M igrating.

EGC 2005, CrossGrid technical achievements, Amsterdam, Feb. 16th, 2005 WP2-3 New Generation Environment for Grid Interactive MPI Applications M igrating.
C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.

C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
Global Grid Access Cezary Mazurek, PSNC. Cezary Mazurek, PSNC, Enable access to global grid, Supercomputing 2003, Phoenix, AZ 2 Agenda Introduction PROGRESS.

Global Grid Access Cezary Mazurek, PSNC. Cezary Mazurek, PSNC, Enable access to global grid, Supercomputing 2003, Phoenix, AZ 2 Agenda Introduction PROGRESS.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, 22-24 January 2007. Introduction to Grid portals Gergely Sipos

MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
GridLab Enabling Applications on the Grid Jarek Nabrzyski et al. Poznań Supercomputing and Networking.

GridLab Enabling Applications on the Grid Jarek Nabrzyski et al. Poznań Supercomputing and Networking.
Universität Dortmund Robotics Research Institute Information Technology Section 03.06.2015 Grid Metaschedulers An Overview and Up-to-date Solutions Christian.

Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.

Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Grids and Globus at BNL Presented by John Scott Leita.

Grids and Globus at BNL Presented by John Scott Leita.
UCoMS: Grid Computing Framework for Petroleum Engineering.

UCoMS: Grid Computing Framework for Petroleum Engineering.
W w w. h p c - e u r o p a. o r g The HPC-Europa project and GridSphere Dawid Szejnfeld Poznan Supercomputing.

W w w. h p c - e u r o p a. o r g The HPC-Europa project and GridSphere Dawid Szejnfeld Poznan Supercomputing.
W w w. h p c - e u r o p a. o r g Single Point of Access to Resources of HPC-Europa Krzysztof Kurowski, Jarek Nabrzyski, Ariel Oleksiak, Dawid Szejnfeld.

W w w. h p c - e u r o p a. o r g Single Point of Access to Resources of HPC-Europa Krzysztof Kurowski, Jarek Nabrzyski, Ariel Oleksiak, Dawid Szejnfeld.

Similar presentations

Ads by Google