12f.1 MPI and Grid Computing UNC-Wilmington, C. Ferner, 2008 Nov 4, 2008.

Slides:



Advertisements
Similar presentations
Generic MPI Job Submission by the P-GRADE Grid Portal Zoltán Farkas MTA SZTAKI.
Advertisements

Distributed Systems basics
Cross-site running on TeraGrid using MPICH-G2 Presented by Krishna Muriki (SDSC) on behalf of Dr. Nick Karonis (NIU)
Grid Computing, B. Wilkinson, C Program Command Line Arguments A normal C program specifies command line arguments to be passed to main with:
Grid Computing, Barry Wilkinson, 2004A3.1 Assignment 3 Simple Job Submission Using GRAM.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
NorduGrid Grid Manager developed at NorduGrid project.
Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.
Grid Computing Hakan ÜNLÜ CMPE 511 Presentation Fall 2004.
Condor-G: A Computation Management Agent for Multi-Institutional Grids James Frey, Todd Tannenbaum, Miron Livny, Ian Foster, Steven Tuecke Reporter: Fu-Jiun.
A Computation Management Agent for Multi-Institutional Grids
EGEE-II INFSO-RI Enabling Grids for E-sciencE Supporting MPI Applications on EGEE Grids Zoltán Farkas MTA SZTAKI.
USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
A Grid Parallel Application Framework Jeremy Villalobos PhD student Department of Computer Science University of North Carolina Charlotte.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
6a.1 Globus Toolkit Execution Management. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS.
Assignment 3 Using GRAM to Submit a Job to the Grid James Ruff Senior Western Carolina University Department of Mathematics and Computer Science.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Computational Grids Aaron Witt EECC 756 May 18, 1999.
Grid Services at NERSC Shreyas Cholia Open Software and Programming Group, NERSC NERSC User Group Meeting September 17, 2007.
Workload Management Massimo Sgaravatto INFN Padova.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Grids and Globus at BNL Presented by John Scott Leita.
Cross Cluster Migration Remote access support Adianto Wibisono supervised by : Dr. Dick van Albada Kamil Iskra, M. Sc.
Simo Niskala Teemu Pasanen
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”
Prof. Heon Y. Yeom Distributed Computing Systems Lab. Seoul National University FT-MPICH : Providing fault tolerance for MPI parallel applications.
INFN-GRID Globus evaluation (WP 1) Massimo Sgaravatto INFN Padova for the INFN Globus group
Chao “Bill” Xie, Victor Bolet, Art Vandenberg Georgia State University, Atlanta, GA 30303, USA February 22/23, 2006 SURA, Washington DC Memory Efficient.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Grid Computing I CONDOR.
The Grid - Multi-Domain Distributed Computing Kai Rasmussen Paul Ruggieri.
A Geographically-Distributed, Assignment-Structured Undergraduate Grid Computing Course Mark A. Holliday, Barry Wilkinson, Jeffrey House, Samir Daoud,
CSF4 Meta-Scheduler Name: Zhaohui Ding, Xiaohui Wei
National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.
Evaluation of Agent Teamwork High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007.
Web Services BOF This is a proposed new working group coming out of the Grid Computing Environments Research Group, as an outgrowth of their investigations.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
Report from USA Massimo Sgaravatto INFN Padova. Introduction Workload management system for productions Monte Carlo productions, data reconstructions.
Developing Applications on Today’s Grids Tom Goodale Max Planck Institute for Gravitational Physics
Java Commodity Grid (Java CogKit) Java CogKits allow developers to use commodity technologies such as Java or Python in programming the Grid based on Globus.
Part Five: Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
Review of Condor,SGE,LSF,PBS
Basic Grid Projects - Globus Sathish Vadhiyar Sources/Credits: Project web pages, publications available at Globus site. Some of the figures were also.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Using the ARCS Grid and Compute Cloud Jim McGovern.
Globus Grid Tutorial Part 2: Running Programs Across Multiple Resources.
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
3/12/2013Computer Engg, IIT(BHU)1 MPI-1. MESSAGE PASSING INTERFACE A message passing library specification Extended message-passing model Not a language.
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
1 Advanced MPI William D. Gropp Rusty Lusk and Rajeev Thakur Mathematics and Computer Science Division Argonne National Laboratory.
The Globus Toolkit The Globus project was started by Ian Foster and Carl Kesselman from Argonne National Labs and USC respectively. The Globus toolkit.
CSF. © Platform Computing Inc CSF – Community Scheduler Framework Not a Platform product Contributed enhancement to The Globus Toolkit Standards.
Best 20 jobs jobs sites.
Workload Management Workpackage
Agent Teamwork Research Assistant
Duncan MacMichael & Galen Deal CSS 534 – Autumn 2016
GridBench: A Tool for Benchmarking Grids
Peter Kacsuk – Sipos Gergely MTA SZTAKI
Globus Job Management. Globus Job Management Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.
Wide Area Workload Management Work Package DATAGRID project
Presentation transcript:

12f.1 MPI and Grid Computing UNC-Wilmington, C. Ferner, 2008 Nov 4, 2008

12f.2 MPICH-G2 MPICH is an implementation of the standard MPI MPICH-G is an implementation of MPI that uses the Globus Toolkit MPICH-G2 is a complete redesign and reimplementation of MPICH-G

12f.3 MPICH-G2 MPICH-G2 hides heterogeneity by using the Globus Toolkit for –authentication –authorization –exectutable staing –process control –communication –redirection of standard input and output –remote file access

12f.4 % grid-proxy-init % mpirun -np 6 myprog mpirun globusrun DUROC GRAM CondorforkSGE MDS GASS P0P1P2P3P4P5 Generates RSL Submits multiple jobs Authenticates, Coordinates Startup Initiates Job, Detects Termination Process Control

12f.5 RSL mpirun will generate the RSL or one can create/provide the RSL This is RSL version 1 (not XML)‏ + ( &(resourceManagerContact="m1.utech.edu") (count=10)‏ (jobtype=mpi)‏ (label="subjob 0")‏ (environment=(GLOBUS_DUROC_SUBJOB_INDEX 0))‏ (directory=/homes/users/smith)‏ (executable=/homes/users/smith/myapp)‏ )‏ ( &(resourceManagerContact="m2.utech.edu") (count=10)‏ (label="subjob 1")‏ (environment=(GLOBUS_DUROC_SUBJOB_INDEX 1))‏ (directory=/homes/users/smith)‏ (executable=/homes/users/smith/myapp)‏ )‏ ( &(resourceManagerContact="c1.nlab.gov") (count=10)‏ (jobtype=mpi)‏ (label="subjob 2")‏ (environment=(GLOBUS_DUROC_SUBJOB_INDEX 2))‏ (directory=/users/smith)‏ (executable=/users/smith/myapp)‏ )‏

12f.6 Topology Early implementations of MPI's collective communication operations assumed all processes were equidistant from on another. This assumption is unlikely in a Grid environment Shared-Memory Cluster Cluster 2 Site ASite B

12f.7 Topology Use the concept of Communicators, MPICH-G2 collective communication operations are topology-aware. It uses the concept of “levels” and “colors”