Assignment 3 Using GRAM to Submit a Job to the Grid James Ruff Senior Western Carolina University Department of Mathematics and Computer Science.

Slides:



Advertisements
Similar presentations
Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Advertisements

Globus Workshop at CoreGrid Summer School 2006 Dipl.-Inf. Hamza Mehammed Leibniz Computing Centre.
Generic MPI Job Submission by the P-GRADE Grid Portal Zoltán Farkas MTA SZTAKI.
WS-JDML: A Web Service Interface for Job Submission and Monitoring Stephen M C Gough William Lee London e-Science Centre Department of Computing, Imperial.
Grid Computing, Barry Wilkinson, 2004A3.1 Assignment 3 Simple Job Submission Using GRAM.
A3.1 Assignment 3 Simple Job Submission Using GT 4 GRAM.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
NorduGrid Grid Manager developed at NorduGrid project.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
A Computation Management Agent for Multi-Institutional Grids
EGEE-II INFSO-RI Enabling Grids for E-sciencE Supporting MPI Applications on EGEE Grids Zoltán Farkas MTA SZTAKI.
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
2-1.1 Job Submission © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification date: Jan 18, 2010.
1c.1 Assignment 2 Preliminaries Review Full details in assignment write-up. ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 24, 2007.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
6a.1 Globus Toolkit Execution Management. Data Management Security Common Runtime Execution Management Information Services Web Services Components Non-WS.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Grids and Globus at BNL Presented by John Scott Leita.
1b.1 Globus Toolkit 4.0 Grid Resource Allocation Manager (GRAM) Job submission ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 24,
Globus Computing Infrustructure Software Globus Toolkit 11-2.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.
Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”
1 History and New Developments in State-wide Grid Computing Course NC A & T University Saturday Oct 18, 2008 Dr. Barry Wilkinson University of North Carolina.
High Performance Louisiana State University - LONI HPC Enablement Workshop – LaTech University,
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.
3-2.1 Topics Grid Computing Meta-schedulers –Condor-G –Gridway Distributed Resource Management Application (DRMAA) © 2010 B. Wilkinson/Clayton Ferner.
Nadia LAJILI User Interface User Interface 4 Février 2002.
A Geographically-Distributed, Assignment-Structured Undergraduate Grid Computing Course Mark A. Holliday, Barry Wilkinson, Jeffrey House, Samir Daoud,
Rochester Institute of Technology Job Submission Andrew Pangborn & Myles Maxfield 10/19/2015Service Oriented Cyberinfrastructure Lab,
How to use Oracle Grid OEM to deploy J2EE applications By: Charles Li Date: 5/2/2005 Updated: 10/12/2005.
2-1.1 Job Submission Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 2, pp
Military Technical Academy Bucharest, 2004 GETTING ACCESS TO THE GRID Authentication, Authorization and Delegation ADINA RIPOSAN Applied Information Technology.
August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003.
1 5th AstroGrid-D Meeting, MPE Garching Frank Breiting, AIP November 14, 2006 Status of the Dynamo Use Case as prepared by Michael Braun Frank Breitling.
Communicating Security Assertions over the GridFTP Control Channel Rajkumar Kettimuthu 1,2, Liu Wantao 3,4, Frank Siebenlist 1,2 and Ian Foster 1,2,3 1.
Grid Infrastructure group (Charlotte): Barry Wilkinson Jeremy Villalobos Nikul Suthar Keyur Sheth Department of Computer Science UNC-Charlotte March 16,
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
Part Five: Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.
APST Internals Sathish Vadhiyar. apstd daemon should be started on the local resource Opens a port to listen for apst client requests Runs on the host.
Condor Project Computer Sciences Department University of Wisconsin-Madison Grids and Condor Barcelona,
1 High-Performance Grid Computing and Research Networking Presented by David Villegas Instructor: S. Masoud Sadjadi
Creating and running an application.
1 Introduction to Teaching Grid Computing Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of North Carolina Charlotte.
High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.
Job Submission with Globus, Condor, and Condor-G Selim Kalayci Florida International University 07/21/2009 Note: Slides are compiled from various TeraGrid.
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
Globus Grid Tutorial Part 2: Running Programs Across Multiple Resources.
© Geodise Project, University of Southampton, Geodise Compute Toolbox Functions CommandFunctionCommandFunction gd_certinfo.
Accounting in DataGrid HLR software demo Andrea Guarise Milano, September 11, 2001.
Manchester Computing Supercomputing, Visualization & eScience Seamless Access to Multiple Datasets Mike AS Jones ● Demo Run-through.
1 An unattended, fault-tolerant approach for the execution of distributed applications Manuel Rodríguez-Pascual, Rafael Mayo-García CIEMAT Madrid, Spain.
GridWay Overview John-Paul Robinson University of Alabama at Birmingham SURAgrid All-Hands Meeting Washington, D.C. March 15, 2007.
Practical using C++ WMProxy API advanced job submission
Duncan MacMichael & Galen Deal CSS 534 – Autumn 2016
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Creating and running applications on the NGS
Globus Job Management. Globus Job Management Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.
Wide Area Workload Management Work Package DATAGRID project
Presentation transcript:

Assignment 3 Using GRAM to Submit a Job to the Grid James Ruff Senior Western Carolina University Department of Mathematics and Computer Science

What is GRAM? GRAM stands for Globus Resource Allocation Manager. GRAM is used as the interface to request and use different resources. GRAM submissions are called ‘job(s)’.

What does GRAM require? GRAM requires that the users are entered into an authorization file called the grid-mapfile. A container must be running on both ends of the request. (i.e. at MCNC and WCU) The user using the request to have a certificate, and that certificate be trusted at both ends of the job submission. A valid proxy for the user.

Requirements Met! There is already a container listening to port 8443 on the cluster. We will use this container to submit jobs. The user accounts for this demonstration are correctly configured for the cluster. We now need a proxy: % grid-proxy-init

Our First Job Submission For all of the examples that we will be doing, the scheduler (i.e., what places the jobs on different nodes) will be the Fork scheduler. Submit our first job: % globusrun-ws –submit –F \ ourhost:8443 –streaming –c \ /usr/bin/uptime

What happened? GRAM checked for authentication for your request. Once confirmed, the scheduler is called. (In our case, the Fork Job Scheduler.) As each part of the job is completed, the output is streamed to our console. After job completion, the credentials used are cleaned up. The job only executed on the machine that we ran the GRAM request on.

Specifying a Job Request using RSL RSL stands for (Globus) Resource Specification Language. (XML Format) RSL provides a simple medium to define a job with many parameters, without having to rely only on the command line.

A Sample RSL File /bin/echo ${GLOBUS_USER_HOME} 12 abc 34 pdscaex_instr_GrADS_grads23_28919.cfg pgwynnel was here PI GLOBUS_DUROC_SUBJOB_INDEX 0 ${GLOBUS_USER_HOME}/stdout ${GLOBUS_USER_HOME}/stderr 1 multiple

A Few Points from the RSL /bin/echo - Specifies the location of the binary that should be executed Provides arguments to the binary. ${GLOBUS_USER_HOME}/stdout - Specifies the Standard Output file. 1 - Defines how many times the binary should be executed.

Submitting the RSL file The command to submit the RSL file is almost identical to the previous example: % globusrun-ws –submit –f \ $GLOBUS_LOCATION/test/globus_wsr f_gram_service_java_test_unit/te st.xml

What’s Next? Students will be required to complete a Java program. The Java program will be required to be run using the command line and an RSL form.

Questions? Please ask!