1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification.

Slides:



Advertisements
Similar presentations
Secure File Transfer Protocol (SFTP) With Secure Copy (SC) What is a Secure File Transfer Protocol with Secure Copy???
Advertisements

NIMAC 2.0: The Accessible Media Producer Portal NIMAC 2.0 for AMPs.
Sonny J Zambrana University of Pennsylvania ISC-SEO November 2008.
Grid Computing, Barry Wilkinson, 2004A3.1 Assignment 3 Simple Job Submission Using GRAM.
A3.1 Assignment 3 Simple Job Submission Using GT 4 GRAM.
Linux, it's not Windows A short introduction to the sub-department's computer systems Gareth Thomas.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
Presentation Two: Grid Security Part Two: Grid Security A: Grid Security Infrastructure (GSI) B: PKI and X.509 certificates C: Proxy certificates D:
Grid Security. Typical Grid Scenario Users Resources.
1c.1 Assignment 2 Preliminaries Review Full details in assignment write-up. ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 24, 2007.
Summer School Certificates Diego Romano & Gilda Team.
AssignPrelim1.1 © 2011 B. Wilkinson/Clayton Ferner. Modification date: Aug 22, 2011 Course Preliminaries.
X.509 at the University of Michigan CIC-RPG Meeting June 7, 1999 Kevin Coffman Bill Doster
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
AssignPrelim1.1 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson. Course Preliminaries.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
AssignPrelim1.1 ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 13, 2007 Course Preliminaries.
Assignment 3 Using GRAM to Submit a Job to the Grid James Ruff Senior Western Carolina University Department of Mathematics and Computer Science.
1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of.
1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Security Mechanisms The European DataGrid Project Team
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
Website Tutorial. Administration  Log on by clicking Login on the footer of almost any page  Your Username is.
Agenda What is Computer Programming? The Programming Process
ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 22, 2011assignprelim.1 Assignment Preliminaries ITCS 6010/8010 Spring 2011.
Week 2 File Systems & Unix Commands. File System Hierarchy.
Security Directions - Release 6 and beyond SearchDomino.com Webcast Patricia Booth Security and Directory Product Management 9/25/02.
1 History and New Developments in State-wide Grid Computing Course NC A & T University Saturday Oct 18, 2008 Dr. Barry Wilkinson University of North Carolina.
ITCS 4/5145 Parallel Programming, UNC-Charlotte, B. Wilkinson, 2012, Jan 18, 2012assignprelim.1 Assignment Preliminaries ITCS 4145/5145 Spring 2012.
CS105 Lab 1 – Introduction Section: ??? TA: ??? ??? Announcements CITES Accounts Compass Netfiles Other Administrative Information CS105 Fall
Tomcat Setup BCIS 3680 Enterprise Programming. Getting Web Apps to Work  Verify that Tomcat works.  Understand how context works.  Create folders/files.
PROGRAMMING PROJECT POLICIES AND UNIX INTRO Sal LaMarca CSCI 1302, Fall 2009.
AE6382 Secure Shell Usually referred to as ssh, the name refers to both a program and a protocol. The program ssh is one of the most useful networking.
ITCS 4/5010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Dec 28, 2012assignprelim.1 Assignment Preliminaries ITCS 4010/5010 Spring 2013.
E-science grid facility for Europe and Latin America E2GRIS1 Raúl Priego Martínez – CETA-CIEMAT (Spain)‏ Itacuruça (Brazil), 2-15 November.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003.
Grid NERSC demo Shreyas Cholia Open Software and Programming NERSC User Group Meeting September 19, 2007.
Exporting User Certificate from Internet Explorer.
Globus Toolkit Installation Report. What is Globus Toolkit? The Globus Toolkit is an open source software toolkit used for building Grid systems.
Association with the Gilda Virtual Organization Certificate,VO membership, and MyProxy Server usage.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Apr. 25, Grid Computing Hands On Training for Users Faculty of Sciences, University.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
Copyright © 2006, Infinite Campus, Inc. All rights reserved. User Security Administration.
From “Control Panel”, launch “Programs and Features” then select “Turn Windows features on or off” Lab 2: Setup Lab Environment.
1 Day 2 Logging in, Passwords, Man, talk, write. 2 Logging in Unix is a multi user system –Many people can be using it at the same time. –Connections.
1 Getting Started with C++ Part 2 Linux. 2 Getting Started on Linux Now we will look at Linux. See how to copy files between Windows and Linux Compile.
Integrity Check As You Well Know, It Is A Violation Of Academic Integrity To Fake The Results On Any.
 Last lesson, the Windows Operating System was discussed along with the Windows command shell  Unix is a computer operating system, that similarly manages.
Security on Grid: User Interface, Internals and APIs Simone Campana LCG Experiment Integration and Support CERN IT.
Tomcat Setup BCIS 3680 Enterprise Programming. One-Click Tomcat Setup 2  This semester we’ll try to set up Tomcat with a PowerShell script.  Preparation.
Integrity Check As You Well Know, It Is A Violation Of Academic Integrity To Fake The Results On Any.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Hands on Security, Authentication and Authorization Virginia Martín-Rubio Pascual RedIRIS/Red.es Curso Grid y e-Ciencia.
EGI-InSPIRE RI Grid Training for Power Users EGI-InSPIRE N G I A E G I S Grid Training for Power Users Institute of Physics Belgrade.
Enabling Grids for E-sciencE gLite security pratical tutorial Dario Russo INFN Catania Catania,
SSH. 2 SSH – Secure Shell SSH is a cryptographic protocol – Implemented in software originally for remote login applications – One most popular software.
Assignprelim.1 Assignment Preliminaries © 2012 B. Wilkinson/Clayton Ferner. Modification date: Jan 16a, 2014.
Assignprelim.1 Assignment Preliminaries © 2012 B. Wilkinson/Clayton Ferner. Modification date: Aug 10, 2012.
Using Crontab with Ubuntu
Part 3 – Remote Connection, File Transfer, Remote Environments
CRC exercises Not happy with the way the document for testbed architecture is progressing More a collection of contributions from the mware groups rather.
Assignment Preliminaries
Viet Tran Institute of Informatics Slovakia
File Transfer Olivia Irving and Cameron Foss
CGS 3175: Internet Applications Fall 2009
Assignment Preliminaries
Presentation transcript:

1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification date: Sept 9b, 2011

1c.2 Traditional way from a Windows system is to use PuTTY to get remote access. Obtain from ~sgtatham/putty/download.html Remote Access coit-grid01.uncc.edu Select ssh Can save and reload

1c.3 WinSCP Another method is WinSCP will can be used for file transfer as well as a login client via secured socket layer Obtain from Remote directory Local directory Drag to move files

1c.4 WinSCP console window Console terminal selection

1c.5 As will be fully explained later in the course, X509 certificates used to provide security in a Grid system. Each user needs a certificate issued (signed) by a “certificate authority” (CA). The course CA is set up on coit-grid02.uncc.edu. User “certificates”

1c.6 Requesting a certificate 1.Log into coit-grid01.uncc.edu 2.Issue the command grid-cert-request You will be prompted for your name and a passphrase. (Yet another password!) Don't forget this. We cannot reset it if you lose it. Obtaining a “certificate” You will not do this on the assignment

1c.7 Requesting a certificate This will produce three files in.globus in your home directory: usercert_request.pem usercert.pem (an empty file)‏ userkey.pem Obtaining a “certificate” cont. You will not do this on the assignment

1c.8 Request: usercert_request.pem –Certificate request, which you should send to CA. Certificate: usercert.pem –Initially an empty file. Signed certificate from CA will be placed here. (In assignment, this will be done for you.)‏ User’s private key: userkey.pem –Private key associated with your certificate request, encrypted with pass phrase that you entered when prompted by grid-cert-request. Files held by user after using grid-cert-request You will not do this on the assignment

1c file grid-cert-request.pem to CA course administrator (the course TA).‏ Request your certificate within 2 days, as we need time to sign and download. 2. CA administrator will create certificate as file usercert.pem. In our case, CA administrator will secure copy this file into your.globus directory replacing empty file created with grid-cert- request. 3. You will receive an when this has been done. Obtaining a “certificate” cont. You will not do this on the assignment

1c.10 4.Test that certificate works by issuing the command grid-proxy-init which creates a “proxy” certificate to access resources on your behalf. You will be prompted for a passphase, which will be the same as you used when making the request. 5. Check that you got a proxy by using the command: grid-proxy-info which will show the proxy subject and time left. Proxy can be destroyed with: grid-proxy-destroy Obtaining a “proxy certificate” You will not do this on the assignment

1c.11 1.When you registered to use the portal a certificate request was created for you automatically using the slides above. The CA signed your certificate and stored them on the MyProxy server (coit-grid02.uncc.edu). 2.The MyProxy server is a repository for certificates and private keys. Using the MyProxy server, your private key is better protected. 3.The obtain a proxy certificate issue the command myproxy-logon –s coit-grid02.uncc.edu You will be prompted for a passphase, which should be the password you supplied when you registered yourself on the portal. Obtaining a “proxy certificate” using the MyProxy server

1c.12 4.Check that you got a proxy by using the command: grid-proxy-info which will show the proxy subject and time left. 5.To see the complete proxy information, you can use the command: openssl x509 –in proxy_path -noout –text Where “proxy_path” is the path given by the grid-proxy-info command. 6.Proxy can be destroyed with: grid-proxy-destroy Obtaining a “proxy certificate” using the MyProxy server (cont.)

1c.13 Submitting a job Assignment first asks you to submit a job using the –c option: globusrun-ws -submit -F localhost:8440 -s -so echo_output -c /bin/echo hello This should simply work. You are asked to check the output.

1c.14 Then create XML job description document (JDD) and resubmit using that: globusrun-ws -submit -F localhost:8440 -f test1.xml At this point, you will need to use an editor to create test1.xml. Use any. One suggestion is to use nano.

1c.15 nano In your case, you will be using coit-grid01.edu Control key commands: Control-O to save, Control-X to exit

1c.16 Next step is run the same command on the machine torvalds.cis.uncw.edu globusrun-ws -submit -F torvalds.cis.uncw.edu -f test1.xml After seeing that it works, you will perform the same multi-step application using different grid resource with data movement as you did in the first assignment. You will want to have two ssh windows (one logged into the servers at the two sites) to verify the results

1c.17 Task 3b: Create XML job description document to perform the integration using the trapeziodal method and submit to run on coit-grid01. Task 3c:Transfer the output to torvalds: globus-url-copy file:///path to your directory/ area_output gsiftp://torvalds.cis.uncw.edu/path to your directory/ Task 3d: Create XML job description document to perform the computation of the mulch and submit to run on torvalds. Task 3e: Transfer the output back to coit-grid01 from torvalds using globus-url-copy.

1c.18 Compute area of flower bed torvaldscoit-grid01 area_ output Compute volume and cost of mulch globus-url-copy mulch_ output globus-url-copy mulch_ output area_ output

1c.19 Task 4 asks you to do file staging as well as file cleanup as part of the XML job description file. This means that the globusrun-ws command will take care of the file transfer for you. You won’t need to execute the globus-url-copy commands. The file staging and file cleanup should go in the XML job description file just before the closing tag.

1c.20 Stage in and stage out are similar in structure, except source and destination will likely be reversed: gsiftp://coit-grid01.uncc.edu:2811/path to file file:///${GLOBUS_USER_HOME}/path/ Note that the variable “${GLOBUS_USER_HOME} is defined to the be users home directory on the remote server, not the local computer.

1c.21 File clean up is structure like this: path to file...

1c.22 Questions?