Basic aliensh S. Bagnasco, INFN Torino CNAF Nov 27-28, 2007.

Slides:



Advertisements
Similar presentations
Utilizing the GDB debugger to analyze programs Background and application.
Advertisements

1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification.
Guide To UNIX Using Linux Third Edition
Very Quick & Basic Unix Steven Newhouse Unix is user-friendly. It's just very selective about who its friends are.
Linux Commands LINUX COMMANDS.
L INUX C OMMAND L INE I NTERFACE G UNAANBAN.G
Using Macs and Unix Nancy Griffeth January 6, 2014 Funding for this workshop was provided by the program “Computational Modeling and Analysis of Complex.
AliEn Tutorial MODEL th May, May 2009 Installation of the AliEn software AliEn and the GRID Authentication File Catalogue.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 WP4 hands-on workshop: EDG LCFGng exercises
ALICE Offline Tutorial Using the AliEn Grid Client GSI, 4 th Mar
Unix Primer. Unix Shell The shell is a command programming language that provides an interface to the UNIX operating system. The shell is a “regular”
UNIX command line. In this module you will learn: What is the computer shell What is the command line interface (or Terminal) What is the filesystem tree.
Lesson 7-Creating and Changing Directories. Overview Using directories to create order. Managing files in directories. Using pathnames to manage files.
Guide to Linux Installation and Administration, 2e1 Chapter 8 Basic Administration Tasks.
Chapter Four UNIX File Processing. 2 Lesson A Extracting Information from Files.
Guide To UNIX Using Linux Fourth Edition
– Introduction to the Shell 10/1/2015 Introduction to the Shell – Session Introduction to the Shell – Session 2 · Permissions · Users.
Alice off-line meeting Alberto Colla Cern, October 3, 2005 AliEn How-To Alice off-line meeting Cern, October 3, 2005 Alberto Colla (Alice off-line Calibration.
Introduction to Unix – CS 21 Lecture 9. Lecture Overview Shell description Shell choices History Aliases Topic review.
110/10/06 - AliEn AliEn Tutorial Solutions Panos Christakoglou University of Athens - CERN.
Session 2 Wharton Summer Tech Camp Basic Unix. Agenda Cover basic UNIX commands and useful functions.
Group 1 : Grid Computing Laboratory of Information Technology Supervisors: Alexander Ujhinsky Nikolay Kutovskiy.
Next Unix Topics Tuesday, 2/11 & 18/2014. Change Password (by 2/14/14) ssh to account on – faclinux.cse.ohio-state.edu – stdlinux.cse.ohio-state.edu passwd.
Working with AliEn Kilian Schwarz ALICE Group Meeting April
Introduction to Programming Using C An Introduction to Operating Systems.
Lesson 3-Touring Utilities and System Features. Overview Employing fundamental utilities. Linux terminal sessions. Managing input and output. Using special.
JAliEn Java AliEn middleware A. Grigoras, C. Grigoras, M. Pedreira P Saiz, S. Schreiner ALICE Offline Week – June 2013.
Lecture 02 File and File system. Topics Describe the layout of a Linux file system Display and set paths Describe the most important files, including.
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
 Last lesson, the Windows Operating System was discussed along with the Windows command shell  Unix is a computer operating system, that similarly manages.
Lesson 6-Using Utilities to Accomplish Complex Tasks.
1 Week 8 Creating Simple Shell Scripts. 2 Chapter Objectives  In this chapter, you will :  Learn how to create Shell Scripts  Commenting / Making Portable.
A GANGA tutorial Professor Roger W.L. Jones Lancaster University.
Chapter 10 Periodic Processes Unix System Administration.
AliEn Tutorial ALICE workshop Sibiu 20 th August, 2008 Pablo Saiz.
 Prepared by: Eng. Maryam Adel Abdel-Hady
INTRODUCTION TO SHELL SCRIPTING By Byamukama Frank
Using Linux Kaya Oğuz Room: 310.
Bash Scripting CIRC Summer School 2016 Baowei Liu CIRC Summer School 2016 Baowei Liu.
Advanced Computing Facility Introduction
Introduction to Unix for FreeSurfer Users
GRID COMPUTING.
UNIX To do work for the class, you will be using the Unix operating system. Once connected to the system, you will be presented with a login screen. Once.
AliEn Tutorial Panos Christakoglou University of Athens - CERN
Development Environment Basics
CIRC Winter Boot Camp 2017 Baowei Liu
SUSE Linux Enterprise Desktop Administration
Prepared by: Eng. Maryam Adel Abdel-Hady
MyProxy Server Installation
Andy Wang Object Oriented Programming in C++ COP 3330
Running a job on the grid is easier than you think!
Running a job on the grid is easier than you think!
Submit BOSS Jobs on Distributed Computing System
The Linux Operating System
Shell Script Assignment 1.
Assignment Preliminaries
CSE 303 Concepts and Tools for Software Development
Introduction to UNIX.
LING 408/508: Computational Techniques for Linguists
Web Programming Essentials:
Configuring Internet-related services
Shells, Help, and Paths.
Chapter Four UNIX File Processing.
Getting Started: Amazon AWS Account Creation
Introduction Paul Flynn
Andy Wang Object Oriented Programming in C++ COP 3330
Linux Shell Script Programming
CSE 303 Concepts and Tools for Software Development
Week 1 – Lesson 2: Creating Shell Scripts, Linux Commands
Linux Commands LINUX COMMANDS.
Presentation transcript:

Basic aliensh S. Bagnasco, INFN Torino CNAF Nov 27-28, 2007

Preparing the certificates Certificates should be stored under $HOME/.globus Globus enforces privacy on your private key! (chmod 400)

Changes in environment . /tmp/gclien_env_…

Getting a GRID proxy Authentication command (default is the local username) Happens every 24 hours Put certificate password

Getting an AliEn token

Authentication problems I Globus related: Permissions on $HOME/.globus/userkey.pem are not private to the user chmod 400 userkey.pem Your certificate authority is exotic and not known to the server. Your certificate has expired. Clock skew: Your local computer time is in the future with respect to the server's time. Your local computer time is more in the past than the certificate life time.

Authentication problems II alien-token-init related: You have not gone through all 5 steps of the AliEn user registration. You have not given the AliEn user name as an argument to the token-init command and your local user name is not identical to the AliEn user name. The script wants to bootstrap the installation but you don’t have write permissions on the installation path Avoid bootstrapping by setting the GSHELL_ROOT environment variable. API servers are not working…

Try it out! Upload your certificates to your machines: Store them under e.g: /afs/cern.ch/user/t/trn2301/.globus/ Check that the key file is read only. Get a valid alien token. If asked if you want to compile the gapi and xrootd libs answer YES (everything is already precompiled)

Accessing the shell Message of the day. Standard bash shell with grid comands Main bash features are available. Not all shell helper programs are available. Some local commands (like ls, cat etc) are overwritten with the corresponding GRID commands. File/path tab completion in the virtual GRID directory. Message of the day.

Tab completion working!!! Shell Basic commands I Tab completion working!!!

Shell Basic commands II

Shell Basic commands III

whereis command

Viewing files I

viewing files II

Editing files Define your preferred editor via the variable EDITOR: 'emacs' 'emacs -nw' 'xemacs' 'xemacs -nw' 'pico' 'vi' (DEFAULT) 'vim' The file is temporary in /tmp on your local disk and then is uploaded once you exit the editor!

Clean up old versions

Copying out files GOLDEN RULE If you want to access your local directory structure while you are in the shell you should start by having the prefix “file:” e.g: cp file:/home/pchrist/gshell.sh gshell.sh

File catalogue structure The path name will be: for ‘real’ data: /data/<Year>/<AcceleratorPeriod>/<RunNumber>/ for simulated data: /sim/<Year>/<ProductionType>/<RunNumber>/ Subdirectories will be called: Raw/ cond/ reco/<PassX>/ESD/ reco/<PassX>/AOD/ … File names will look like this: <xxxx>.AliESD.root For further information see: http://indico.cern.ch/conferenceDisplay.py?confId=3280 http://cern.ch/Oldenburg/MetaData/MetaData.doc

Querying the File Catalogue aliensh:[alice] [1] find -x pp /alice/cern.ch/user/p/pchrist/Tutorial/PDC06/* *Merged*tag.root > pp.xml Redirect the output to the xml collection.

Querying the File catalogue aliensh:[alice] [1] find -x pp /alice/data/2008/LHC08a/*/reco/Pass3/* *Merged*tag.root Run:collision_system=”pp” and Run:stop<"2008-03-20 10:20:33" and Run:start>"2008-03-19" > pp.xml

Try it out I Access the alien shell and try some simple commands: Check your user name by typing ‘whoami’. List the contents of your home directory. Print the working directory. Create the following directory structure in your AliEn space: $HOME/bin (if it is not there) $HOME/GridSchool Get the information of the file with ‘whereis’: /alice/cern.ch/user/s/sbagnasc/GridSchool/GridSchoolNov2007.tgz Check $HOME

Try it out II Try the -v option! Copy the AliEn file /alice/cern.ch/user/s/sbagnasc/GridSchool/GridTutorial-November2007.tgz to your local $HOME/GridSchool Exit the shell and unpack the file locally by typing: tar xvzf GridSchoolNov2007.tgz Enter again the shell and register: The .csh files in your AliEn $HOME/bin The .jdl files in your AliEn $HOME/GridSchool Try the -v option!

Try it out iII Play with the ‘find’ command: Access the shell again and query the f.c. and get all the tag files (*.tag.root) under: /alice/sim/2007/LHC07c/pp_minbias/8268/* Get the output on your terminal (find /alice/…) Get the output on your terminal in a xml format (find -x tag /alice/…) Redirect the results to the tag.xml collection: the output will not be stored in your AliEn working directory but rather in your local working directory. Repeat the previous exercise limiting the number of output files to 5 (find -l 5 ...).

Tomorrow Whatever is left over from today… Write a JDL to generate some file Submit the job and check its progress Check the job’s output Write a JDL to look at the output Submit it to run wherever the file is Get the result If there is some time left, do the same actually generating MC events and reconstructing them, or even analyzing some PDC data…