HPC at HCC Jun Wang Outline of Workshop1 Overview of HPC Computing Resources at HCC How to obtain an account at HCC How to login a Linux cluster at HCC.

Slides:



Advertisements
Similar presentations
Linux, it's not Windows A short introduction to the sub-department's computer systems Gareth Thomas.
Advertisements

Learning Unix/Linux Bioinformatics Orientation 2008 Eric Bishop.
Cosc 4750 Getting Started in UNIX Don’t be afraid of the prompt, in linux it can be your best friend. In some cases, the only way to do certain things.
Dayu Zhang 9/8/2014 Lab02. Example of Commands pwd --- show your current directory This is home of venus, not your home directory Tilde: means you are.
CSCI 1411 FUNDAMENTALS OF COMPUTING LAB Lab Introduction 1 Shane Transue MSCS.
Using HPC for Ansys CFX and Fluent
Working Environment - - Linux - -.
T UTORIAL OF U NIX C OMMAND & SHELL SCRIPT S 5027 Professor: Dr. Shu-Ching Chen TA: Samira Pouyanfar Spring 2015.
Dayu Zhang 9/3/2014 Lab01. Lab Instructor: Dayu Zhang Office Hour Mon/Wed 10:40am – 11:10am Room A201 Lab Website
Introduction to RCC for Intro to MRI 2014 July 25, 2014.
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
How to Install Windows 7.
Understanding the Basics of Computational Informatics Summer School, Hungary, Szeged Methos L. Müller.
A crash course in njit’s Afs
L INUX C OMMAND L INE I NTERFACE G UNAANBAN.G
Using Linux Text Editors. Use Non-Graphical Linux Text Editors Graphical Text Editor.
ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 22, 2011assignprelim.1 Assignment Preliminaries ITCS 6010/8010 Spring 2011.
ITCS 4/5145 Parallel Programming, UNC-Charlotte, B. Wilkinson, 2012, Jan 18, 2012assignprelim.1 Assignment Preliminaries ITCS 4145/5145 Spring 2012.
Overview of Linux CS3530 Spring 2014 Dr. José M. Garrido Department of Computer Science.
Help session: Unix basics Keith 9/9/2011. Login in Unix lab  User name: ug0xx Password: ece321 (initial)  The password will not be displayed on the.
HCC Workshop August 29, Introduction to LINUX ●Operating system like Windows or OS X (but different) ●OS used by HCC ●Means of communicating with.
Welcome to Linux & Shell Scripting Small Group How to learn how to Code Workshop small-group/
Linux environment ● Graphical interface – X-window + window manager ● Text interface – terminal + shell.
Cmsc 312 Operating Systems. UNIX? DOS – PC? VAX/VMS - mainframe Unix – PC, workstation, mainframe 1970 bell Lab For computer scientist? Why popular? Free.
BIOSTAT LINUX CLUSTER By Helen Wang October 11, 2012.
VIPBG LINUX CLUSTER By Helen Wang March 29th, 2013.
AN INTRO TO UNIX/LINUX COMMANDS BY: JIAYANG WANG.
1 Editing a C Program 01/16/15. 2 Objective Use Linux to edit, compile and execute a C program.
ITCS 4/5010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Dec 28, 2012assignprelim.1 Assignment Preliminaries ITCS 4010/5010 Spring 2013.
ACCESS IC LAB Graduate Institute of Electronics Engineering, NTU Usage of Workstation Lecturer: Yu-Hao( 陳郁豪 ) Date:
1 Lab 2 “Hello world” in Unix/Linux #include "std_lib_facilities_4.h" int main(){ cout
Getting started: Basics Outline: I.Connecting to cluster: ssh II.Connecting outside UCF firewall: VPN client III.Introduction to Linux IV.Intoduction to.
Next Unix Topics Tuesday, 2/11 & 18/2014. Change Password (by 2/14/14) ssh to account on – faclinux.cse.ohio-state.edu – stdlinux.cse.ohio-state.edu passwd.
Unix and Samba By: IC Labs (Raj Kidambi). What is Unix?  Unix stands for UNiplexed Information and Computing System. (It was originally spelled "Unics.")
1May 16, 2005 Week 2 Lab Agenda Command Line FTP Commands Review More UNIX commands to learn File name expansion - * Introduction of vi.
More on Using onyx 8/28/13. Program 1 Due a week from today. See website for details.
HPC at HCC Jun Wang Outline of Workshop2 Familiar with Linux file system Familiar with Shell environment Familiar with module command Familiar with queuing.
AN INTRO TO UNIX/LINUX COMMANDS BY: JIAYANG WANG.
Dr. Sajib Datta Jan 16,  The website is up.  Course lectures will be uploaded there ◦ Check regularly for assignments and update.
Assignprelim.1 Assignment Preliminaries © 2012 B. Wilkinson/Clayton Ferner. Modification date: Jan 16a, 2014.
Assignprelim.1 Assignment Preliminaries © 2012 B. Wilkinson/Clayton Ferner. Modification date: Aug 10, 2012.
Advanced Computing Facility Introduction
Linux & Joker – An Introduction
Interacting with the cluster ssh, sftp, & slurm batch scripts
Brief introduction about “Grid at LNS”
GRID COMPUTING.
How to Work on your METEO 473 codes from your PC at home
Tutorial of Unix Command & shell scriptS 5027
CS1010: Intro Workshop.
Development Environment Basics
HPC usage and software packages
Getting started with CentOS Linux
Web Programming Essentials:
How to use the HPCC to do stuff
Andy Wang Object Oriented Programming in C++ COP 3330
Parallel computation with R & Python on TACC HPC server
Assignment Preliminaries
Practice #0: Introduction
Ubuntu Working in Terminal
Tutorial of Unix Command & shell scriptS 5027
Tutorial of Unix Command & shell scriptS 5027
The Linux Command Line Chapter 12
Using HPC for Ansys CFX and Fluent
College of Engineering
CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster
Web Programming Essentials:
Tutorial of Unix Command & shell scriptS 5027
Run Java file with Window cmd
High Performance Computing in Bioinformatics
Getting started with CentOS Linux
Presentation transcript:

HPC at HCC Jun Wang Outline of Workshop1 Overview of HPC Computing Resources at HCC How to obtain an account at HCC How to login a Linux cluster at HCC How to Copy files to/from Linux cluster at HCC Commonly Used Linux commands Change password to your own after first login How to edit a file using Linux vi editor

HPC at HCC Jun Wang ClusterOverviewProcessorsRAMConnectionStorage Firefly 720 node production-mode LINUX cluster 871 (2.8 GHz, 64 bit) Opteron, 4-Core Per Node GHz, 8-Core Per Node 8 GB per node 800 MB/sec Infiniband interconnect 150 TB shared Panasas storage 6 TB SATA RAID 73 GB per node Sandhills 44 Node Production-mode LINUX cluster 1344 cores 2.2 GHz AMD Opteron cores at 1.9GHz AMD Opteron Nodes with 128GB per node 2 Nodes with 256GB per node QDR Infiniband Gigabit Ethernet ~1.5TB per node Red 266 node Production-mode LINUX cluster 40x Opteron x Opteron x Xeon E x Xeon E5530 ~2500 Condor job slots 1.5-2GB RAM per job slot Gigabit Ethernet ~2 PB of raw storage space Tusker 106 node Production-mode LINUX cluster Opteron GHz, 4 CPU/64 cores per node 256 GB RAM per node QDR Infiniband ~350 TB shared Lustre storage ~500GB local scratch Overview of HPC Computing Resources at HCC

HPC at HCC Jun Wang Firefly Sandhills RedTusker

HPC at HCC Jun Wang How to obtain an account at HCC Group account application for faculty User account application for faculty/postdocs/students

HPC at HCC Jun Wang How to login a Linux cluster at HCC On PC: Download putty.exe to your desktop from

HPC at HCC Jun Wang How to login a Linux cluster at HCC On Mac: Click “Applications”-->”Utilities”-->”Terminal” Type “ssh

HPC at HCC Jun Wang How to Copy files to/from Linux cluster at HCC On PC: Download a free app WinSCP Install it using all default options Note: You may need to convert file generated on Windows to Linux format Type “dos2unix xxx” in a Linux terminal, where xxx the file name

HPC at HCC Jun Wang How to Copy files to/from Linux cluster at HCC On Mac: Open a terminal and type “scp -r $PWD/xxx ” to upload Open a terminal and type “scp -r ” to

HPC at HCC Jun Wang Commonly Used Linux commands Changes directories:cd /directory/directory Lists files:ls Copies files: cp thisfile.txt /home/thisdirectory Moves files: mv thisfile.txt /home/thisdirectory Deletes files: rm thisfile.txt Creates a directory: mkdir directory View a file: less thisfile.txt Displays your present working directory: pwd Reset your password:passwd Finds a string of text in a file: grep -i “Phrase” * -R Search a file in a directory:find /SomeDirectory -name SomeFileName -type f --print Exit a terminal:exit Displays command help: man command

HPC at HCC Jun Wang Change password to your own after first login Type “passwd” after login to any HCC cluster Note: HCC uses LDAP to share users account and password info across all HCC clusters HCC password rule: Password minimum length 8Minimum required digit characters 1 Minimum required alpha characters 1Minimum required upper case characters 1 Minimum required character categories 1Minimum token length 1

HPC at HCC Jun Wang How to edit a file using Linux vi editor Type “vi test-vi” to create a file called test-vi Press “Enter” key to enter command mode Press “i” key to enter edit mode Type some characters

HPC at HCC Jun Wang How to edit a file using Linux vi editor Press “Esc” key to switch to command mode Type“:wq” and Press ”Enter” key to save file and exit to command line Type “q” to quit. Press “i” key to re-edit and “Esc” when done. Type “q!” to quit without save or “wq” to save and quit Retype “vi test-vi” to check saved test-vi

HPC at HCC Jun Wang Thank you for your attention! Hands-on practice on zeng-cuda.unl.edu if you do not have a HCC account Username: workshop Create your own directory

HPC at HCC Jun Wang Familiar with Linux file system Familiar with Shell environment Familiar with queuing system How to submit a serial job How to submit a MPI parallel job You may download this ppt file at the newly designed electronics shop website To be continued: