Hodor HPC Cluster LON MNG HPN Head Node Comp Node Comp Node Comp Node Parallel Storage
Hodor HPC Cluster Head Node 2 CPUs – 8 Cores - SandyBridge 64GB RAM Module Files Open MPI, Intel MPI GCC, Intel COMPILERS SLURM Job Scheduler Head Node HPN MNG LON Comp Node Parallel Storage
Hodor HPC Cluster Head Node Must Request an Account Authentication Campus Connection File Transfer SCP SFTP Globus Compile Very Short Test Runs Do not USE mpirun / mpiexec Head Node HPN MNG LON Comp Node Parallel Storage
Hodor HPC Cluster Head Node SSH Keys Are Allowed Must Append new keys Replacing keys will break your account Must be on-campus to connect Or use Campus VPN Incorrect password attempts will block user access. Head Node HPN MNG LON Comp Node Parallel Storage
Hodor HPC Cluster Compute Nodes x 32 2 CPUs – 4 Cores – SandyBridge 16 Nvidia Tesla K20m GPUs 16 Xeon Phi 31P1s Co-processors 64GB RAM Module Files Use “srun” to get Bash Shell Head Node HPN MNG LON Comp Node Parallel Storage
Shared File Space /home/user.name /share/apps /cm/shared Not Shared /tmp Heavy I/O should be done in: Must be copied before end of job. Head Node HPN MNG LON Comp Node Parallel Storage
SLURM Queue Information Commands squeue sinfo qstat –a qstat –n qstat –f
SLURM Job Submission Commands srun – for interactive - use of “screen” sbatch - for batch runs
SLURM Job Submission Commands Examples: /share/apps/slurm/examples sbatch somescript.sh srun –N1 –n --pty bash
Important sbatch arguments #SBATCH –N8 #SBATCH --ntasks-per-node=8 #SBATCH –t 00:10:00 #SBATCH –o ./out_test.txt #SBATCh –e ./err_test.txt
Important sbatch environment variables $SLURM_SUBMIT_DIR Path from current dir when sbatch was invoked. $SLURM_NTASKS Total number of tasks in your job $SLURM_JOB_ID ID number identifying your SLURM job.
SLURM Job Delete Commands scancel #### qdel ####
Modulefile Commands module avail module load module list
www.crc.und.edu Website: Hodor Help Info Tutorials & Desktop Software > Linux HPC Cluster (Hodor) Hodor does not have a job submission queue called “test”
Get Hodor Account Send email to: Aaron.Bergstrom@und.edu