1. Christian Kocks April 3, 2012 High-Performance Computing Cluster in Aachen

2. Christian Kocks April 3, 2012 Slide 2 www.kommunikationstechnik.org Typical Simulation Workflow Simulator developmentSimulationEvaluation and visualization of results

3. Christian Kocks April 3, 2012 Slide 3 www.kommunikationstechnik.org Workflow for Simulations on HPC Cluster Develop simulator on local PC / server Perform short tests on local PC / server Transfer simulator to HPC cluster (Subversion!) Perform short tests on HPC cluster using the Linux login shell Enqueue simulations on HPC cluster Wait for notification e-mail from HPC cluster Transfer results to local PC / server (e.g. with WinSCP using SCP protocol) Evaluate and visualize results on local PC HPCHigh-Performance Computing SCPSecure Copy

4. Christian Kocks April 3, 2012 Slide 4 www.kommunikationstechnik.org Local Simulations vs. HPC Cluster Simulations Local simulationsHPC cluster simulation Execution of simulations can be directly controlledSimulations must be enqueued Very low setup time necessary to start simulationSome preparation necessary for running simulations Number of available resources very limited“Unlimited” resources Number of parallel jobs limited“Unlimited” number of parallel jobs Arrangements with colleagues necessaryNo arrangements necessary number of simulations total simulation time local HPC cluster

5. Christian Kocks April 3, 2012 Slide 5 www.kommunikationstechnik.org Using Matlab on HPC Cluster Connect to Linux login shell using SSH client (e.g. PuTTY): Server name: cluster-linux.rz.rwth-aachen.de Load Matlab modules: module load MISC module load matlab Start Matlab: matlab -nodisplay -nodesktop -nosplash -nojvm -logfile job.log -c @lic-serv.uni-due.de Alternative: use graphical remote session (with NX client)

6. Christian Kocks April 3, 2012 Slide 6 www.kommunikationstechnik.org Using Subversion on HPC Cluster Use Subversion module svntest for first tests Check out Subversion module (e.g. svntest) from KT server: svn checkout https://134.91.99.160/svn/svntest/trunk [dst] Update local working copy: svn update Add file test.m: svn add test.m Commit changes to KT server: svn commit

7. Christian Kocks April 3, 2012 Slide 7 www.kommunikationstechnik.org Sample Queue Script File https://versions1.kt.uni-due.de/svn/lib/trunk/simulators/sim_awgn_matlab/sample_simple.sh #!/usr/bin/env zsh #BSUB -J sim_awgn_matlab# job name #BSUB -o sim_awgn_matlab.%J# job output (use %J for job id) #BSUB -e sim_awgn_matlab.e%J# error output #BSUB -W 0:20 # hard limits in hours:minutes #BSUB -M 512 # memory in MB #BSUB -u my.name@kommunikationstechnik.org# e-mail address for notification #BSUB -N# enable e-mail notification #BSUB -n 2# request number of compute slots #BSUB -a openmp# use esub for OpenMP/shared memory jobs ### load matlab modules module load MISC module load matlab ### change to the work directory cd $HOME/svn/lib/simulators/sim_awgn_matlab ### run matlab matlab -nodisplay -nodesktop -nosplash -nojvm -logfile job.log -c @lic-serv.uni-due.de <sim_awgn_matlab_run.m

8. Christian Kocks April 3, 2012 Slide 8 www.kommunikationstechnik.org Sample Queue Script File – Advanced https://versions1.kt.uni-due.de/svn/lib/trunk/simulators/sim_awgn_matlab/sample_advanced.sh #!/usr/bin/env zsh #BSUB -J sim_awgn_matlab# job name #BSUB -o sim_awgn_matlab.%J# job output (use %J for job id) #BSUB -e sim_awgn_matlab.e%J# error output #BSUB -W 0:20 # hard limits in hours:minutes #BSUB -M 512 # memory in MB #BSUB -u my.name@kommunikationstechnik.org# e-mail address for notification #BSUB -N# enable e-mail notification #BSUB -n 2# request number of compute slots #BSUB -a openmp# use esub for OpenMP/shared memory jobs ### load matlab modules module load MISC module load matlab ### change to the work directory cd $HOME/svn/lib/simulators/sim_awgn_matlab ### run matlab matlab -nodisplay -nodesktop -nosplash -nojvm -logfile job.log -c @lic-serv.uni-due.de <<EOF sim_awgn_matlab('ebn0', 6.78952, 'ModulationOrder', 2, 'Log', 'true', 'NumSymbols', 1000, ‚Filename', 'sample_advanced'); EOF

9. Christian Kocks April 3, 2012 Slide 9 www.kommunikationstechnik.org Job Management Enqueue a job: bsub <myscript.sh Query unfinished jobs: bjobs Kill unfinished job: bkill [job ID]

10. Christian Kocks April 3, 2012 Slide 10 www.kommunikationstechnik.org General Hints for using HPC Cluster Ask Mrs. Tiedtke from Uni DuE for HPC cluster account Write the simulator in a way to allow the execution of multiple small simulations instead of one long simulation Collect simulation parameters and results in MAT file Deactivate all graphical outputs Read “HPC Primer” for further information on using the cluster Visit http://www.rz.rwth-aachen.de/aw/cms/rz/Themen/~mem/hochleistungsrechnen

11. Christian Kocks April 3, 2012 Slide 11 www.kommunikationstechnik.org High-Performance Computing Cluster in Aachen Demonstration…