1. M AKING M ULTICORE S YSTEMS P ERFORM ! Read IDC’s Insight Report (#211311) on www.exludus.com: Extreme Computing: eXludus Reinvents Job Scheduling and Promises Improved Multicore System Utilization. Published: March 28th, R. Walsh, S. Conway, E. Joseph

2. 2 Multi-Core Application Performance Predictability and Throughput Throughput Run Time { Target Run Time Target Throughput { Under normal operating conditions an application run time determines the throughput capacity of systems. But on multi-core processor systems applications tend to interfere randomly with one another causing an effective loss of capacity to sustain performance level expectations. Node-Level Capacity Management, as per Multi-Core Optimizer, is designed to eliminate job interference performance impacts and optimize throughput. Throughput Run Time { Target Run Time Optimal Throughput { MultiCore Variability

3. 3 MCore Optimizer: Dynamic Operational Research Given aircraft fleet (processor cores) Given hubs to service (jobs) Find optimal flight schedule to carry most passengers (throughput)

4. 4 MCore Optimizer: Resource Allocation No OS / Application Change Real-time optimal job mix search Prevents job interference Blocks resource conflicts ‘Learns’ job resources needed Each color represents one of eleven jobs, white spaces represent unused resources. With MCore Optimizer Time CPUMemory Throughput Gain Without MCore Optimizer CPU Memory

5. 5 MCore Optimizer: Pre-Emptible Backfilling JOB “A” JOB “B” Serial Processing (i.e. WLM) gives best service time response ratio but worst throughput! JOB “A” JOB “B” Concurrent Processing (i.e. OS fair share scheduler) gives best throughput but worst run time response ration… JOB “A” JOB “B” PE-BF Processing gives best throughput and best run time response ratio. A job on the wait Q can temporarily run while the “primary” job blocks

6. 6 MCore Optimizer: Feedback Scheduling DB qsub A.sh qsub -l “500MB,1cpu,300sec” A.sh user MCore Optimizer A.sh MCore Optimizer past run history past run history this run data Tracks job resource use Provides WLM with resource expectations Prevents job interference with resource expectations Supports LSF, PBS Pro, Moab, Torque, Open PBS, SGE

7. 7 RepliCatorVM: Scalable VM Provisioning Performance Re-provision a 3 GB VM image on 1,000 systems in 60 seconds on a 1 Gbit network!

8. benoit.marchand@exludus.com +1 514 885 1270 (cell) dale.geldart@exludus.com +1 514 227 8411 (direct) +1 514 409 6143 (cell)

9. 9 MCore Optimizer: Software Architecture Virtualization technology : jobs run in an encapsulated environment Cooperating “Socially Responsible” resource consumption Aligns and synchronizes resource use across software layers Transparent to OS, Workload Manager & Application No single point of failure Application CApplication B Workload Mgr Application A Operating System Virtualized Resource Allocation Layer … MCore Optimizer

10. 10 Cluster Capacity Management Limit Sampling Loses Control