1. © 2012 MELLANOX TECHNOLOGIES 1 Disruptive Technologies in HPC Interconnect HPC User Forum April 16, 2012

2. © 2012 MELLANOX TECHNOLOGIES 2 Why Virtualization in HPC?  High Performance Computing Single tasks across multiple CPUs  Traditional virtualization in enterprise Many tasks across multiple CPUs Workload consolidation on less machines Oversubscription of resources Operating System HPC App HPC App HPC App HPC App Operating System HPC App HPC App HPC App HPC App Virtualization Layer  Benefits of Virtual Clusters Efficient cluster management Snapshots (checkpoint/restart) Multi-tenant environments Live workload migration

3. © 2012 MELLANOX TECHNOLOGIES 3 High Performance Virtualization over SR-IOV  HCA shared among Guest OS’es Virtual Functions assigned to VM Physical Function controlled by Hypervisor  Complete RDMA software stack run in VMs  Very little throughput and latency overhead  Work in progress to support advance features such as live migration over SR-IOV VM VF PF InfiniBand HCA RDMA Stack VM RDMA Stack VM RDMA Stack Hypervisor

4. © 2012 MELLANOX TECHNOLOGIES 4 Co-Design Strategy for Scalable Computing Network Server/Storage Application Communication Libraries Network Server/Storage Application Communication Libraries Extension of I/O communications (RDMA, collectives, synchronization etc) Throughput Latency Message Rate Transport/Collective Offloads Bottlenecks MPI SHMEM/PGAS

5. © 2012 MELLANOX TECHNOLOGIES 5 ScableMPIScalableSHMEMScalableUPC Utilizing Co-Design – Mellanox ScalableHPC Mellanox Co-Design MXM - MellanoX Messaging FCA – Fabric Collective Accelerations

6. © 2012 MELLANOX TECHNOLOGIES 6 OpenMPI Benchmark Results with Accelerators

7. © 2012 MELLANOX TECHNOLOGIES 7 Collective Acceleration Results for OpenSHMEM

8. © 2012 MELLANOX TECHNOLOGIES 8 Thank You HPC@mellanox.com