NVIDIA® GRID™ GPU Acceleration for the Cloud Steve Harpster, Solutions Architect North/South America sharpster@nvidia.com Brad Truman, VP-Sales Whitehat Virtual Technologies, Austin TX Brad.Truman@whitehatvirtual.com 512-762-1855

Focus on Quality of the End-User Experience Core Competence in Citrix Technologies Average 15 years Citrix Experience Dell Preferred Partner (DVS, server, storage, networking) Only NVIDIA GRID Partner in Texas

Virtualization 101 Guest OS VIRTUAL MACHINE HYPERVISOR Server Client App VDA Guest OS Software Virtual Driver Virtual Driver Virtual Driver Virtual Driver NVIDIA Driver Client VIRTUAL MACHINE Virtualization vCPU vMemory vStorage vNetwork GPU HYPERVISOR Server Hardware CPU Memory Storage Network GPU

GPU Virtualized Datacenter AEC Government Oil and Gas Energy Exploration Design & Manufacturing Healthcare e.g. Radiology, MRI Aerospace Education Media & Entertainment QUADRO Workstation GRID GPU Virtualized Datacenter

NVIDIA GRID K2 NVIDIA GRID K1 DESIGNER NVIDIA GRID K1 POWER USER GPU 4 Kepler GPUs 2 High End Kepler GPUs CUDA Cores 768 (192/GPU) 3072 (1536/GPU) Memory Size 16GB DDR3 (4GB/GPU) 8GB GDDR5 (4GB/GPU) Max Power 130 W 225 W Equivalent Quadro with Pass-through Quadro K600 (entry) Quadro K5000 (high end) There are two GRID cards available today GRID K1: Knowledge Workers + Power Users 4 entry-level Kepler GPUs + 16GB of memory high user density (more memory => more users) => solution for best user scalability GRID K2: Designer 2 high-end Kepler GPUs + 8GB of super fast GDDR5 memory lower user density BUT more performance => solution for most demanding users Key Features: GPU horse power: entry level vs. high-end (8x of entry-level GPU) Memory: 16GB vs. 8GB User density: 4-100 vs. 2-64 Power: 130W vs. 225W => that’s what servers are designed for Watts per User => no graphics processer in the world delivers this efficiency (watts per user); integrated graphics around 10W Supports latest graphics & compute APIs OpenGL 4.3 DX 11 CUDA 5 NVIDIA VGX virtualization (to be release mid 2013) KNOWLEDGE WORKER 1 Number of users depends on software solution, workload, and screen resolution

NVIDIA GRID™ Enabled OEM Platforms Cisco UCS C240 M3 Dell PowerEdge R720 Fujitsu Celsius C620 Fujitsu Celsius R930 HP ProLiant WS460c Gen8 HP ProLiant SL250s Gen8 IBM iDataPlex dx360 M4 IBM Flex System Need servers to stick them in => server roadmap Available today Dell IBM Cisco Asus Supermicro Tyan Sugon Inspur Near Future HP Fujitsu Hitachi Quanta For more information on GRID enabled servers visit www.nvidia.com/buygrid

VDI SOLUTIONS ROADMAP

Graphics Options in Virtualization

GRID Enabled Roadmap for Citrix XenDesktop DESIGNER POWER USER KNOWLEDGE WORKER Virtual Workstation VDI Dedicated GPU Citrix HDX 3D Pro XenDesktop 7.0 XenServer 7 GPU Dedicated per user Today In Tech Preview NOW! HARDWARE VIRTUALIZATION + VGX Hypervisor XenDesktop 7 Virtualized GPUs for users

2H 2013 XenDT 7 Announcement at Synergy of XenDesktop 7 on next gen XenServer “Clearwater”

GRID vGPU = Hardware Virtualization Hypervisor Virtual Machine 2H 2013 XenDT 7 GPU Hypervisor Guest OS Hypervisor Device Emulation Framework Apps Virtual GPU Manager Virtual Desktop Remote Protocol Resource Manager NVIDIA GRID USM (Driver) Partition GPU memory & allocate to <= 8 VMs Graphics Commands State 2nd Step: integration of hypervisor with VM driver (USM-User Selectable Machine) and remote protocol. For Citrix the Virtual Desktop is XenDesktop remoting via the HDX or ICA protocols. Unique NVIDIA contribution in the Per-VM Dedicated Channels to improve the VM performance. Each VDI vendor will choose their own remote protocol to differentiate their solution. E.g. VMware supports PCoIP today running on a UDP network transport. NVIDIA promotes h.264 video formats since so many mobile devices support hardware decompression of h.264 video streams. NVIDIA GRID GPU Per-VM Dedicated Channels GPU MMU Per-VM Dedicate Channel Remote Display Per-VM Dedicate Channel Per-VM Dedicate Channel 4GB memory per GPU

GRID vGPU Profiles Card Physical GPUs Virtual GPU Use Case Frame Buffer (MB) Virtual Display Heads Maximum Resolution Maximum vGPUs per GPU per Board GRID K2 2 GRID K260Q Typical Designer 2048 4 2560x1600 GRID K240Q Entry-Level Designer 1024 8 GRID K200 Knowledge Wkr 256 1920x1200 16 GRID K1 GRID K140Q Basic Designer GRID K100 32

GRID vGPU Hardware Virtualization PARTITION GRID K2 GPU FRAMEBUFFER 1 user XDT VM at 4GB memory (Quadro K5000 memory size) 2 user XDT VMs at 2GB each (Quadro 4000 memory size) 4 user XDT VMs at 1GB each (Quadro 2000 memory size) 8 user XDT VMs at 256MB each (Low-Resolution VDI) 2H 2013 XenDT 7 Virtual GPU or VGX Hypervisor integration into XenServer and XenDesktop allows GPU memory allocation to user VMs. The user’s pixels are stored in this GPU memory partition. The policy that allocates the memory could be compared to traditional Quadro graphics that you have selected today for your engineering & design users. NVIDIA GRID K2 4GB memory per GPU 4GB memory per GPU

GRID Enabled for Citrix XenApp 6.5 App Virtualization (Sessions) Virtual Workstation DESIGNER Citrix HDX 3D XenApp 6.5 add-on Windows Server GPU sharing for OpenGL 4.2 & DirectX 11 Citrix XenApp 5 Windows Server CPU based software rasterization Citrix HDX 3D XenApp 6.5 Windows Server GPU sharing for DirectX 9 POWER USER VDI KNOWLEDGE WORKER

XenApp in a VM VIRTUAL MACHINE 1 VIRTUAL MACHINE 2 HYPERVISOR Server Windows Server OS Virtual Driver NVIDIA Driver App XenApp Session Windows Server OS Virtual Driver NVIDIA Driver App XenApp Session Software VIRTUAL MACHINE 1 vCPU vMemory vStorage vNetwork VIRTUAL MACHINE 2 vCPU vMemory vStorage vNetwork GPU #1 GPU #2 Virtualization HYPERVISOR Our demo at Citrix Synergy used GRID K2 with each card running 2 XenApp VMs (Virtual Servers) Server Hardware CPU Memory Storage Network GRID K2

GRID Enabled Solutions Roadmap for VMware Dedicated GPU VMware vDGA View 5.3 ESX 5.1/5.5 Citrix HDX 3D Pro + VMware Hypervisor XenDesktop 7 ESX 5.1/5/5 Software Virtualization VMware vSGA Virtual Workstation DESIGNER POWER USER Citrix on VMware is tested – see Citrix website VDI API-Intercept KNOWLEDGE WORKER

Src: GTC2013 presentation “S3544 3D Apps Vmware Horizon View”

GRID Enabled Solutions Roadmap for Microsoft Available Now Virtual Workstation DESIGNER Software Virtualization Microsoft RemoteFX Server 2008 R2 DirectX 9 Server 2012 DirectX 9, 10, 11 POWER USER VDI KNOWLEDGE WORKER

Linux Application Desktops Red Hat KVM with GPU Pass-Through announced at SuperComputing’13 in November Beta in Fedora core 20 Production RHEL 7

Linux in a VM HYPERVISOR RHEL Ubuntu CentOS … HP RGS NICE DCV Linux OS NVIDIA Driver App Linux OS Virtual Driver NVIDIA Driver App Remote VDA Session Remote VDA Session Software HP RGS NICE DCV VIRTUAL MACHINE 1 vCPU vMemory vStorage vNetwork VIRTUAL MACHINE 2 vCPU vMemory vStorage vNetwork GPU #1 GPU #2 Virtualization HYPERVISOR Our demo at Citrix Synergy used GRID K2 with each card running 2 XenApp VMs (Virtual Servers) Red Hat KVM XenServer VMware ESXi Server Hardware CPU Memory Storage Network GRID K2

Status June 2013 OGL 4.3 DX 9, 10, 11 NVIDIA CUDA OGL 4.3 DX 9, 10, 11 HDX 3D Pro XenDesktop XenServer DESIGNER (CATIA, CS6, Inventor) OGL 4.3 DX 9, 10, 11 NVIDIA CUDA HDX 3D XDT AE/XenApp XenServer POWER USER (PLM, Med. Image, Showcase) OGL 4.3 DX 9, 10, 11 NVIDIA CUDA vDGA View vSphere KNOWLEDGE WORKER (MS Office, Photoshop) vSGA View vSphere OGL 2.1; DX 9 There are 3 Virtualized Graphics architectures to support the user classes today. Direct GPU assignment to one user ( GPU Pass-Through ) Software Virtualization with API intercept ( shared graphics from GPU ) CPU-only graphics in software with no hardware acceleration ( traditional VDI ) RemoteFX TASK WORKER (Call Center Apps) Server 2012 Hyper-V OGL 1.1, DX 9, 10, 11

Big graphics ISVs ARCHITECTURE, ENGINEERING, CONSTRUCTION (AEC) MFG & PRODUCT DESIGN CIVIL ENGINEERING ENERGY & NATURAL RESOURCES Revit, AutoCAD CATIA, SolidWorks Micro Station ArcGIS Explorer Inventor, AutoCAD SmartPlant SolidEdge, Teamcenter Creo, Pro/E

GRID Reference Architecture User NVIDIA GRID Hypervisor Virtual Desktop Agent Recommended Configuration Designer K2 4 Users 2 GRID K2 boards Dual socket server 64 GB system memory Power User K1 8 Users 2 GRID K1 boards 96 GB system memory Knowledge Worker 8-32+ Users Minimum 128 GB system memory XenServer 7 XenDesktop 7 (with HDX 3D Pro) or or XenDesktop71 (with HDX 3D Pro) View 5.3 or ESXi 5.1/5.3 with vDGA or XenServer 7 XenDesktop 7 (with HDX 3D Pro) or or XenDesktop 7 (with HDX 3D Pro) View 5.3 or ESXi 5.1/5.5 with vDGA or XenServer 7 XenDesktop 7 (with HDX 3D Pro) or or ESXi 5.1/5.5 with vSGA View 5.X or or Windows Server 2012 With Hyper-V Remote FX