Presentation is loading. Please wait.

Presentation is loading. Please wait.

IT Infrastructure Database Tuning – Fall 2015. Slotnik’s Law of Effort #1: Heterogeneous Dennis Shasha and Philippe Bonnet, 2013 LOOK UP: Slotnik.

Similar presentations


Presentation on theme: "IT Infrastructure Database Tuning – Fall 2015. Slotnik’s Law of Effort #1: Heterogeneous Dennis Shasha and Philippe Bonnet, 2013 LOOK UP: Slotnik."— Presentation transcript:

1 IT Infrastructure Database Tuning – Fall 2015

2 Slotnik’s Law of Effort #1: Heterogeneous Dennis Shasha and Philippe Bonnet, 2013 LOOK UP: Slotnik vs. Amdahl (AFIPS’67), Michael Flynn’s talk on dataflow machines, Ryan Johnson’s paper on bionic databases.SlotnikAmdahl Michael Flynn’s talk Ryan Johnson’s paper Source:

3 NVidia’s vision Bill Daly’s slide deck on exascale computing project

4 RAID controller PCI Southbridge Chipset [z68]z68 Southbridge Chipset [z68]z68 IO Dennis Shasha and Philippe Bonnet, 2013 SSD HDD PCI Express SSD SATA ports Processor [core i7]core i7 Processor [core i7]core i7 Memory bus RAM LOOK UP: Smart Response Technology (SSD caching managed by z68)Smart Response Technology 16 GB/sec 2x21GB/sec 5 GB/sec 3 GB/sec Byte addressable Block addressable

5 RAID Dennis Shasha and Philippe Bonnet, 2013 CPU RAM PCI bridge Host Bus Adapter Caching Write-back / write-through Logical disk organization JBOD RAID Batteries

6 Read Write Logical address space Scheduling & Mapping Wear Leveling Garbage collection Read Program Erase Chip … … … … Flash memory array Channels Physical address Dennis Shasha and Philippe Bonnet, 2013 Slotnik’s Law of Effort #2: The emergence of SSDs Throughput for 4K read IOs from product specifications Latency of 5000 random writes on an Intel 710 SSD (10 successive passes over 250 KB with 512B random writes on a random formatted device). LOOK UP: The necessary death of the block device interfaceThe necessary death of the block device interface

7 Case: TPC-C Top Performer Dennis Shasha and Philippe Bonnet, 2013 Redo Log Configuration Source: Total system cost30,528,863 USD Performance30,249,688 tpmC Total #processors108 Total #cores1728 Total storage1,76 PB Total #users24,300,000 LOOK UP: TPC-C OLTP BenchmarkTPC-C OLTP Benchmark

8 Warehouse-Scale Dennis Shasha and Philippe Bonnet, 2013 Source: LOOK UP: Werner Voegels on virtualization.Werner Voegels on virtualization

9 Cloud Services IaSS: compute and storage abstractions (VM, load balancer) – ex: AWS, Azure PaSS: execution environment – ex: Google App Engine, AWS, Azure SaSS: managed software – ex: SQL Azure, Snowflake Private, public, hybrid coud

10 source: Microsoft Key metric: number of servers per administrator – Amazon: 10K

11 Database Dennis Shasha and Philippe Bonnet, 2013 Source:

12 Mainframe Fast processors, lots of hardware accelerators, lots of RAM and storage Hardware resources are virtualized: e.g., single- level store High-performance, general purpose applicance; or alternative to a private cloud

13 © Philippe Bonnet, Storage Architectures source: Virtual Geek’s take on storage tree of life – A MUST READ!!Virtual Geek’s take on storage tree of life Storage RAM Interconnect

14 Data-Intensive Applications: Server-side Architectures © Philippe Bonnet, source: Virtual Geek’s take on storage tree of life – A MUST READ!!Virtual Geek’s take on storage tree of life Look up Fabric Computing on Wikipedia.Fabric Computing

15 15 Source: Chad Sakac,EMC, software-defined storage - what's next, vmworld 2014


Download ppt "IT Infrastructure Database Tuning – Fall 2015. Slotnik’s Law of Effort #1: Heterogeneous Dennis Shasha and Philippe Bonnet, 2013 LOOK UP: Slotnik."

Similar presentations


Ads by Google