Presentation is loading. Please wait.

Presentation is loading. Please wait.

ScaleDB Transactional Shared Disk storage engine for MySQL Moshe Shadmon, Founder, CTO.

Similar presentations


Presentation on theme: "ScaleDB Transactional Shared Disk storage engine for MySQL Moshe Shadmon, Founder, CTO."— Presentation transcript:

1 ScaleDB Transactional Shared Disk storage engine for MySQL Moshe Shadmon, Founder, CTO

2 The product Storage Layer MySQL-ScaleDB Interface DBMS/Apps Storage Engine

3 ScaleDB Benefits Enables open source DBMS (eg: MySQL) to operate as clustered, high end database Scales applications in cloud environments No need to change the applications Provides high performance Provides unified data store

4 Shared Disk vs. Shared Nothing Shared Nothing Shared Disk Masters Slaves SQL Server DB2 (Unix) MySQL PostgreSQL Oracle RAC IBM - DB2, IMS (MF) ScaleDB

5 Shared Disk vs Shared Nothing Shared NothingShared Disk StoragePer DBMS machineShared storage (NAS/SAN) ScalabilityBy data partitioningBy adding CPU Scaling complexityHighLow High AvailabilityMaster-SlaveMulti-Masters HA complexityHighLow Implemented ByMySQL PostgreSQL SQL Server DB2 (Unix) Oracle RAC IBM on mainframe (DB2/IMS) ScaleDB Shared disk provides out of the box scalability and availability Currently available with the high end commercial databases only

6 Server 1 OSS DBMS ScaleDB VM The Virtualized Cloud Database Local Disk OSS DBMS Storage Engine MySQL Server Server 2 OSS DBMS ScaleDB VM OSS DBMS ScaleDB VM OSS DBMS ScaleDB VM OSS DBMS ScaleDB VM Shared Storage Shared Disk Shared Nothing

7 Standby Cluster Manager Deploying ScaleDB … ScaleDB Cluster Manager Node 1 DBMS ScaleDB Node 2 DBMS ScaleDB Node N DBMS ScaleDB Application Application Layer Database Layer (Physical or VM nodes) Storage Layer Shared Storage ScaleDB

8 Benefits of ScaleDB Technology High Availability – No single point of failure If a node fails – a different node takes over If the cluster manager fails – the standby cluster manager is initiated to manage the cluster Scalability No limit on the number of nodes that can join the cluster Algorithms to minimize the need to communicate Performance Innovative, high performance, general purpose indexing

9 ScaleDB Cluster Manager ScaleDB Node ScaleDB API Transaction Manager Index Manager Index Manager Data Manager Data Manager Buffer Manager Lock Manager Local Lock Manager Global Lock Coordinator Log Manager Recovery Manager Recovery Manager Storage Manager Global Recovery Manager Global Lock Manager Global Lock Manager Global Buffer Manager Global Buffer Manager File System Storage Devices ScaleDBs Internal Architecture Applications XML

10 ScaleDB Cluster Manager ScaleDB Node Read Customer Info File System Storage Devices Distributed Lock Manager Index translates logical id to Row ID Shared DBMS lock Shared Table lock Shared Row lock DBMS X Table Y Block Z Node 1 R/W Node 1 R Node 2 R/W Node 2 R Node 2 R/W H List W List

11 Shared Disk in the Cloud Cloud provides Scalability and HA Scalability - Enables dynamic allocation of computing and storage Availability – Multiple servers over the same physical data High performance Reduces Management Overhead Reduced tuning and partitioning support No manual slave promotion or replication

12 Performance / Scalability Benchmarks Join operations using Multi-Table index Sysbench TPCC Example multiple MySQL + ScaleDB nodes on Amazon EC2 Demo

13 Benchmark multi-table index

14 Sysbench Performance on EC2 775 TPS Number of Nodes TPS Transactions Per Second ScaleDB Other Engine

15 Current & Future Work Optimizing TPCC – soon to be published Integrating with other environments GA – later this year Demo


Download ppt "ScaleDB Transactional Shared Disk storage engine for MySQL Moshe Shadmon, Founder, CTO."

Similar presentations


Ads by Google