The Sun Oracle Database Machine Barry Hodges Senior Solution Architect Oracle New Zealand.

Slides:



Advertisements
Similar presentations
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any.
Advertisements

Extreme Performance with Oracle Data Warehousing
1 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Convergence of HPC, Databases, and Analytics Tirthankar Lahiri Senior Director, Oracle.
Exadata Goals Ideal Oracle Database Platform
<Insert Picture Here>
Cloud Computing: Theirs, Mine and Ours Belinda G. Watkins, VP EIS - Network Computing FedEx Services March 11, 2011.
Exadata Distinctives Brown Bag New features for tuning Oracle database applications.
OLAP Tuning. Outline OLAP 101 – Data warehouse architecture – ROLAP, MOLAP and HOLAP Data Cube – Star Schema and operations – The CUBE operator – Tuning.
1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle for Data Warehousing
Oracle Exadata for SAP.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1.
Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse.
Big Data Working with Terabytes in SQL Server Andrew Novick
The Power of Platform Solutions to Transform Higher Education
Oracle Universal Content Management and Storage Systems
IBM 1350 Cluster Expansion Doug Johnson Senior Systems Developer.
Virtualization of Fixed Network Functions on the Oracle Fabric Krishna Srinivasan Director, Product Management Oracle Networking Savi Venkatachalapathy.
10 REASONS Why it makes a good option for your DB IN-MEMORY DATABASES Presenter #10: Robert Vitolo.
Introduction to DBA.
1. Aim High with Oracle Real World Performance Andrew Holdsworth Director Real World Performance Group Server Technologies.
A Fast Growing Market. Interesting New Players Lyzasoft.
1 HYRISE – A Main Memory Hybrid Storage Engine By: Martin Grund, Jens Krüger, Hasso Plattner, Alexander Zeier, Philippe Cudre-Mauroux, Samuel Madden, VLDB.
Oracle Data Warehouse Strategic Update Ray Roccaforte.
Presented by Marie-Gisele Assigue Hon Shea Thursday, March 31 st 2011.
Meanwhile RAM cost continues to drop Moore’s Law on total CPU processing power holds but in parallel processing… CPU clock rate stalled… Because.
Data Warehousing - 3 ISYS 650. Snowflake Schema one or more dimension tables do not join directly to the fact table but must join through other dimension.
CON Software-Defined Networking in a Hybrid, Open Data Center Krishna Srinivasan Senior Principal Product Strategy Manager Oracle Virtual Networking.
Extreme Performance Data Warehousing
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Base Content Slide Larry Ellison CEO, Oracle
Fast Track, Microsoft SQL Server 2008 Parallel Data Warehouse and Traditional Data Warehouse Design BI Best Practices and Tuning for Scaling SQL Server.
© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.
© 2009 Oracle Corporation. S : Slash Storage Costs with Oracle Automatic Storage Management Ara Vagharshakian ASM Product Manager – Oracle Product.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
Oracle BIWA SIG Basics Worldwide association of 2000 professionals interested in Oracle Database-centric business intelligence, data warehousing, and analytical.
1.
Oracle Storage Overview Tomáš Vencelík – Storage sales leader.
Database Systems Design, Implementation, and Management Coronel | Morris 11e ©2015 Cengage Learning. All Rights Reserved. May not be scanned, copied or.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
5 Database Features Every DBA Needs to Know About THT11267 Doug Chamberlain - Principal Product Manger, Oracle Copyright © 2014, Oracle and/or its affiliates.
Oracle Challenges Parallelism Limitations Parallelism is the ability for a single query to be run across multiple processors or servers. Large queries.
Physical Database Design & Performance. Optimizing for Query Performance For DBs with high retrieval traffic as compared to maintenance traffic, optimizing.
September 2011Copyright 2011 Teradata Corporation1 Teradata Columnar.
Data Warehousing at Acxiom Paul Montrose Data Warehousing at Acxiom Paul Montrose.
Data Warehousing 1 Lecture-24 Need for Speed: Parallelism Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.
1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
Oracle Advanced Compression – Reduce Storage, Reduce Costs, Increase Performance Session: S Gregg Christman -- Senior Product Manager Vineet Marwah.
1.
SESSION CODE: BIE07-INT Eric Kraemer Senior Program Manager Microsoft Corporation.
CON Software-Defined Networking in a Hybrid, Open Data Center Krishna Srinivasan Senior Principal Product Strategy Manager Oracle Virtual Networking.
Srik Raghavan Principal Lead Program Manager Kevin Cox Principal Program Manager SESSION CODE: DAT206.
Copyright © 2006, GemStone Systems Inc. All Rights Reserved. Increasing computation throughput with Grid Data Caching Jags Ramnarayan Chief Architect GemStone.
Infrastructure for Data Warehouses. Basics Of Data Access Data Store Machine Memory Buffer Memory Cache Data Store Buffer Bus Structure.
Rajesh Bhat Director, PLM Analytics Applications
Fundamentals of Information Systems, Sixth Edition Chapter 3 Database Systems, Data Centers, and Business Intelligence.
WHAT EXACTLY IS ORACLE EXALYTICS?. 2 What Exactly Is Exalytics? AGENDA Exalytics At A Glance The Exa Family Do We Need Exalytics? Hardware & Software.
Introduction to Exadata X5 and X6 New Features
Oracle Announced New In- Memory Database G1 Emre Eftelioglu, Fen Liu [09/27/13] 1 [1]
Exadata Distinctives 988 Bobby Durrett US Foods. What is Exadata? Complete Oracle database platform Disk storage system Unique to Exadata – intelligent.
Oracle Exalytics Business Intelligence Machine Eshaanan Gounden – Core Technology Team.
JD Edwards EnterpriseOne In-Memory Sales Advisor
Running virtualized Hadoop, does it make sense?
Exadata for Oracle DBAs
Database Performance Tuning and Query Optimization
Blazing-Fast Performance:
Data Lifecycle Review and Outlook
Chapter 11 Database Performance Tuning and Query Optimization
Data Warehousing Concepts
Presentation transcript:

The Sun Oracle Database Machine Barry Hodges Senior Solution Architect Oracle New Zealand

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.

Demonstration

Sun Oracle Database Machine Sun Oracle Database Machine Demonstration Business Case: Analyzing food retail point of sale (POS) data using Exadata Schema Design: 3NF part of the Oracle Retail Data Warehouse Model Data: Generated test data representing a full day of POS data for the US Demo leverages Exadata Storage software but is not running on a real DB Machine

Sun Oracle Database Machine Sun Oracle Database Machine Demonstration – Scenario 1 Goal – show that a query completes twice as fast if the data is spread across twice as manner storage servers Query million rows = time 1 Query million rows = time 1 / 2

Sun Oracle Database Machine Sun Oracle Database Machine Demonstration – Scenario 2 Query million rows = time 1 Query million rows = time 1 Query million rows = time 1 Goal – show how performance is maintained as increasing data volumes are offset by expanding the storage hardware

Sun Oracle Database Machine Sun Oracle Database Machine Demonstration – Scenario 1 Goal – show the difference required in network traffic when not utilising smart scans, storage indexes and other Exadata features Query 1 CELL.SMART_SCAN_CAPABLE = "TRUE" 1.25 GB returned Query 2 CELL.SMART_SCAN_CAPABLE = "FALSE" 27 GB returned

Some Performance Results

Sun Oracle Database Machine Sun Oracle Database Machine Singapore Customer – POC – Full Rack V2 TaskRows Returned Time in Current Environment POC TimeImprovement Multiple computations and group by clause secs (12.5 mins) secs26X Simple Query, Predicate Offload secs (51.9 mins) secs109X Joins of smaller tables secs (117.0 mins) 6.16 secs1139X Spooling large number of rows to file. CTAS benefit secs (61.9 mins) secs50X Insert..Append. Parallel insert, IO capacity used secs (15.1 mins) 7.93 secs114X Average 321X

Sun Oracle Database Machine Sun Oracle Database Machine Giant Eagle One of the largest, privately owned and family-operated companies in the U.S. with annual sales of approximately $7.1 billion 223 Supermarket locations and 125 GetGo ® fuel stations located in Ohio, Pennsylvania, West Virginia and Maryland More than 3.8 million active customers are enrolled in the Giant Eagle Advantage Card ® their loyalty card program 5 million unique customers served annually Participated in the Exadata Beta Program

Sun Oracle Database Machine Sun Oracle Database Machine Giant Eagle – Beta Test – Half Rack V1 TaskTime in Current Environment POC Time ( No Index) Improvement All GetGos for 13 weeks All Transactions4010 secs (66.8 mins) 87 secs45X Bananas - Movement 8 weeks200 secs (3.3 mins) 18 secs10X Bananas - Category secs (7.3 mins) 10 secs43X Coupon Movement Type1264 secs (21.0 mins) 16 secs78X Date to Date Movement Comparison - 53 weeks10980 secs (183.0 mins) 229 secs (3.8 mins) 46X Department Sales for GetGo2588 secs (43.1 mins) 23 secs111X

Sun Oracle Database Machine Sun Oracle Database Machine Giant Eagle – Beta Test – Half Rack V1 TaskTime in Current Environment POC Time ( No Index) Improvement OBI-EE: Merchandising Level 1 Detail: Current - 4 weeks 26 secs3 secs7X OBI-EE: Merchandising Level 1 Detail: Current - 52 weeks 437 secs (7.3 mins) 28 secs14X Promotion Items for 1 week42 secs26 secs0.6X Sales and Customer Counts582 secs (9.7 mins) 30 secs18X Gift Card Movement75 secs (1.2 mins) 7 secs9X Top Movers5525 secs (92 mins) 179 secs (3 mins) 29X

The Propeller Head Stuff

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Data Warehousing Version 1 –World’s Fastest Machine for Data Warehousing –Extreme Performance for Sequential I/O –10x Faster than other Oracle D/W Systems Version 2 –5 x Version 1 Data Warehousing Performance –World’s Fastest Machine for OLTP –Extreme Performance for Random I/O –Dramatic new Exadata Software Capabilities

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Data Warehousing

Sun Oracle Database Machine Sun Oracle Database Machine A Simple Query Example Exadata Storage Grid SUM Optimizer Chooses Partitions and Indexes to Access 10 TB scanned 1 GB returned to servers 10 TB scanned 1 GB returned to servers Oracle Database Grid What were my sales yesterday? select sum(sales) where date = '24-SEPT' select sum(sales) where date = '24-SEPT' Scan compressed blocks in partitions/indexes Retrieve sales amounts for Sept 24 Scan compressed blocks in partitions/indexes Retrieve sales amounts for Sept 24

Sun Oracle Database Machine Sun Oracle Database Machine Exadata Hybrid Columnar Compression Data is grouped by column and then compressed Query Mode for data warehousing Optimised for speed 10X compression typical Scans improve proportionally Archival Mode for infrequently accessed data Optimized to reduce space 15X compression is typical Up to 50X for some data

Sun Oracle Database Machine Sun Oracle Database Machine Flash Flash storage more than doubles scan throughput –50 GB/sec Combined with Hybrid Columnar Compression –Up to 50 TB of data fits in flash –Queries on compressed data run up to 500 GB/sec 50 HITACHI USP V TERADATA 2550 NETEZZA TwinFin 12 SUN ORACLE Database Machine Query Throughput GB/sec Uncompressed Data Flash Disk

Sun Oracle Database Machine Sun Oracle Database Machine Exadata Storage Indexes Exadata Storage Indexes maintain summary information about table data in memory Store MIN and MAX values of columns within disk stripe Eliminates disk I/Os if MIN and MAX can never match “where” clause of a query Completely automatic & transparent ABCD Min B = 1 Max B =5 Table Index Min B = 3 Max B =8 select * from table where B < 2 - Only first set of rows can match

Sun Oracle Database Machine Sun Oracle Database Machine Benefits Multiply 1 TB with compression 10 TB of user data Requires 10 TB of IO 100 GB with partition pruning 20 GB with Storage Indexes 5 GB Smart Scan on Memory or Flash Subsecond On Database Machine Data is 10x Smaller, Scans are 2000x faster

Sun Oracle Database Machine Sun Oracle Database Machine Benefits Multiply Massively parallel high volume hardware to quickly process vast amounts of data Exadata runs data intensive processing directly in storage Row filtering based on “where” predicate, Column filtering, Join filtering, Incremental backup filtering, Storage Indexing, Scans on encrypted data, Data Mining model scoring Most complete analytic capabilities OLAP, Statistics, Spatial, Data Mining, Real-time transactional ETL, Efficient point queries Powerful warehouse specific optimizations Flexible Partitioning, Bitmap Indexing, Join indexing, Materialized Views, Result Cache Data Mining OLAP ETL

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for OLTP

Only Oracle runs real-world business applications “on the Grid” Unique fault-tolerant scale-out OLTP database RAC, Data Guard, Online Operations Unique fault-tolerant scale-out storage suitable for OLTP ASM, Exadata Dramatic New OLTP Capabilities

Sun Oracle Database Machine Sun Oracle Database Machine Flash Disk drives hold vast amounts of data But are limited to about 300 I/Os per second Flash technology holds much less data But can run tens of thousands of I/Os per second Ideal Solution Keep most data on disk for low cost Transparently move hot data to flash Use flash cards instead of flash disks to avoid disk controller limitations Flash cards in Exadata storage High bandwidth, low latency interconnect 300 I/O per Sec Tens of Thousands of I/O’s per Second

Sun Oracle Database Machine Sun Oracle Database Machine Extreme Performance for Random I/O Sun Oracle Database Machine has 5 TB of flash storage 4 high-performance flash cards in every Exadata Storage Server Smart Flash Cache caches hot data Not just simple LRU Knows when to avoid caching to avoid flushing cache Allows optimization by application table Oracle is the First Flash Optimized Database

Sun Oracle Database Machine Sun Oracle Database Machine Extreme Performance for Random I/O Database Machine achieves: 20x more random I/Os Over 1 million per second 2x faster sequential query I/O 50 GB/sec 10x better I/O response time Sub-millisecond Greatly Reduced Cost 10x fewer disks needed for I/O Lower Power 5X More I/Os than 1000 Disk Enterprise Storage Array

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Consolidation

Typical Oracle Deployment Model

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Consolidation

Consolidation mixes many different workloads in one system Warehouse oriented bulk data processing OLTP oriented random updates Multimedia oriented streaming files The Sun Oracle Database Machine handles any combination of workloads with extreme performance Dramatic new consolidation capabilities

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Consolidation Exadata and ASM allow all storage servers to be shared across databases Shared Configuration Advanced ASM data striping spreads every database across all storage servers Eliminates hot-spots and captive unused space Full storage grid performance available to all databases Database or cluster level storage security Predictable Performance Exadata I/O resource manager prioritizes I/Os to ensure predictable performance at user, job, application, or database level

Sun Oracle Database Machine Sun Oracle Database Machine Best Machine for Consolidation Many databases can run on Database Machine servers Shared Configuration Applications connect to a database service that runs on one or more database servers Services can grow, shrink, & move dynamically Large databases can span nodes using RAC Multiple small databases can run on a single node Predictable performance Instance caging provides predictable CPU resources when multiple databases run on the same node Restricts a database to subset of processors

Sun Oracle Database Machine Sun Oracle Database Machine Product Family BasicQuarter Rack Half RackFull Rack2-8 Full Racks Database Servers Exadata Storage Servers Total Disk Capacity7.2 TB21 TB50 TB100 TB200 – 800TB User Data (uncompressed)2 TB6 TB14 TB28 TB56 – 224 TB I/O Throughput (disks)1.5 GB/sec4.5 GB/sec10.5 GB/sec21 GB/sec GB/sec I/O Throughput (flash)3.6 GB/sec11 GB/sec25 GB/sec50 GB/sec GB/sec I/O per Second (IOPS)75,000225,000500,0001,000,0001M – 8M RacksN/A1112-8

Sun Oracle Database Machine Sun Oracle Database Machine Product Family BasicQuarter Rack Half RackFull Rack2-8 Full Racks Database Servers Exadata Storage Servers Total Disk Capacity7.2 TB21 TB50 TB100 TB200 – 800TB User Data (uncompressed)2 TB6 TB14 TB28 TB56 – 224 TB I/O Throughput (disks)1.5 GB/sec4.5 GB/sec10.5 GB/sec21 GB/sec GB/sec I/O Throughput (flash)3.6 GB/sec11 GB/sec25 GB/sec50 GB/sec GB/sec I/O per Second (IOPS)75,000225,000500,0001,000,0001M – 8M RacksN/A1112-8

Sun Oracle Database Machine Sun Oracle Database Machine What’s the Value? Extreme Performance Extreme performance for data warehousing and OLTP, powered by Sun Oracle Exadata Storage Servers Pre-Installed and Pre-Configured Enterprise ready for rapid customer success and high return on investment. One number to call for all aspects hardware, software, operating system. Complete Functionality Complete functionality, with in-database ETL, analytics (OLAP, Data Mining) and more

Sun Oracle Database Machine