Presentation on theme: "Barry Hodges Senior Solution Architect, Sales Consulting, Oracle NZ The Best of Oracle Open World 2008."— Presentation transcript:
Barry Hodges Senior Solution Architect, Sales Consulting, Oracle NZ The Best of Oracle Open World 2008
A Different Perspective Just being there … Opportunity to liaise with subject matter experts and product managers Input into the road map Pre-arranged agenda adapted as new opportunities presented themselves
Data Warehouses Growing Rapidly Tripling In Size Every Two Years Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008. 200 400 600 800 1000 19982000200220042006200820102012 Actual Projected Terabytes of Data Size of the Largest Data Warehouses
Data Warehouses Start Slowdown at 1TB Table Scan Time Table Size 1TB10 TB100TB 1 Hour 10 Hours 5 Hours Typical NAS Typical Mid-Range Array Typical High-End Array
The Performance Challenge Storage Data Bandwidth Bottleneck Current warehouse deployments often have bottlenecks limiting the movement of data from disks to servers Pipes between disks and servers are 10x to 100x too slow for data size
Ship less data through the pipes Add more pipes Make the pipes wider Solutions To Data Bandwidth Bottleneck
Brainy Software approach - use smart database software to minimize the need for hardware –Smart Scan, OLAP, Bitmap Indexing, Join indexing, Materialized Views, Result Caches, Range Partitioning, etc. Brawny Hardware approach - use powerful hardware to perform brute-force scans and joins –Brawny hardware approach only works if the rate of scanning data scales with size of data Solution Approaches
HP Exadata Storage Server Hardware The Core Building Block Exadata Ships Less Data Through Pipes –Query processing is moved into storage to dramatically reduce data sent to servers while offloading server CPUs Exadata has More Pipes –Modular storage cell building blocks organized into Massively Parallel Grid –Bandwidth scales with capacity Exadata has Bigger Pipes –InfiniBand interconnect transfers data 5x faster than Fibre Channel Exadata Moves a Lot Less Data a Lot Faster
HP Exadata Cell Building Block Details Storage Server (Cell) is building block of Exadata Storage Grid Cells ship with all hardware and software components pre- installed Runs Exadata Storage Software, Oracle Infiniband protocol, Oracle Enterprise Linux 5.1, and HP hardware management software Hewlett Packard is exclusive hardware provider Absolutely no custom hardware - all parts off the shelf high- volume
8 GB DRAM Redundant 110/220V Power Supplies 2 Intel 2.66 Ghz Xeon Quad-core Processors Infiniband DDR dual port card Lights Out 100c – Management Card 12 x 3.5 Disk Drives - 7200 RPM 1000GB SATA - 15000 RPM 450GB SAS Cell Hardware Details – HP DL180G5 P400 Smart Array Disk Controller card - 512M battery backed cache
SAS or SATA Disks in Exadata Servers Choice of either –300 GB 15,000 RPM Serial Attached SCSI (SAS) disks –1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks SAS AdvantagesSASSATAAdvantage Throughput (MB/s)1,0007501.33X Average Seek Time (ms)188.8.131.52X Disk level read errors (per year)6.36310.00X Years to disk failure184.108.40.206X Choose SATA Based Servers for High Capacity SATA AdvantagesSASSATAAdvantage Capacity (TB RAW)3.6123.33X Capacity (TB Uncompressed User Data)*1.03.33.33X Choose SAS Based Servers for High Performance * Computed after mirroring, log files, indexes, undo and temp tablespaces SUPERCEDED
SAS or SATA Disks in Exadata Servers Choice of either –450 GB 15,000 RPM Serial Attached SCSI (SAS) disks –1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks SAS AdvantagesSASSATAAdvantage Throughput (MB/s)1,0007501.33X Average Seek Time (ms)220.127.116.11X Disk level read errors (per year)6.36310.00X Years to disk failure18.104.22.168X Choose SATA Based Servers for High Capacity SATA AdvantagesSASSATAAdvantage Capacity (TB RAW)5.4122.22X Capacity (TB Uncompressed User Data)*22.214.171.124X Choose SAS Based Servers for High Performance * Computed after mirroring, log files, indexes, undo and temp tablespaces
Traditional Scan Processing What Were Yesterdays Sales? SUM Oracle Database Grid Storage Array Retrieve Entire Sales Table Select sum(sales) where Date= 20-Oct …
Exadata Smart Scan Processing Oracle Database Grid What Were Yesterdays Sales? Exadata Storage Grid SUM Select sum(sales) where Date= 20-Oct … Retrieve Sales Amounts from Oct 20
Smart Scan Functionality Join filtering –Star join filtering is performed within Exadata storage cells –Dimension table predicates are transformed into filters that are applied to scan of fact table Backups –I/O for incremental backups is much more efficient since only changed blocks are returned Create Tablespace (file creation) –Formatting of tablespace extents eliminates the I/O associated with the creation and writing of tablespace blocks Smart scans are transparent to the application –No application or SQL changes required –Returned data is fully consistent and transactional
Graph shows throughput achieved in real-world deployments –Infiniband is held back by PCIe 1.0 x8 bus on typical host systems MB/sec 12x slower 3x slower Single Connection Throughput InfiniBand Throughput
Massively Parallel Storage Grid Scalable –Scales to hundreds of storage servers –Data automatically distributed across storage servers by ASM –Transparently redistributed when storage servers are added or removed –Data bandwidth scales linearly with capacity Available –Data is mirrored across storage servers –Failure of disk or storage server transparently tolerated Simple –Works transparently - no application changes Exadata bandwidth scales linearly with capacity 4 GB/sec 8 GB/sec 16 GB/sec …
8 HP ProLiant DL360 Oracle Database servers –2 quad-core Intel Xeon, 32GB RAM –Oracle Enterprise Linux 14 Exadata Storage Cells (SAS or SATA) –Up to 21 TB uncompressed user data (SAS) * –Up to 46 TB uncompressed user data (SATA) * 4 InfiniBand switches, 1 Gigabit Ethernet switch Pre-installed, pre-configured Add more racks for unlimited scalability HP Oracle Database Machine Pre-Configured High Performance Data Warehouse * Computed after mirroring, log files, indexes, undo and temp tablespaces
M-Tel Exadata Speedup 10X to 72X Performance Improvement 28x Average Speedup
Giant Eagle Exadata Speedup 3X to 20X Performance Improvement 16x Average Speedup
Database Machine Comparison HP Oracle Database Machine Netezza 10100 Teradata 2550 Footprint 1 rack User data 21 TB12.5 TB12.6 TB Disks 168 x 450GB disks108 x 400GB disks144 x 300GB disks Database cores 64 DB Cores4 DB Cores (?)32 DB Cores Storage cores 112 Storage Cores108 Storage Cores*0 Storage Cores Total cores 176 Cores112 Cores*32 Cores Interconnect 20Gb/sec Infiniband1Gb/sec Ethernet1 Gb/sec BYNET Memory 368 GB108 GB128 GB HW Architecture OpenProprietaryProprietary** * Netezza 10100 uses PowerPC CPUs (less powerful than Intel Xeon cores) ** Teradata BYNET Interconnect is proprietary
Data Protection Solutions All single points of failure eliminated by the architecture Hardware Assisted Resilient Data (HARD) built into storage –Prevent data corruption before it happens Data Guard provides disaster protection & data corruption protection –Automatically maintained second copy of database Flashback provides human error protection –Snapshot-like capabilities to rewind database to before error Recovery Manager (RMAN) provides backup to disk –Archiving and corruption protection –Can be used with Oracle Secure Backup (OSB) or third party tape backup software These work just as they do for traditional non-Exadata storage –Users and database administrator use familiar tools
Exadata Co-Existence and Migration Databases can be concurrently deployed on Exadata and traditional storage –Smart Scan capability only works if the whole tablespace is located on Exadata storage Online migration if currently using ASM and ASM redundancy Migration can be done using RMAN or Data Guard ExadataNon-Exadata Database Server Online Migration
US$24,000 / HP Oracle Exadata Storage Server US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk) US$24,000 / HP Oracle Exadata Storage Server US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk) * North America Prices. NOT inclusive of shipping, local taxes, etc US$650,000 / HP Oracle Database Machine US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server) * Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above. US$650,000 / HP Oracle Database Machine US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server) * Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above. The HP Oracle Database Machine How Much?
The HP Oracle Database Machine Sales / Support Model –System Delivery –Hardware Service –System Sales –System Support Oracle Technology Sales Manager is the single point for sales Oracle is single point for Support
NZ TBC –Singapore already –Sydney, Australia scheduled –NZ to be confirmed A queue has already formed! The HP Oracle Database Machine Where Can You Try It?
Oracle Technology Sales Manager coordinates with Oracle data warehouse specialist Sales Consultants We are looking for: –Well-known companies or organisations who will be references –Oracle knowledgeable staff –Performance challenges likely due to unbalanced hardware –Budget and clear business need –Query profile will benefit from Oracle Exadata Storage Server Software –Interest in full HP Oracle Database Machine configuration The HP Oracle Database Machine How Is Oracle Prioritising Interest?
Exadata Benefits Extreme Performance –10X –10X and more speedup for data warehousing Database Aware Storage –Smart Scans Massively Parallel Architecture –Dynamically Scalable to hundreds of cells –Linear Scaling of Data Bandwidth –Transaction/Job level Quality of Service Mission Critical Availability and Protection –Disaster recovery, backup, point-in-time recovery, data validation, encryption
Custom Complete Flexibility Any OS, any platform Easy fit into a companys IT standards Documented best- practice configurations for data warehousing Optimized Warehouse Optimized Warehouse Scalable systems pre-installed and pre- configured: ready to run out-of-the-box Highest performance Pre-installed and pre- configured Sold by Oracle Reference Configurations Reference Configurations HP Oracle Database Machine HP Oracle Database Machine The HP Oracle Database Machine The next step in DW Hardware Solutions
Oracle.com: http://www.oracle.com/exadata Oracle Exadata Technology Portal on OTN: http://www.oracle.com/technology/products/bi/db/exadata Oracle Exadata white papers: http://www.oracle.com/technology/products/bi/db/exadata/pdf/exad ata-technical-whitepaper.pdf http://www.oracle.com/technology/products/bi/db/exadata/pdf/migr ation-to-exadata-whitepaper.pdf Resources
Your consent to our cookies if you continue to use this website.