Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  It is like an appliance containing - Storage, Flash Disks, Database Servers, Infinib and.

Slides:



Advertisements
Similar presentations
Extreme Performance with Oracle Data Warehousing
Advertisements

Exadata Embracing Change What is familiar and what is new? The statements and opinions expressed here are my own and do not necessarily represent those.
1 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Convergence of HPC, Databases, and Analytics Tirthankar Lahiri Senior Director, Oracle.
ITEC474 INTRODUCTION.
Exadata for Oracle DBAs Arup Nanda Longtime DBA and now DMA.
The Architecture of Oracle
Exadata Distinctives Brown Bag New features for tuning Oracle database applications.
Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse.
10 REASONS Why it makes a good option for your DB IN-MEMORY DATABASES Presenter #10: Robert Vitolo.
Query Execution Professor: Dr T.Y. Lin Prepared by, Mudra Patel Class id: 113.
Virtualization and the Cloud
1 What is an operating system? CSC330Patricia Van Hise.
Query Execution Chapter 15 Section 15.1 Presented by Khadke, Suvarna CS 257 (Section II) Id
How to Cluster both Servers and Storage W. Curtis Preston President The Storage Group.
Operating Systems.
CPU Describe the purpose of the CPU
Router Architectures An overview of router architectures.
Computers They're Not Magic! (for the most part)‏ Adapted from Ryan Moore.
Router Architectures An overview of router architectures.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
The Sun Oracle Database Machine Barry Hodges Senior Solution Architect Oracle New Zealand.
How Computers Work. A computer is a machine f or the storage and processing of information. Computers consist of hardware (what you can touch) and software.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 10 Database Performance Tuning and Query Optimization.
Chapter Oracle Server An Oracle Server consists of an Oracle database (stored data, control and log files.) The Server will support SQL to define.
Oracle10g RAC Service Architecture Overview of Real Application Cluster Ready Services, Nodeapps, and User Defined Services.
HBase A column-centered database 1. Overview An Apache project Influenced by Google’s BigTable Built on Hadoop ▫A distributed file system ▫Supports Map-Reduce.
Contact Information Office: 225 Neville Hall Office Hours: Monday and Wednesday 12:00-1:00 and by appointment.
1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.
Chapter 1 Intro to Computer Department of Computer Engineering Khon Kaen University.
Oracle Tuning Considerations. Agenda Why Tune ? Why Tune ? Ways to Improve Performance Ways to Improve Performance Hardware Hardware Software Software.
Chapter 2: SQL – The Basics Objectives: 1.The SQL execution environment 2.SELECT statement 3.SQL Developer & SQL*Plus.
(C) 2008 Clusterpoint(C) 2008 ClusterPoint Ltd. Empowering You to Manage and Drive Down Database Costs April 17, 2009 Gints Ernestsons, CEO © 2009 Clusterpoint.
Operating Systems COMP 4850/CISG 5550 Page Tables TLBs Inverted Page Tables Dr. James Money.
Oracle 10g Database Administrator: Implementation and Administration Chapter 2 Tools and Architecture.
CCNA 2 Week 1 Routers and WANs. Copyright © 2005 University of Bolton Welcome Back! CCNA 2 deals with routed networks You will learn how to configure.
Inside your computer. Hardware Review Motherboard Processor / CPU Bus Bios chip Memory Hard drive Video Card Sound Card Monitor/printer Ports.
Computer Organization & Assembly Language © by DR. M. Amer.
Virtualization and Databases Ashraf Aboulnaga University of Waterloo.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 4 Computer Systems Review.
1 Lecture 1: Computer System Structures We go over the aspects of computer architecture relevant to OS design  overview  input and output (I/O) organization.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
CSCE Database Systems Chapter 15: Query Execution 1.
Query Execution. Where are we? File organizations: sorted, hashed, heaps. Indexes: hash index, B+-tree Indexes can be clustered or not. Data can be stored.
Week1: Introduction to Computer Networks. Copyright © 2012 Cengage Learning. All rights reserved.2 Objectives 2 Describe basic computer components and.
Introduction to Exadata X5 and X6 New Features
October 15-18, 2013 Charlotte, NC Accelerating Database Performance Using Compression Joseph D’Antoni, Solutions Architect Anexinet.
Same Plan Different Performance Mauro Pagano. Consultant/Developer/Analyst Oracle  Enkitec  Accenture DBPerf and SQL Tuning Training Tools (SQLT, SQLd360,
An Introduction to GPFS
Exadata Distinctives 988 Bobby Durrett US Foods. What is Exadata? Complete Oracle database platform Disk storage system Unique to Exadata – intelligent.
1 Patterns PRESENTER Y V RaviKumar Oracle ACE & Oracle Certified Master (OCM) PRESENTER Y V RaviKumar Oracle ACE & Oracle Certified Master (OCM)
Information Technology (IT). Information Technology – technology used to create, store, exchange, and use information in its various forms (business data,
Query Execution Chapter 15 Section 15.1 Presented by Khadke, Suvarna CS 257 (Section II) Id
JET INFOSYSTEMS The main approach to Big Data parallel processing: Oracle way Aleksey Struchenko Database Department Leader.
Nexsan iSeries™ iSCSI and iSeries Topologies Name Brian Montgomery
CPS216: Data-intensive Computing Systems
High Availability Linux (HA Linux)
File System Implementation
Exadata for Oracle DBAs
Oracle Storage Performance Studies
Systems Software Keywords Operating Systems
Chapter 15 QUERY EXECUTION.
Case studies – Atlas and PVSS Oracle archiver
Akshay Tomar Prateek Singh Lohchubh
Operating Systems Chapter 5: Input/Output Management
Sun Ray SPARC™ CPU 1280 x 1024 x 24 frame buff 10/100Mb Ethernet
Troubleshooting Techniques(*)
Query Execution Presented by Jiten Oswal CS 257 Chapter 15
File system implementation
Performance And Scalability In Oracle9i And SQL Server 2000
Advanced Database Topics
Presentation transcript:

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  It is like an appliance containing - Storage, Flash Disks, Database Servers, Infinib and Switches, Ethernet Switches, KVM (some models)  But it is not an appliance. Why? - Additional software to make it a better database machine - Components can be managed independently  That’s why Oracle calls it a Database Machine  And DMA - Database Machine Administarator

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy

MEMORY NETWORK CPU DISK I/O CONTROLLER Less I/O = Better Performance

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  Success of SAN caches is built upon predictive analytics  They work well, if a small percentage of disk accessed most often - The emphasis is on disk; not data  Most database systems - Are way bigger than caches - Need to get the data to the memory to process --> I/O at the disk level is still high  Caches are excellent for filesystems or very small databases

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  Memory is still more expensive  How much memory is enough?  You have a 100 MB database and 100 MB buffer cache  The whole database will fit in the memory, right? NO!  Oracle database fills up to 7x DB size buffer cache

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy MEMORY NETWORK CPU DISK I/O CONTROLLER Filtering Should be Applied Here  A typical query may: - Select 10% of the entire storage - Use only 1% of the data it gets  To gain performance, the DB needs to shed weight  It has to get less from the storage - Filtering at the storage level - The storage must be cognizant of the data

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy The Communication between CPU and Disk, Carries the information on the query - columns and predicates. This occurs as a result of a special protocol called iDB.

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  Cells are Sun Blades  Run OEL Linux  Software called Exadata Storage Server (ESS) which understands iDB

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy Storage Index Storage Indexes store in memory of the Cell Server the areas on the disk and the MIN/MAX value of the column and whether NULL exists. They eliminate disk I/O.

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy select name, value/1024/1024 as stat_value from v$mystat s, v$statname n where s.statistic# = n.statistic# and n.name in ( 'cell physical IO bytes saved by storage index', 'cell physical IO interconnect bytes returned by smart scan’) Output STAT_NAME STAT_VALUE SI Savings Smart Scan

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy select sql_id, child_number child, plan_hash_value plan_hash, executions execs, (elapsed_time/ )/decode(nvl(executions,0),0,1,executions)/ decode(px_servers_executions,0,1,px_servers_executions/decode(nvl (executions,0),0,1,executions)) avg_etime, px_servers_executions/decode(nvl(executions,0),0,1,executions) avg_px, decode(IO_CELL_OFFLOAD_ELIGIBLE_BYTES,0,'No','Yes') Offload, decode(IO_CELL_OFFLOAD_ELIGIBLE_BYTES,0,0,100*(IO_CELL_ OFFLOAD_ELIGIBLE_BYTES-IO_INTERCONNECT_BYTES) /decode(IO_CELL_OFFLOAD_ELIGIBLE_BYTES,0,1,IO_CELL_OFF LOAD_ELIGIBLE_BYTES)) "IO_SAVED_%", sql_text from v$sql s where upper(sql_text) like upper(nvl('&sql_text',sql_text)) and sql_text not like 'BEGIN :sql_text := %' and sql_text not like '%IO_CELL_OFFLOAD_ELIGIBLE_BYTES%' and sql_id like nvl('&sql_id',sql_id) order by 1, 2, 3 /

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy Pre-requisite for Smart Scan - Direct Path - Full Table or Full Index Scan -> 0 Predicates Disabling Smart Scans - Simple Comparison cell_offload_processing = operators false; Other reasons _kcfis_storageidx_disabled = true - Cell is not offload capable The diskgroup attribute cell.smart_scan_capable set to FALSE; - Not on clustered tables, IOTs, etc.

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy These are flash cards presented as disks; not memory to the Storage Cells. They are similar to SAN cache; but Oracle controls what goes on there and how long it stays.

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy  Bloom Filters  Functions offloading - Get the functions that can be offloaded V$SQLFN_METADATA  Decompression - (Compression handled by Compute Nodes)  Virtual Columns

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy

 Disks (hard and flash) are connected to the cells.  The disks are partitioned at the cell.  Some partitions are presented as filesystems.  The rest are used for ASM diskgroups  All these disks/partitions are presented to the compute nodes.

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy

Linux Commands - vmstat, mpstat, fdisk, etc. ASM Commands - SQL*Plus, ASMCMD, ASMCA Database Commands - startup, alter database, etc. Clusterware Commands - CRSCTL, SRVCTL, etc. Linux Commands - vmstat, mpstat, fdisk, etc. CellCLI - command line tool to manage the Cell

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy

Database Machine Administrator (DMA) New Role

Dot2Data Solutions Pvt. Ltd. A Databases Services Consultancy US Office : 79, Donald Street, APT#60 Weymouth, MA India Office : Plot No.40, Dubey Rd N.4, Nallagandla, Gachbowli, Hyderabad-19 Phone: