2Oracle Enterprise Manager: Empowering IT to Drive Business Value Next Generation Database Management with Oracle 11gMartin LambertBusiness Development Manager – Oracle Australia
3<Insert Picture Here> Agenda<Insert Picture Here>The “Big 4” 11g featuresReal Application TestingAdvanced CompressionActive DataGuardTotal RecallEnterprise Manager 11G and the DBA“It’s not just about the database”
4Oracle Database 11g Highlights High AvailabilityLogminer, Physical Standby, Streams support for XMLType, TDEFast Start Failover with Async PropagationFaster Logical Standby ApplyFlashback TransactionData Repair AdvisorIntegrationFaster GatewaysGateways to Legacy DatabasesStreams Synchronous CaptureStreams Faster ApplyPerformance and ScalabilityRAC Scalability EnhancementsFaster PL/SQL TriggersSecurityTablespace and LOB EncryptionSecure By DefaultEnterprise Manager support for TDE, OLS, VPD, EUSTDE works with LOBS, log minerWindowsVSS Writer for Point In Time CopiesManageability and DiagnosabilityUnified Automatic Memory ManagementScheduler supports remote jobsAutomatic Health MonitoringFaster Database UpgradesASMVariable extent sizes, Fast resync, Preferred readsRACHighly optimized protocolsADDM for RACContent Management InfrastructureBinary XML storageEnhanced XML indexingCombined Text and Relational IndexesDICOM Medical Imaging SupportStorage & Query of Semantic Content (RDF, OWL)Business IntelligenceNext generation OLAPSupermodels for Data MiningEnterprise Manager is DW awarePIVOT/UNPIVOT operators
5The Big 4 Features in 11g Real Application Testing Advanced CompressionActive Data GuardTotal Recall
6Real Application Testing – Database Replay Recreate actual production database workload in test environmentIdentify, analyze and fix potential instabilities before making changes to productionCapture Workload in ProductionCapture full production workload with real load & concurrency infoMove the captured workload to test systemReplay Workload in TestMake the desired changes in test systemReplay workload with production load & concurrencyHonor commit orderingAnalyze & ReportErrorsData divergencePerformance divergenceAnalysis & Reporting
7Database Replay Workflow Production ( )Mid-TierClients…CaptureStorageWindowsFile SystemASM…Test ( 11.1)ReplayAnalysis &ReportingStorageReplay Driver *LinuxTransferDatabase Replay enables realistic testing of system changes by essentially recreating production environment on a test system. It does this by capturing a workload on the production system and replaying it on a test system with the exact timing, concurrency, and transaction characteristics of the original workload. This makes possible complete assessment of the impact of the change including undesired results such product defects, new contention points or performance regressions. Extensive analysis and reporting is provided to help identify any potential problems, such as new errors encountered and performance divergences.As a result, businesses can have a high degree of confidence in the overall success of the system change and can significantly reduce production deployment risk.Replay entire workload with production timing & dependency<5% performance impact to system during captureTest any changes from database tier and below, including migration to RACTest system does not require mid-tierCan capture from and replay in 11.1 database releasePre-Process
8Real Application Testing Real Application Testing = SPA + Database ReplaySPA + Database Replay are complementaryTogether, provide comprehensive & flexible testing solutionSQL Performance AnalyzerPredicts impact of change on SQL response timeAssess change by executing query part of SQL in isolation without concurrencyUnit testing of SQL, e.g., optimizer stats/config, drop index, etc.Can use for upgrades from9.2/10.1 10.2 or 11g10.2 10.2 or 11gDatabase ReplayPredicts impact of change on workload throughputAssess change by replaying workload with concurrencyComprehensive testing of DB stack, e.g, memory, RAC, concurrency relatedCan use for upgrades from9.2 or 10.2 11g
9Snapshot Standby – Leverage Standby Database for Testing Physical Standby Apply LogsConvert Physical Standby to Snapshot Standby and open for writes by testing applicationsALTER DATABASE CONVERT TO SNAPSHOT STANDBY;Discard testing writes and catch-up to primary by applying logsALTER DATABASE CONVERT TO PHYSICAL STANDBY;Preserves zero data lossBut no real time query or fast failoverNo idle resourcesSimilar to storage snapshots, but:Provides DR at the same timeUses single copy of storageOpen DatabaseBack out ChangesSnapshot Standby Perform TestingContinuous Redo Shipping
10The Big 4 New Features in 11g Real Application TestingAdvanced CompressionActive Data GuardTotal Recall
113X Advanced Compression in Oracle Database 11g Comprehensive set of data compression capabilitiesStructured ( inline ), unstructured ( zlib ), rman ( zlib ),network transport ( zlib ), datapump ( bzip2 )Reduces storage consumption by 2 – 3 timesSavings cascades into test, dev, QA, backup, DR environmentsEnhances memory and network efficiencyComplete application transparencyBenefits diverse application workloadsTransaction ProcessingData WarehousingContent ManagementUp To3XCompression
12OLTP Table Compression Uncompressed Block1•• 2•• 3•• 4 • • 5•Jack•Free SpaceCompressed BlockHeaderHeaderJohn=|Doe=|Jane=|Smith=1•John•Doe 2•Jane• Doe 3•John•Smith 4• Jane • Doe 5•Jack •Smith Free Space1•John•Doe 2•Jane• Doe 3•John•Smith 4• Jane • DoeFree SpaceLocalSymbol TableMore DataPer Block
13The Big 4 New Features in 11g Real Application TestingAdvanced CompressionActive Data GuardTotal Recall
14Data Guard vs Active Data Guard Data Guard 11gStop redo apply at 8amOpen read-only for queriesActive Data Guard OptionRedo apply is always onAlways open read onlyBy 4pm, data is 8 hours oldQueries and reports always see latest dataAny failover will be delayed due to backlog of data that must be appliedFailover is immediate when needed, standby database always up-to-dateTo illustrate the value of Active Data Guard, lets compare it to the basic functionality that is included with Data Guard 11g. In this example we are using our physical standby database for reporting.With Data Guard 11g, similar to all previous Data Guard releases, if I wish to open the standby database read-only, I need to stop the apply of redo from current transactions occurring on the primary database. Data Guard 11g will still ship the recovery (redo) data to the standby site, but the data is archived at the standby to be applied at a later time. Data Guard 11g, WITHOUT the Active Data Guard Option, can not simultaneously apply current data and be open read-only.In contrast, if I have the Active Data Guard Option enabled, apply is always on while the standby is open read-only.So in the Data Guard 11g case, since apply is not active while open read-only, by 4pm in the afternoon the data that my queries are returning on my read-only standby is 8 hours old – frozen in time from the moment I opened the database read-only. In contrast, with Active Data Guard, queries always return the latest results.The other consideration is that at failover time, should an unplanned event make the primary database unavailable and require a failover to occur, the Data Guard 11g standby will need to process the backlog of the day’s transactions that have been accumulating at the standby database while it was open read-only. This will increase the time needed to complete the failover and increase downtime. When using the Active Data Guard Option, the standby is always up-to-date, failover is immediate.This not only illustrates the benefit of Active Data Guard, it also help to illustrate why so few customers currently use their physical standby for read-only queries. Stale data, and the impact on failover time – are significant hurdles to utilizing physical standby databases before the Active Data Guard Option.
15Active Data Guard 11g Scale-out Query Performance to Web-Scale* queriesOr Single NodeActive Data Guard Reader FarmqueriesupdatesqueriesqueriesqueriesProductionDatabaseStandby DatabasesDR included *
16The Big 4 New Features in 11g Real Application TestingAdvanced CompressionActive Data GuardTotal Recall
17Managing Data History – Current Approaches Application or mid-tier levelCombines business logic and archive policiesIncreases complexityNo centralized managementData integrity issues if underlying data is updated directlyDatabase levelEnabled using TriggersSignificant performance and maintenance overheadExternal or Third-partyHistory stored in separate databaseCannot seamlessly query OLTP and history dataApplication level approach means application code needs to be changed and maintained. No SQL*Plus access. Difficult to react to new requirements.“Princeton” is an example of external, third-party solution. Specialized UI. Not standard SQL.
18Introducing Flashback Data Archive Seamless access to archived historical dataUsing “AS OF” SQL constructselect * from product_information AS OF TIMESTAMP'02-MAY AM‘ where product_id = 3060History is stored in automatically created history tables inside the archiveHistory is captured asynchronously by new background process (fbda)Note: no “versions” query yet (possible future)
19<Insert Picture Here> Agenda<Insert Picture Here>The “Big 4” 11g featuresReal Application TestingAdvanced CompressionActive DataGuardTotal RecallEnterprise Manager 11G and the DBA“It’s not just about the database”
20Sustain Optimal Performance Top DBA ChallengesSustain Optimal PerformancePerformance ManagementPreserve Order Amid ChangeChange ManagementManage More with LessOngoing AdministrationOracle surveyed our installed base and we found that regardless of company size or number of databases managed, the tasks that a DBA needs to perform fall into one of three main categories.Delivering sustained, optimal performance and uptime is critical to the business users of your databases.Even while performance management is going on, your environment itself is changing. You may be adding indexes to improve the performance of a particular report, or you may be changing from large Unix servers to a grid of Linux servers or changing out your Storage Area Network or just applying routine patches to your database or your operating system. Amidst all this change, the database and business applications must continue to perform and be available to your business users. It is the role of the DBA to manage all this change in an orderly fashion.And while this is all happening, you still have the manage the ongoing tasks in your environment like space management, user management, and the provisioning and testing of new systems.These tasks consume nearly all of the time for DBAs leaving little time for training or professional development. And the number of databases being managed generally only goes one way – up. All of these demands make it necessary for intelligent tools to assist DBAs and that is what Oracle is here to talk with you about today.20
21Top DBA Challenges Performance Management Change Management Sustain Optimal PerformancePerformance DiagnosticsApplication TuningPerformance ManagementChange ManagementPreserve Order Amid ChangeOngoing AdministrationNow, let’s look at some of the top challenges DBAs face in the area of performance management and lets break these down into to Performance Diagnostics and Application Tuning.Manage More with Less21
224/1/2017Automatic Performance Diagnostics Maximize Performance With Self-Managing DatabasePerformance & Management AdvisorsHigh Load SQLRAC IssuesIO / CPU IssuesBoost Administrator ProductivityEliminate Performance BottlenecksLower IT Management CostsDeliver Higher Quality of ServiceSelf-Diagnostic EngineAutomatic WorkloadRepository SnapshotsSustain maximum performance with self-managing databaseTop-down analysis using Automatic Workload Repository snapshotsReal-time performance analysis with Automatic Database Diagnostic MonitorResolve performance issues faster with drill-down root-cause analysisClassification tree based on Oracle performance tuning expertisePerformance expert; now a RAC specialist too in Oracle Database 11gADDM is a core part of the diagnostic infrastructure in the Oracle Database and it was introduced in Oracle 10g and it has further evolved in Oracle Database 11g. ADDM starts off with analysis of snapshots of key workload metrics taken in the Database. These snapshots include critical performance information pertaining to the database kernel and the database workload as well as at the operating system level. ADDM runs on a regular basis (by default once an hour) and it analyzes this information and makes recommendations on problems that it identifies.For example, when there are SQL load issues, the SQL Advisors make recommendations on how to tune the SQL statements. Also when there are IO or CPU issues, ADDM gives advice on system resource optimization. And if you are running a RAC cluster, ADDM analyzes your complete RAC infrastructure including your interconnect and it offers advice there as well.ADDM is part of the database kernel, so it is always up to date an in synch with your version of the database.ADDM uses a Classification Tree methodology and it brings to your attention only those things which require your attention.Oracle Confidential222222
23Automatic Performance Diagnostics New in Oracle Enterprise Manager 11g Pre-Packaged AppsComposite AppsCustom AppsMiddlewareDatabasePhysical & Virtual ServersStorageApplication-to-DiskeCommerce AppsEnhanced ADDMNEW: SQL impacting performance findings highlightedGlobal AWR report for easier RAC diagnosticsBackward compatibility: Can analyze snapshots from earlier versionsActive Session History (ASH)NEW: ASH for Standby: Facilitates performance analysis of Standby DBGlobal ASH reports for RAC systemsGlobal ASH report?Enhanced ADDM:Shows blocking sessions across RAC nodes
24Performance Diagnostics 4/1/2017Performance DiagnosticsNEW: Active ReportsInteractive reports for off-line analysisOffer same level of interactivity with drill-downs for detailed analysisCan be ed to appropriate personnel for analysisDoes not require Oracle Enterprise Manager installationOracle Confidential242424
25RAC Database Manageability New in Oracle Enterprise Manager 11g 4/1/2017RAC Database Manageability New in Oracle Enterprise Manager 11gNEW: Monitoring and management of ClusterwareNEW: Grid Plug-and-Play support for policy-managed RAC databasesAddition and deletion of RAC nodesADDM shows blocking sessions across RAC instancesOracle Confidential252525
26High Availability New in Oracle Enterprise Manager 11g 4/1/2017High Availability New in Oracle Enterprise Manager 11gConfiguration-wide summary view with charts for RAC/HA setupProvides recommendations for MAA implementationNEW: Minimum downtime automation for single instance to MAAShow Availability related events across the configurationNEW: Manage role-based standby DBs, e.g. convert Physical Standby to Active Data GuardConfiguration wide view for RAC/HA setup instead of individual targetsShow Availability related eventsInstant notifications on RAC Database/Instance AvailabilityBackup/RecoveryStandbyDB, Instance, ASMHA Configuration standardsReport Best practice HA configuration standardsWorkflows to implement using Enterprise ManagerShow key HA information% Availability across configurationLast Backup, Next BackupFRA chartsStandby metrics, Red generation chartCluster Managed Services summary, and drilldownsLaunch HA Operations in contextOracle Confidential262626
27Top DBA Challenges Performance Management Change Management Sustain Optimal PerformancePerformance DiagnosticsApplication TuningPerformance ManagementChange ManagementPreserve Order Amid ChangeOngoing AdministrationThe second part of Performance Management is Application Tuning.Manage More with Less27
28Application Tuning Automatic SQL Tuning 4/1/2017Application Tuning Automatic SQL TuningPackaged Apps + SQL ProfileCustomizable Apps + SQL AdviceCustomizable Apps + Indexes & MVs + PartitionsWell-Tuned SQLAutomatic Tuning OptimizerAuto SQL TuningAuto SQLAnalysisAccessSQLHigh-LoadApplicationsAutomatic SQL TuningCaptures high-load SQLTunes SQL using SQL ProfilesImplements greatly improved SQL plans (optional)Performance benefit of advice providedSQL Profiling tunes execution plan without changing SQL textEnables transparent tuning for packaged applicationsAutomatic SQL Tuning was introduced in 10g. In 11g, we have taken it to the next level.High load SQL is captured from the kernel and passed to the Automatic Tuning Optimizer. It analyzes the SQL as well as the access structures (indexes, MVs) used by those SQL statements. Out of the ATO come various types of recommendations.You may get SQL Tuning recommendation to create a SQL Profile which is especially useful with packaged application where you may not be able to wait for your vendor to change a SQL statement.Oracle Confidential282828
29SQL Tuning Advisor New in Oracle Enterprise Manager 11g 4/1/2017SQL Tuning Advisor New in Oracle Enterprise Manager 11gSQLSQL Tuning AdvisorSQL ProfilingStatistics AnalysisAccess Path AnalysisSQL Restructure AnalysisAlternative Plan AnalysisParallel Query AnalysisAutomatic Tuning OptimizerAdministratorSQLComprehensive SQL Tuning RecommendationsGather Missing or Stale StatisticsCreate a SQL ProfileAdd Missing Access StructuresModify SQL ConstructsAdopt Alternative Execution PlanCreate Parallel SQL ProfileSQL Tuning AdvisorNEW: Identifies alternative execution plans using real-time and historical performance dataNEW: Recommends appropriate degree of parallelism to improve SQL performanceWhile tuning a SQL statement, SQL Tuning Advisor searches real-time and historical performance data for alternative execution plans for the statement. If plans other than the original plan exist, then SQL Tuning Advisor reports an alternative plan finding.Sometimes SQL Tuning Advisor may recommend accepting a profile that uses the Automatic Degree of Parallelism (Auto DOP) feature. A parallel query profile is only recommended when the original plan is serial and when parallel execution can significantly reduce the elapsed time for a long-running query.Oracle Confidential29
30Real-Time SQL Monitoring Looking Inside SQL Execution Automatically monitors long running SQLEnabled out-of-the-box with no performance impactMonitors each SQL executionExposes monitoring statisticsGlobal execution levelPlan operation levelParallel Execution levelGuides tuning effortsNEW: Available as Active Reports in Grid Control 11.1NEW: Enhanced to monitor PL/SQL
31Top DBA Challenges Performance Management Sustain Optimal Performance Preserve Order Amid ChangeChange DetectionChange TestingChange AutomationChange ManagementNow, let’s go on to the area of Change Management – how to preserve order amid change. The first thing we need to do is detect change, whether you are the one making the change or not. Then, we need to be able to apply testing to these changes to see their impact, and finally we need to be able to automate the change propagation throughout your development, test, and production systems.So, first, let’s talk about how to detect change.Ongoing AdministrationManage More with Less31
32Detecting Configuration and Application Changes 4/1/2017Detecting Configuration and Application ChangesSecurityMonitoringPoliciesReportsCompareConfiguration ChangesEnsures system compliance with company standardsDetects unauthorized (malicious) changesOver 300 out-of-box policies per Oracle “best practices”Monitor compliance continuouslyApplication ChangesNEW: Real-time schema change detectionSchema compare capability help identifyMalicious SQLUnauthorized access control changesChanges to tables, procedures, triggers, functionsNew/dropped indexes, etc.Changes can take many different forms. They can be configuration changes, or application changes.Traditionally, DBAs have had little visibility into the complete picture of what changes are being made.Oracle provides over 300 best practices polices based upon our experience to help identify when your databases are well configured. You also get a compliance score reflecting degree of compliance (0-100%) with each database that is updated over time. You can also be notified when you are not compliant.We also offer the ability to track SQL changes to tables, procedures, triggers, functions, and indexes at the schema level. This allows the DBA to see what is going on Inside the database and to track these changes over time.Real time schema change detection can alert you to unauthorized or unintended changes to your schema. This is important for many reasons including security and performance – for example an index dropped inadvertently.The XML schema comparison and associated ‘ALTER’ statements allow you to identify changes and to easily reconcile two different schemas.New in Grid Control 11.1Real-time schema change detectionNew parameter: ENABLE_DDL_LOGGINGTRUE: DDL changes written to alert logsSchema BaselinesImport to fileExport from fileMeta-Data API for XML-based schema object comparisonsXML document showing metadata and differences between objectsAssociated ALTER statements to make one like the otherOracle Confidential323232
33Top DBA Challenges Performance Management Sustain Optimal Performance Preserve Order Amid ChangeChange DetectionChange TestingChange AutomationChange ManagementNow, on to the actual testing of changes at the host or database level. One of the key challenges is the lack of tools which permit you to test these changes and promote these changes across the enterprise.Ongoing AdministrationManage More with Less33
34Secure Test System Deployment Oracle Data Masking 4/1/2017Secure Test System Deployment Oracle Data MaskingProductionTestLAST_NAMESSNSALARYAGUILAR40,000BENSON60,000LAST_NAMESSNSALARYSMITH111—60,000MILLER40,000Deploy secure test system by masking sensitive dataSensitive data never leaves the databaseExtensible template library and policies for automationSophisticated masking: Condition-based, compound, deterministicIntegrated masking and cloningLeverage masking templates for common data typesNEW: Command line (EMCLI) support for data masking actionsData Masking enhancements New in Grid Control 11.1CLI support for masking functionsList masking definitionsGenerate scriptSave scriptRe-associate a masking definition to another targetImport a masking definitionExport a masking definitionData preserving ShuffleSQL Expression based mask formatsPre-masking scriptsRandom Decimal number generationOracle Confidential
35Change Testing Oracle Real Application Testing SQL Performance Analyzer (SPA)Unit testing of SQL response timeDatabase ReplayConcurrent load testing using Production workloadsReplayWorkloadCaptureDeploy ReplayClientsCreate Test SystemEnd-to-End WorkflowIn the area of test and change management, Real Application Testing enables businesses to adopt new technology dramatically faster and at lower cost and risk. It consists of two separate solutions. The first one is a load testing solution called Database Replay which allows you to replay an actual production workload on a test system while maintaining all the necessary workload characteristics such as timing, concurrency and transactions dependencies. The other solution of Real Application Testing is SQL Performance Analyzer which enables users to identify and remediate SQL regressions resulting from any type of database change. You will be pleased to know that Real Application Testing has been back-ported to earlier releases of the Oracle Database to help customers smoothly transition to new releases.Proper testing with Database Replay depends on the correct execution of many critical steps. For example, the database system on which testing is to be performed has to have the exact same data as the production system when workload capture was initiated. You need to move AWR performance data from production to test for analysis purposes. You need to deploy replay clients software on target servers that will drive the workload replay. Now, with Enterprise Manager, we provide support for all these steps and offers end-to-end Database Replay automation. It provides a user-friendly workflow to capture production workload and associated performance data, copy the workload to a test system, setup the software and test database to the correct point in time or SCN, deploy replay clients, initiate the replay process, and analyze the replay results. By orchestrating the entire Database Replay workflow in Oracle Enterprise Manager, you can expect fewer errors and faster, more reliable testing.We have also added enhancements to SQL Performance Analyzer or SPA. We also have more extensive progress monitoring capabilities that are very helpful for analysis of large workloadsWith respect to change management, in the production environment all changes in the database need to be tracked. Sometimes the changes made to the production system need to be propagated to the other systems like Reporting, Testing and Training. For application DBAs, that manage the lifecycle of promoting database changes from development to test to production, the new release adds support for propagation of database changes from a gold baseline to multiple databases. This capability allows DBAs to apply multiple sets of changes to an environment and promote the entire set of changes from test to production without having to keep track of the multiple scripts and their dependencies. This also reduces the risk of any unauthorized or untested changes from getting propagated into production.We now provide Exadata simulation in SPA so that you can see, before actually purchasing Exadata, whether your workload can benefit from Exadata and if so by how much.
36Oracle Real Application Testing SQL Performance Analyzer 4/1/2017Oracle Real Application Testing SQL Performance AnalyzerSQL Plans + Stats Pre-Change TrialSQL Plans + Stats Post-Change TrialSQL WorkloadSTSCompare SQL PerformanceAnalysis ReportTest and predict impact of system changes on SQL query performanceAnalyze performance changes for improvements or regressionComprehensive performance analysis and reportingRe-execute SQL queries in test environmentEnd-to-end solution: STS, SQL Plan Baselines, & SQL Tuning AdvisorHelps users predict the impact of system changes on SQL workload response timeLow overhead capture of SQL workload to SQL Tuning Set (STS) on production systemBuild different SQL trials (experiments) of SQL statements performance by test executionOffers workload as well as fine-grained performance analysis on individual SQLIntegrated with STS, SQL Plan Baselines, & SQL Tuning Advisor to form an end-to-end solutionTest impact of change on SQL query performanceCapture SQL workload in production including statistics & bind variablesRe-execute SQL queries in test environmentAnalyze performance changes – improvements and regressionsUse SQL Tuning Advisor to tune regressionSQL Performance Analyzer (SPA)GUI support for Exadata simulation to estimate performance benefits – done without actual hardwareWorkflows to support upgrade use cases from earlier releasesSimple “one-click” STS transport to another databaseAutomatically execute short running queries multiple times for better SQL trial accuracyAbility to compare two SQL Tuning Sets. This is useful for:Better Database Replay analysisWhen you can replay workload without Database Replay (e.g., through ATS, scripts or other load testing tools)Oracle Confidential363636
37SPA EnhancementsAnalyze performance of two workloads thru STS comparisonAllows comparing two different STS and generate SPA reportBetter SPA trial accuracy through multiple test executionSPA provides “Alternate Plans” recommendation for individual regressed SQL in a SPA trialSPA Active ReportsAnalyze Performance of Two Workloads thru STS ComparisonAllows comparing two different STS and generate SPA reportEliminates re-executing SQL for trial data using “Build from STS” trial methodMultiple plans even those with are different binds/env picked upUse cases: Perform SQL-centric analysis with DB ReplaySQL workload capture into STS-1 during DB Replay - Workload CaptureSTS-2 during Database Replay – Workload ReplayUse SPA to build trials from STS-1 and STS-2 and generate reportSimilarly with Oracle Application Testing Suite or home-grown scriptsReporting: SPA Report + Additional informationCommon SQL, Missing/New SQL, Plan ChangesOverall Workload and Individual SQL StatisticsOnly API support in DB 11.2Better SPA trial accuracy through multiple test executionFirst execution ignored to discount caching effectTest execute multiple times for short running queries and use averaged statisticsSPA Active ReportsBenefits and usage similar to other Active Reports covered earlierSPA provides “Alternate Plans” recommendation for individual regressed SQL in a SPA trialIf a better execution plan was noticed in AWR or SQL Trial then a SQL Plan Baseline can be created from for that SQL statementSimilar to “Alternate Plan” SQL Tuning Advisor recommendation
38Oracle Real Application Testing Database Replay CaptureProcessReplayAnalysis & ReportingProductionReplay DriverClientsStorageReduce costs and risks of database changesFully automated workflowChange Assurance forDatabase and O/S upgrades, e.g. migration to Exadata V2Configuration changes, e.g., conversion from SI to RACStorage changesO/S migrations, e.g., Windows to LinuxSupports upgrades from Oracle 9iR2 to 10gR2 and 11g!Let me drill down into the Real Application Testing feature. As I said, it allows you to test infrastructure changes – such as hardware/OS upgrade, going from single instance to RAC, database upgrades, etc. The unique aspect of this functionality is that it constructs the test workload by capturing the actual production workload. Real Application Testing therefore enables businesses to adopt new technology dramatically faster and at lower cost and risk.It consists of two separate solutions. The first one is a load testing solution called Database Replay which allows you to replay an actual production workload on a test system while maintaining all the necessary workload characteristics such as timing, concurrency and transactions dependencies. The other solution of Real Application Testing is SQL Performance Analyzer which enables users to identify and remediate SQL regressions resulting from any type of database change. You will be pleased to know that Real Application Testing has been back-ported to earlier releases of the Oracle Database to help customers smoothly transition to new releases.Proper testing with Database Replay depends on the correct execution of many critical steps. For example, the database system on which testing is to be performed has to have the exact same data as the production system when workload capture was initiated. You need to move AWR performance data from production to test for analysis purposes. You need to deploy replay clients software on target servers that will drive the workload replay. Enterprise Manager provides support for all these steps and offers end-to-end Database Replay automation. It provides a user-friendly workflow to capture production workload and associated performance data, copy the workload to a test system, setup the software and test database to the correct point in time or SCN, deploy replay clients, initiate the replay process, and analyze the replay results.By orchestrating the entire Database Replay workflow in Oracle Enterprise Manager, you can expect fewer errors and faster, more reliable testing.Real Application Testing reduces the risk of embracing a new technology and it reduces the testing time from months to weeks or from weeks to days. This allows businesses to continue to benefit from changes but without any associated negative impacts such as performance degradation, outages, etc.The kind of systems changes Real Application Testing allows you to test include:Database and O/S upgradesConfiguration changes, e.g.., conversion from single instance to Oracle RACStorage changes such as move to Oracle ASMO/S migrations, e.g.., Windows to Linux
39Top DBA Challenges Performance Management Sustain Optimal Performance Preserve Order Amid ChangeChange DetectionChange TestingChange AutomationChange ManagementNow let’s discuss the third area of Change Management. Now that we have identified changes and have determined how to test these changes, how do we roll out these changes across the enterprise?Ongoing AdministrationManage More with Less39
40Testing Automation Reduce Time and Effort of Database Testing Automate production to test workflow of Database ReplayCapture production workload, performance dataCopy workload, performance data to stagingProvision software, create test databaseDeploy replay clients and orchestrate replay
41Deployment Automation 4/1/2017Deployment AutomationCreate Reference RAC System1Stage Gold Image2Create Production RAC System3Scale-Out RAC4Gold image based provisioningSimplified RAC provisioning with automationSingle click RAC scale-out and scale-backProvision full RAC and Clusterware systemsASM SupportTraditionally, managing deployments of new systems has been a very manual process which required a lot of time from the DBA. Oracle has embraced the notion of gold image-based provisioning. Gold images help simplify the creation and deployment of new systems from known, certified configurations which are created by the DBAs and stored in the configuration repository.Single click RAC deployment is supported for adding or removing capacity from your RAC cluster as you need it. This covers the database as well as the clusterware. It configures the entire stack needed for your RAC cluster.RAC provisioningConfigures entire stackPre-requisite checks & automatic fix-upsSupport Clusterware with Grid Naming Service (GNS)Support for Grid Plug-n-Play (GPnP) configuration in both initial Provisioning and during Scale outConfigure either Admin managed or Policy Managed databasesSupport for configuration profiles including 4 out of box profilesASM SupportDatabase Machine support for SunOracle Confidential414141
42Database Change Automation Schema Changes Change ManagementSchema change propagationCapture development changes in baseline versionPreview changes before confirmingPropagate planned changes from baseline to multiple databasesIn the area of test and change management, Real Application Testing enables businesses to adopt new technology dramatically faster and at lower cost and risk. It consists of two separate solutions. The first one is a load testing solution called Database Replay which allows you to replay an actual production workload on a test system while maintaining all the necessary workload characteristics such as timing, concurrency and transactions dependencies. The other solution of Real Application Testing is SQL Performance Analyzer which enables users to identify and remediate SQL regressions resulting from any type of database change. You will be pleased to know that Real Application Testing has been back-ported to earlier releases of the Oracle Database to help customers smoothly transition to new releases.Proper testing with Database Replay depends on the correct execution of many critical steps. For example, the database system on which testing is to be performed has to have the exact same data as the production system when workload capture was initiated. You need to move AWR performance data from production to test for analysis purposes. You need to deploy replay clients software on target servers that will drive the workload replay. Now, with Enterprise Manager, we provide support for all these steps and offers end-to-end Database Replay automation. It provides a user-friendly workflow to capture production workload and associated performance data, copy the workload to a test system, setup the software and test database to the correct point in time or SCN, deploy replay clients, initiate the replay process, and analyze the replay results. By orchestrating the entire Database Replay workflow in Oracle Enterprise Manager, you can expect fewer errors and faster, more reliable testing.We have also added enhancements to SQL Performance Analyzer or SPA. We also have more extensive progress monitoring capabilities that are very helpful for analysis of large workloadsWith respect to change management, in the production environment all changes in the database need to be tracked. Sometimes the changes made to the production system need to be propagated to the other systems like Reporting, Testing and Training. For application DBAs, that manage the lifecycle of promoting database changes from development to test to production, the new release adds support for propagation of database changes from a gold baseline to multiple databases. This capability allows DBAs to apply multiple sets of changes to an environment and promote the entire set of changes from test to production without having to keep track of the multiple scripts and their dependencies. This also reduces the risk of any unauthorized or untested changes from getting propagated into production.We now provide Exadata simulation in SPA so that you can see, before actually purchasing Exadata, whether your workload can benefit from Exadata and if so by how much.
43Software Change Automation: Patching My Oracle SupportAnalyzeMy Oracle Support connectionProactive advisoriesCPUsFeature basedPatch downloadsPatch DatabasePatch/CPU/PatchsetZero downtime patching for RACLights-out patching for LinuxAutomatic download from Oracle ULNTestReportCorporate DMZPromoteVerifyPatchStageA task that DBAs have to perform all the time is patching. Oracle Enterprise Manager has the ability to connect to Oracle Metalink and analyze and download the patches you need, apply them in your test environment, promoted them to your staging area, and deploy them into production, and verify that they were applied correctly. This patch lifecycle applies to single patches, patch sets, and Critical Patch Updates.Also, with Oracle Real Application Clusters, certain patches can be applied in a rolling fashion to each node in the cluster to eliminate downtime.And with Oracle Enterprise Linux, the ability to download and apply O/S patches is totally automated from beginning to end requiring no intervention at the console.
44Top DBA Challenges Sustain Optimal Performance Performance Management Change ManagementPreserve Order Amid ChangeManage More with LessSpace and Resource ManagementAutomated Self-ManagementOngoing AdministrationNow, our final section is Ongoing Administration.This will help us understand how to manage more and more resources with the same number of DBAs. The first section deals with the challenges around installation and configuration of new systems.44
45Space and Resource Management Space ManagementNEW: Compression Advisor (Oracle Database 11.2)Analyzes objects to give estimate of space savings for different compressions methodsHelps in deciding correct compression level for applicationRecommends various strategies for compressionResource ManagerNEW: Instance Caging (Oracle Database 11.2)More flexible alternative to server partitioningWide platform support than operating system resource managersLower administration overhead than virtualizationI/O Resource Management for ExadataASM Cluster File System supportNEW in Oracle Enterprise Manager 11gComprehensive administrationProactive MonitoringSecuritySpace ManagementNew in Grid Control 11.1 – Compression Advisor (DB 11.2)Recommends various strategies for compressionHelps in deciding correct compression level for applicationAnalyzes objects to give estimate of space savings for different compressions methodsSorting on a particular column for increasing compression ratioPicking the right compression algorithm for a particular data setWorks for OLTP compression and Hybrid Columnar compressionPresents tradeoffs between different compression algorithmsNew in Grid Control 11.1 – DB 11.2 supportTEMP tablespace shrinkSegment Creation on DemandShrink works at file and tablespace levelImproves space utilization by reclaiming unused or over-allocated spaceNew SEGMENT CREATION DEFERRED clauseOnly a small subset is used by any customerOracle Applications and SAP create thousands of tablesDuring table creation, segments are not created for table, lob, index segmentsOn first row insertion, all segments are createdDuring a CTAS, segments are not created if no rows returnedE.g.. Oracle Apps has 18K tablesNew in Grid Control 11.1 – Instance Caging (DB 11.2)Resource ManagerWide platform support than operating system resource managersMore flexible alternative to server partitioningI/O Resource Management for ExadataSet CPU_COUNT per instance and enable resource managerLower administration overhead than virtualizationAdministrationNew in Grid Control 11.1ASM Cluster File System supportSecurityProactive Monitoring2> On top of that, EM is proactively monitoring the health of the ACFS system by monitoring its availability, state(mount) and space usage. ASM also collects performance metrics for the system1> EM provided comprehensive management operations for the major components of the ACFS storage including ACFS, dynamic volume, and snapshots.EM manages ACFS from the following perspectives:3> ACFS management is cluster aware. It is integrated with the cluster home page as well as host home page to show the overall state and health of ACFS across cluster nodes. Cluster related operations can also be achieved through one mouse click on all cluster instances.Enterprise Manager Grid Control Plug-in to monitor & manage Exadata Storage CellsStorage Plug-In for Exadata V2Works with Enterprise Manager Grid Control and later versions
46Top DBA Challenges Sustain Optimal Performance Performance Management Change ManagementPreserve Order Amid ChangeManage More with LessSpace and Resource ManagementAutomated Self-ManagementOngoing AdministrationNow we come to the last part of Ongoing Administration and covers Oracle’s comprehensive self-management capabilities.46
47Automated Self-Management Support WorkbenchAutomatic DiagnosticRepositoryIncident PackagingServiceTest Case BuilderFault DiagnosticsAutomatic Block RepairHA ConsoleMAA AdvisorAutomation workflows forGrid migrationHigh AvailabilityImproved RAC installEasier Upgrade/DowngradeEnhanced pre-upgradeChecksConditional MaskingCompound MaskingIntegrated Clone and MaskStatistics VersioningInstall, Upgrade, SecurityOn-demand SegmentCreationTemp Tablespace ShrinkCompression AdvisorResource ManagerInstance CagingACFS supportResource MgmtIn the area of database self-management, and here I will not go through all the enhancements we are introducing in Oracle Database 11g Release 2 because they are too many to describe, but suffice to say that we continue to improve the manageability of the database across the major areas like high availability, install, upgrade, security, resource management and performance management. A few examples are new features or enhancements like Automatic degree of parallelism, Compression Advisor, automatic data block repair, and database clone and mask and integration.As you know, we have data masking capabilities that enable you to share production data with internal and external entities while preventing sensitive or confidential parts of the information from being disclosed to unauthorized users. Data Masking is now securely integrated with the database cloning capabilities in Enterprise Manager. In addition to the standalone masking process, database administrators now have the flexibility to add data masking to the database clone process by specifying the mask definitions that need to be run after cloning. After the clone process has completed, we brings up the database in RESTRICTED mode, thus disabling non-administrative access and then runs the masking process. Once it verifies that the masking process has completed successfully, the database is then opened automatically for general use.
48Oracle Database Manageability Empowering DBAs To Drive Business ValueEnhance Service Quality By Maximizing Application-to-Disk PerformanceImproved IT Agility with Risk-free Change ManagementLower IT Costs Through Self-Managing Automation48
49<Insert Picture Here> Agenda<Insert Picture Here>The “Big 4” 11g featuresReal Application TestingAdvanced CompressionActive DataGuardTotal RecallEnterprise Manager 11G Update“It’s not just about the database”
50Complete and Integrated Solution Oracle Enterprise ManagerOracle Application Operations ManagementUser Experience ManagementSystem Monitoring & DiagnosticConfiguration ManagementLifecycle AutomationUI, Security, Integration, Data Management, My Oracle Support IntegrationOracle Fusion Middleware ManagementOracle Database ManagementOracle Solaris & Oracle Enterprise Linux ManagementOracle VM ManagementOracle Sun Server Management3rd Party Technology Management<This is one of the two slides in the overview section that lists the actual features of the product. You may use these two slides to present an introduction to the various features before showing your demo.Expand on the first two boxes from the previous slide on Complete and Integrated aspect of the product. Completeness is communicated by walking through the functional capabilities of the suite as well as the full-stack management capabilities that the rest of Oracle Enterprise Manager provides. As for the integrated attribute, point out that the bulk of the pack runs in the integrated Grid Control console, which is also the integrated tool to manage Oracle middleware, database, VM and even host machines. RUEI, while it runs as a separate piece of software, also contains numerous integration points to Grid Control. ACC and CCC, while being totally separate at the moment, are being absorbed into the next version of EM. Consequently, our management suite is at least as integrated as the most integrated 3rd party product, and more integrated than the rest. Also, focus on the features of the suite, not the console that they run on in order to avoid objection of them being separate software.>Talking PointsApplication Management Suite leverages Oracle Enterprise Manager as its foundation, leveraging its rich set of capabilities in User Experience Management, System Monitoring and Diagnostics, Configuration Management, and Lifecycle Automation, as well as platform functions such as Presentation (Dashboards, Topology Viewer, Reports), Security (Authentication and Role Based Access Control), Integration with other management tools, Data Management (EM Repository, data export), and My Oracle Support integration.It is part of a complete and integrated solution to manage the complete IT environment. Commonality helps different administrators to work together using a single set of tool and lower training costs as there is a common set of UI.User Experience Management provides the business perspective on the health of the applications.System Monitoring & Diagnostic monitors all the key application components via alerts and dashboards and helps troubleshoot problems quicker.Configuration Management helps model the application environment to visualize dependencies, track changes that are made, and automate IT compliance management.Lifecycle Automation covers the set of features for command & control (start/stop), EM job system, and for EBS, application change management.
51Architecture: Network Protocol Analysis PagerequestCollected data:• Client-ip, Server-ip, Gateway-ip• Requested URL (Page,Object)• Cookie/Session-id• Referrer• GET & POST requests• User agents (phone type)Network Response Time• Delivered?• Aborted?• Network timeout?InternetFirewallSniffingSwitchServer Response Time• Response?• Server error, web site error, Hit OK• Content of page (i.e order details, functional errors)Web serverWeb serverWeb serverDBDB
52Product Overview Optimizing end-user experience through real end-user monitoring Business ReportingKPI MonitoringData ExportReal User Experience Insight key highlights:Replay of poor performanceExecutive dashboardsExtensive KPI and SLA monitoringFull alerting capabilitiesQuick bottle-neck analysesTransaction performance analysesCustomized reportingTrend analysesFull data integration via XMLTransaction PerformanceExecutive dashboard
53Tracking Transactions End-to-End, Application Level ViewProcess EngineService BusReal-time tracking of each transactionFollows transactions across all infrastructure and applicationsApp Servers, Applications, ESB's, BPM's, Etc.Leverages message content – the business value flowing through the applicationProvides this without modifying or tagging the messagesMessage FingerprintingNon-invasive; doesn’t break applications53535353
54Performance Analysis View Service topology Drill into functional implementationView performance for each step (BPEL activity, service bus pipeline, portal page, region, etc.)Drill into Java EE implementation of functional stepEven drill to SQL performance for any service (including dehydration SQL)54
55Business-Driven IT Management This slide explains the overall concept and operational architecture of “Business Driven IT Management” – a central theme of Oracle Enterprise Manager 11gBusiness-Driven IT Management has 3 major solution pillars:Pillar #1: Business Driven Application Management – provides correlated management of User Experience, Business Transactions and Business Services – allows users to identify business issues, understand business needs, and manage from business perspective.Pillar #2: Integrated Application to Disk & Cloud Management – provides complete and integrated management of Oracle’s SW+HW stack, and private clouds – enables enterprises to eliminate management silos, and create agile IT for dynamic business.Pillar #3: Integrated Systems Management & Support – provides integration with Services Cloud, including Oracle’s Support Portal (MyOracleSupport.com) – allows users to proactively identify and fix problems, and maximize business productivity.[Staging for the next slide..]This completes a quick overview of the Business-Driven IT Management and its three major solution pillars.For rest of the presentation, we will zoom into and focus on pillar xxx …-j