Presentation is loading. Please wait.

Presentation is loading. Please wait.

Oracle Warehouse Builder: Overview

Similar presentations


Presentation on theme: "Oracle Warehouse Builder: Overview"— Presentation transcript:

1

2 Oracle Warehouse Builder: Overview
Jean-Pierre Dijcks and Michelle Bird Warehouse Builder Product Management

3 <Insert Picture Here>
Agenda <Insert Picture Here> Integrated Solution Market Position Roadmap Merging the ODI and OWB products Common pricing bundle Product Overview New Features in OWB 11.1 Preview of OWB 11.2 Pricing and Packaging For More Information ...

4 <Insert Picture Here>
Integrated Solution

5 Distributed Data Marts and Servers Expensive data warehouse architecture
Data Mining Online Analytics ETL ETL

6 Classic Data Integration Tools
Typical ETL Multiple tools require separate training, install, maintenance Generic Repositories Metadata Exchange Classic Data Integration Tools Classic Data Quality

7 with integrated ETL, Analytics & Data Mining
Consolidated Data Warehouse Single source of truth on low cost servers & storage Data Marts Data Mining Online Analytics ETL OWB Oracle Database 11g with integrated ETL, Analytics & Data Mining

8 OWB Integrated in the Oracle Database
Centralized metadata repository hosted on Oracle Database  secure, scalable import metadata manage & propagate metadata changes Monitor incoming data automatic notifications if data quality falls below threshold Profile and cleanse data profile applications, tables, files, … derive or write custom rules Transform cleansed data rich library of transformations and operators leverage Oracle partitioning

9 Oracle Warehouse Builder OWB is optimized for Oracle environments
Benefit from your Oracle investments Better performance through Oracle optimizations Skills, people and technology Improved productivity Use the latest Oracle features without rewriting your code Advanced task automation features Shorten your project times while improving data quality Discover problems up-front with data profiling Improve data quality in a declarative way

10 In-Database ETL Higher Productivity
Oracle In- Database ETL In-house ETL Tune and Administer Test and Update Create Data Quality Routines Tune and Administer Test and Update Create Data Transformations Create DQ Routines Create Data Transformations Years to Months Months to weeks

11 Advanced features made easy
Impact Analysis and Lineage Parallel Loading with DML Error Handling Partition Exchange Loading Fuzzy Matching and Merging Heterogeneous Source Access Any SQL or PL/SQL expression

12 <Insert Picture Here>
Mark Rittman Co-founder, Rittman Mead Consulting “"Rittman Mead recommends Oracle Warehouse Builder because it is the most effective way to leverage advanced capabilities of the Oracle Database for ETL development, while also providing metadata management and data quality features required for full life-cycle deployments.”

13 <Insert Picture Here>
Market Position

14 Market Position Recognized as a leader since OWB 10.2
10,000+ companies rely on OWB Optimized for Oracle environments 2005

15 <Insert Picture Here>
Roadmap

16 Product Highlights An abbreviated history of OWB
2000 2003 Release 9.2 Oracle RAC certified Mapping Debugger Name & Address Match/Merge Release 9.0.4 Metadata Security Process Flow Editor Scripting Language Multi-table insert Pivot and Unpivot 2004 Release 10.1 Oracle 10g certified 2006 Release 10.2 Data profiling & auditing Interactive LIA Scheduling Improved connector for SAP R/3 EBS and PeopleSoft connectors OLAP and relational modeling Pluggable mappings Non-Oracle targets 2007 Release 11.1 Simplified installation: installed w/ Oracle 11g DB Data Watch and Repair (for Oracle MDM) 10,000+ companies Siebel Adapter Release 2.0.4 Basic ETL functionality Mapping Editor 3,000+ companies Compete against Informatica and Ascential Set and row based code generation Recognized as a leader in Gartner Magic Quadrant Recognized as a leader in Forrester Enterprise ETLWave

17 High-Level Roadmap Unified platform that is a superset of OWB and ODI
OWB/ODI investments are fully protected No forced migrations Natural upgrade path No regressions in functionality Training and support to continue for both product releases 10gR1 10gR2 11gR1 11gR2 OWB Unified dev team Common pricing “ CY 2012” ODI 11gR2 10gR3 11gR1

18 Common Pricing Includes ODI product and OWB Enterprise ETL option
DATA INTEGRATOR ENTERPRISE EDITION DATA INTEGRATOR WAREHOUSE BUILDER ENTERPRISE ETL OWB EETL ODI Flagship Data Flagship Integration Product ETL Product Heterogeneous, High-Performance Data Integration Extensible Metadata Management Pricing and packaging discussed in detail later in this presentation. Wizards for Slowly Changing Dimensions Modern Java/SOA Architecture Flexible Knowledge Module framework Interactive Lineage and Impact Analysis 18 18

19 Oracle’s Roadmap for its ETL tools
Long Term Direction: Deliver an integrated data integration product Short Term: Deliver stand-alone releases with first integration steps Shared knowledge module framework (OWB 11.2) Runtime interoperability (future releases) Same user interface framework (future releases) Protect investments for the entire customer base The key point is that investments in either ODI or OWB are safe.

20 <Insert Picture Here>
Product Details

21 Oracle Database as transformation engine
Oracle Warehouse Builder The ETL and DQ tool shipped with Oracle Database Oracle Database as transformation engine Oracle Database as metadata repository Oracle Database 11g Oracle Warehouse Builder 11.1 Heterogeneous Data Integration In-line Data Quality Smart Data Modeling for Oracle The OWB software is shipped with the Oracle Database and is automatically installed during the Database installation process. The Database hosts the metadata repository for OWB and acts as the transformation engine. Unified Metadata Unified Metadata

22 OWB 11.1 Oracle-centric data integration platform
BI Tool Integration Discoverer (Standard Edition): design & deploy EUL OBI EE (Enterprise Edition) : design & leverage Oracle objects Databases Applications Files Messages Analytics Semi-Structured Web Services Databases Applications Files Messages Analytics Semi-Structured Web Services Non-Oracle BI : design & leverage Oracle objects Oracle Database 11g Connectivity SQL*Loader/ Ex Table Connectors CDC: Queues / Streams/ Third Party Odbc / Gateways Connectivity Connectors CDC: Queues / Streams/ Third Party Odbc / Gateways Oracle Warehouse Builder 11.1 Heterogeneous Data Integration In-line Data Quality Smart Data Modeling for Oracle Unified Metadata Unified Metadata

23 Architecture Design Runtime Deploy

24 Sources & Targets Data Sources Data Targets* Oracle Oracle
Tables, Views, MViews, Queues, External Tables, Sqlloader, Transportable Tablespaces, Data Pump… DB2, Sybase, SQLServer, Informix, Mainframes, … (Oracle Transparent Gateways) ODBC Flat Files XML Applications Oracle eBusiness Suite PeopleSoft SAP R/3 Siebel Oracle MDM (UCM, CDH, & PIM) Oracle DB2, Sybase, SQLServer, Informix, Mainframes, … (Oracle Transparent Gateways) ODBC Flat Files XML Applications Oracle eBusiness Suite PeopleSoft Siebel and UCM * OWB can target many data stores. However, its metadata repository and therefore DWH target is Oracle Database.

25 ETL: Mappings Declarative modeling of Data Flows
Map from Source to Target Integrated Data Quality N&A standardization Match/Merge Profiling Generates SQL & PL/SQL Merge, transportable tablespaces, data pump, sqlloader, xml data types, BLOBS/CLOBS, … Leverage custom data transformations Pluggable maps for reusability of logic

26 ETL: Process flows Declarative modeling of Process/work Flows
Co-ordinate execution of Maps and other activities Create complex transitions Send , FTP source/target files, call any external process, SQL Plus, Notifications Generates Oracle Workflow, Oracle Scheduler & XPDL

27 Data Quality functionalities are integrated into ETL processes
Data Quality in OWB Data Quality functionalities are integrated into ETL processes Disciplined approach to Data Quality, not an afterthought Data Quality is modeled, executed and audited just like any other transformation Consists of Data Profiling Name and Address Cleansing Match-Merge

28 Data Profiling

29 Data Cleansing Parsing Standardization Correction Augmentation

30 Supports multiple algorithms Uses of Match-Merge are
Matching is the process of determining, through business rules, which records refer to the same logical data Merging is the business rules driven consolidation of the data from the matched set into a single record Supports multiple algorithms Uses of Match-Merge are De-duplication House-holding Record Linking

31 Integrated Data Object Design
One editor for: Creation of objects Configuration for multiple databases Validation DDL Code generation Deployment to multiple databases Data viewing

32 Integrated Data Object Design
One editor for: Relational modeling Tables, views, materialized views All storage and database properties Dimensional modeling Star and snow flake schemas Multi-dimensional (OLAP) structures for Oracle OLAP Support for Skip-Level, calculated measures, value based hierarchies Slowly changing dimensions (including hierarchy versioning) Support for business definitions Oracle BI SE

33 Data Object Editor

34 Metadata Services Dependency Management
Data Lineage at attribute level Impact Analysis at attribute level Metadata Snapshots Change Management (diff, merge and reconcile) Security (roles) Multi-language Support (MLS via XLIFF) Extensibility - user defined properties, objects, and associations Reporting (browser) APIs (Scripting, SQL, PL/SQL) Exchange (import/export)

35 Impact Analysis

36 Runtime Management Both client and web based administration GUI
Smart deployment Start, stop, expedite jobs from a web client Extensive auditing for: Deployments Executions Error scenarios Full scripting support Full public view support

37 User-Defined Objects & Icons
User-Definable: Objects Associations Properties ALL in the OWB repository! Custom icons for easy recognition Access full metadata services of OWB e.g. impact analysis

38 Experts Re-use OWB Components to build your OWN application!
Define best practices & directed guidance Run Standalone or within OWB Design-time Declarative Definition & Guided execution

39 <Insert Picture Here>
New Features in OWB 11.1

40 Some New Features for OWB 11.1
New Connectivity Options 11g Database support Siebel Connector Gateway 11g support Performance Features Embedded explain plan support Embedded statistics gathering Embedded SQL/View tuning advisor Simplified Installation Embedded in the 11g database install Includes Oracle Workflow in OWB install

41 Some New Features for OWB 11.1 (cont.)
Enhanced SQL Generation Advanced aggregation support DML error logging in mappings More Dimensional Support Hierarchy versioning (supports multiple hierarchies) Advanced binding options Better support for federation Graphical creation of views/MVs Full impact analysis and lineage for federated structures

42 <Insert Picture Here>
Preview of OWB 11.2

43 The following is intended to outline our general product direction
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

44 Web Services for data integration and data quality
OWB 11gR2 “Plays well with others” BI Tool Integration OBI EE (Enterprise Edition) : design & deploy UDML Discoverer (Standard Edition): design & deploy EUL Databases Non-Oracle BI : design & leverage Oracle objects Databases Oracle Database 11g Applications Applications Connectivity Oracle Warehouse Builder 11.2 Connectivity Odbc / Gateways Odbc / Gateways Heterogeneous Data Integration In-line Data Quality Smart Data Modeling for Oracle Files Connectors Files Connectors CDC: Queues / Streams/ Third Party CDC: Queues / Streams/ Third Party Messages Messages SQL*Loader/ Ex Table Native Loaders JDBC Native Un-Loaders JDBC Analytics Knowledge Module Framework Native Loaders Analytics Unified Metadata Unified Metadata Native Un-Loaders Semi-Structured Semi-Structured Service Oriented Architectures Web Services Web Services for data integration and data quality Web Services

45 Leveraging the Oracle Database New Database Features exposed in OWB 11
Advanced Compression Virtual columns New partitioning methods Data Pump Cube MVs for summaries And more… Easy upgrade to OWB 11.2 Import existing OWB design to OWB 11.2 Select new feature; e.g., Cube MVs Regenerate code Each release of OWB exposes new Database functionality. In this example, you simply select “ROLAP: with Cube MVs” and then select generate to generate new, faster code. This functionality is available with the appropriate Database licenses. For example, using partitioning in OWB requires the Oracle Partitioning License.

46 Integrating with OBI EE How it’s done in OWB 11.2
In OWB, derive the model from the dimensional model In OWB, generate the metadata for all 3 layers of OBI EE In Oracle Answers, browse the data You can use OWB to do all the dimensional modeling and then generate a udml file to populate all 3 layers of OBI EE. This functionality requires the ODI EE license.

47 Choose from a library of existing knowledge modules (KMs)
Flexible access to non-Oracle sources Enabled by knowledge module framework Knowledge modules are snippets of code you can run, compile code in non-Oracle environments Choose from a library of existing knowledge modules (KMs) Write your own or edit existing KMs Originally developed by Sunopsis, now Oracle Data Integrator (ODI) This functionality requires the ODI EE license. OWB + knowledge modules = 1st big step in merging OWB and ODI

48 Rich support of ERP, CRM and MDM on any database platform
Knowledge Modules for flexible access Limited only by the code you write or find in the library Access any new source type: relational, non-relational, message based and content sources Rich support of ERP, CRM and MDM on any database platform Rich library of Knowledge Modules

49 Viewing and Editing the KM code Increased Flexibility
Modify template Regenerate the code Reuse the template

50 Using KMs in mappings Easily change the connectivity methods for a single logical design
Complete the logical design (or import an existing mapping) Logical view Execution view Define “execution units” for each type of source ( 3 shown here) Select the best connectivity method for each execution unit (connectivity can be through ODBC, Gateways, Knowledge Modules, etc.)

51 <Insert Picture Here>
Pricing and Packaging

52 In-Database ETL Included in many popular Oracle licenses
Database: SE, SE1, EE, Oracle Database Machine Business Intelligence: SE, SE1 e-Business Suite Intelligence products: Oracle HR Intelligence, Oracle Financial Data Manager

53 Warehouse Builder Packaging Options rely on In-Database ETL
Enterprise ETL/ ODI EE Data Profiling & Quality Create new metadata types Promote from Dev>QA>PROD Navigate lineage & impact Propagate metadata changes Schedule jobs using UI Advanced process flow logic Create nested mappings Slowly changing dimensions Design in RAC environment More… Profile tables, files, applications Detect or create data rules Audit incoming data Correct data In-Database ETL Design ETL mappings View HTML Metadata reports Perform data cleansing Use GUI or scripting language More… Application Adapters Data Watch & Repair All of the options that you can purchase related to OWB reply upon the functionality available in its core offering- the In-Database ETL. Access to data and metadata in: SAP R/3 eBusiness Suite Peoplesoft Siebel Integrate with Oracle MDM: Siebel Universal Customer Master Product Information Management Data Hub Customer Data Hub Options licensed independently of each other, except for Data Watch & Repair which requires Data Profiling & Quality.

54 Warehouse Builder Packaging Options rely on In-Database ETL
Anticipated for OWB 11.2 (subject to change) Warehouse Builder Packaging Options rely on In-Database ETL Enterprise ETL/ ODI EE Data Profiling & Quality Create new metadata types Promote from Dev>QA>PROD Navigate lineage & impact Propagate metadata changes Schedule jobs using UI Advanced process flow logic Create nested mappings Slowly changing dimensions Design in RAC environment Enhanced SOA support Flexible access to non-Oracle sources Orphan Management More… Profile tables, files, applications Detect or create data rules Audit incoming data Correct data In-Database ETL Design ETL mappings View HTML Metadata reports Perform data cleansing Use GUI or scripting language New & improved GUI Integration with OBI EE More… Application Adapters Data Watch & Repair All of the options that you can purchase related to OWB reply upon the functionality available in its core offering- the In-Database ETL. Access to data and metadata in: SAP R/3 eBusiness Suite Peoplesoft Siebel Integrate with Oracle MDM: Siebel Universal Customer Master Product Information Management Data Hub Customer Data Hub Options licensed independently of each other, except for Data Watch & Repair which requires Data Profiling & Quality.

55 Common Pricing Includes ODI product and OWB Enterprise ETL option
DATA INTEGRATOR ENTERPRISE EDITION One license at $23k/cpu “ODI” and “OWB EETL” option are removed from pricelist Both are only available in ODI EE Two separate installations Implement one or both DATA INTEGRATOR WAREHOUSE BUILDER ENTERPRISE ETL OWB EETL ODI Flagship Data Flagship Integration Product ETL Product Heterogeneous, High-Performance Data Integration Extensible Metadata Management Wizards for Slowly Changing Dimensions Modern Java/SOA Architecture Flexible Knowledge Module framework Interactive Lineage and Impact Analysis 55 55

56 OWB Product Offerings This pricing applies to OWB 10. 2 and 11
OWB Product Offerings This pricing applies to OWB 10.2 and 11.1 releases ORACLE DATABASE ENTERPRISE ETL WAREHOUSE BUILDER ENTERPRISE EDITION DATA INTEGRATOR DATA PROFILING & QUALITY APPLICATION ADAPTERS FOR WAREHOUSE BUILDER OWB EETL in $23k/cpu DBEE+$17.5k/cpu $2,300/cpu OWB EETL DB ODPQ ADAPT ODI EE Data quality Extensible Mapping Editor & Debugger Extensible Reveals algorithms run in Oracle Database Metadata Framework Metadata Framework business views of application data Basic dependency management with Process Flows Out of the box support for Slowly Changing Dimensions Profile file, table, application data in place or stage the data. Natively access SAP R/3 hosted on any database OWB in Auto- detect data rules. Audit, auto-correct incoming data. Read from and write to eBusiness Suite, PeopleSoft, or Siebel Interactive Lineage and Impact Analysis Robust scripting language & APIs Fuzzy match/ merge and Name&Address cleansing DATA WATCH & REPAIR ODPQ+$23k DWR Data quality for Oracle MDM: Siebel UCM, PIM, CDH 56 56

57 <Insert Picture Here>
For More Information ...

58 search.oracle.com or For More Information…
Warehouse Builder or oracle.com/technology/products/warehouse/index.html • see “Training”“Oracle By Example” • go to “Product Discussion Forum” to contact us

59

60


Download ppt "Oracle Warehouse Builder: Overview"

Similar presentations


Ads by Google