Download presentation
Presentation is loading. Please wait.
Published byEileen Hicks Modified over 9 years ago
1
Ascential’s DataStage BW Load PACK 3.0 Bryan Katis Platinum Consultant Integration Platform RIG, SAP Labs
2
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 2 2 Agenda BW Load PACK 3.0 BW MetaBroker SAP BW Business Content for Oracle Financials SAP / Ascential Partnership
3
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 3 3 Agenda SAP BW Business Content for Oracle Financials SAP / Ascential Partnership BW Load PACK 3.0 BW MetaBroker
4
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 4 4 BW Load Pack XML Pack Appl. Spec. Extr.Pack Application PACKs DataStage ETL Components E-Business Applications ^ ^ Legacy Systems VSAM RDBMS (DB2) ADABAS R/2 File Non SAP Business API SAP BW Service API Development Testing Productive BW Service API for SAP S I E B E L DataStage ETL Components SAP‘s Data Aquisition Strategy PeopleSoft Oracle BW Load Pack Native PlugIns XML Pack Application PACKs
5
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 5 5 SAP’s Package One Offering Package One offers users a low cost solution for integrating unlimited non-SAP data into SAP BW environments. DataStage on Intel NT (single copy) Access to unlimited number of non-SAP R/3 sources, including any of the data sources supported by the base DataStage license. DataStage Load PACK for SAP BW (single copy) Allows DataStage to load unlimited number of SAP BW environments. Additional Ascential Application PACK (single copy) Options include Siebel and PeopleSoft; XML PACK ships with DataStage; Oracle Applications (coming soon). DataStage Essentials and PACKs education at an Ascential training facility in Europe or the US.
6
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 6 6 SAP’s Package Two Offering Package Two allows users to set up a separate production version of DataStage with broader access to data originating in application environments. This package includes: DataStage on Intel NT or Unix (two copies) Access to unlimited number of non-SAP sources, including any of the data sources supported by the base DataStage license. DataStage Load PACK for SAP BW (two copies) Additional Ascential Application PACKs (three copies) Licenses for application PACKs can be for same or different application PACKs. Options include Siebel and PeopleSoft; XML PACK ships with DataStage; Oracle Applications (coming soon). DataStage Essentials and PACKs education at an Ascential training facility in Europe or the US.
7
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 7 7 mySAP BI for full Open Enterprise Data Warehouse When will Package One Not Be Enough? Performance and Data Security Issues UNIX environment High data volumes, with complex transformations and minimal latency tolerance levels Back-up or additional production server for load balancing Separate development from production server Integration of global data sources in complex system landscape
8
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 8 8 Why choose Ascential DataStage? SAP certifies CSP Partners for its Staging BAPI interface. Why is DataStage a better choice? Ascential DataStage is SAP’s preferred data integration technology Ascential and SAP have co-engineered a joint release of their products resulting in optimum graphical integration and performance benefit. Examples: Custom Ascential business content ships with SAP BW to be used for test and demo purposes SAP BW InfoPackage 3 rd Party Selections contains Ascential specific customizations allowing for full exploitation of DataStage job parameters The DataStage job log is available for examination in the InfoPackage monitor
9
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 9 9 Development Partner SAP BW Certification Levels for CSP Partners BW 1.2BW 3.0BW 2.0BW 4.0 BAPI‘s Certification Level 1.22.04.0 Staging BAPI‘s Staging& Metadata BAPI‘s Staging& Metadata&..... BAPI‘s No Significant BAPI Development
10
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 10 10 Agenda SAP BW Business Content for Oracle Financials SAP / Ascential Partnership BW Load PACK 3.0 BW MetaBroker
11
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 11 11 Generating BW Meta Data from non-SAP Data Scenario: Importing non-SAP data requires additional manual data modeling in the Administrator Workbench. Solution: BW Load PACK 3.0 supports import of non-SAP meta data: including the creation of InfoObjects, InfoSources, InfoPackages and Source Systems. Users can now generate SAP BW Business Content from legacy meta data. Simply point at DataStage Table Definitions or Stage Column Lists and let the Load PACK create SAP BW objects ready for data loading.
12
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 12 12 Integrated Process Messaging Scenario: SAP BW 3.0 supports multiple data sources. It can be difficult to understand and diagnose data loading problems from non-SAP sources. Solution: BW Load PACK delivers process information on-demand to SAP BW InfoPackages. Users can now see the DataStage job log and load statistics in the SAP BW InfoPackage monitor.
13
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 13 13 Load PACK ‘Pushes’ Data into SAP BW Scenario: Companies have change data triggers and schedulers in their non-SAP systems that invoke DataStage, but SAP BW will only accept data loads as ‘pulls’, invoked by the SAP BW scheduler. The data must be ‘landed’ on the DataStage server. Solution: New BAPIs in SAP BW allow the InfoPackage scheduling to be controlled externally by DataStage. The Load PACK can now manage all scheduling operations and invoke load requests from the DataStage server.
14
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 14 14 Performance Improvements Scenario: Data volumes are increasing. Load performance is mission critical. Solution: The New Load PACK takes full advantage of data streaming and multi-threading processing techniques. Users can even tune their data package transmission sizes for each DataStage job.
15
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 15 15 Improved Architecture SAP BW RFC Server Load PACK Client Load PACK Server Repository Flat File Data Streaming Multithreaded Load Requests DS Job
16
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 16 16 Meta Data Import Design Assumptions BW Load PACK jobs produce column lists which mirror BW transfer structures. createselect The new Load PACK allows users to generate SAP BW InfoObjects and InfoSources directly from these column lists. Consolidation of these operations (ETL and BW modeling) greatly simplifies the loading of non-SAP data. Job designers can now simultaneously create and select BW content in the Load PACK GUI. DataStage repository Table Definitions represent meta data descriptions that can be used to generate SAP BW business content. drive The Load PACK GUI will permit access to the DataStage repository. Table Definitions can be used to drive the creation of InfoObjects in SAP BW.
17
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 17 17 Source System Generaldisplayselect Source System management has been moved to a new independent utility. The General tab is primarily used to display and/or select from existing connections.
18
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 18 18 Transfer Structure TransferStructure creationselection Meta Data BAPI support is accessed in the Transfer Structure tab. The creation and selection of BW content is now functionally interdependent.
19
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 19 19 Table Columns Columns There has been little change to the functionality accessed from the Columns tab. Column Synchronization occurs automatically.
20
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 20 20 InfoPackages Push/Pull Data Load Methods create, scheduleinvoke The Push/Pull Data Load Methods are new with this release of the Load PACK. It is now possible to create, schedule and invoke SAP BW InfoPackages from DataStage.
21
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 21 21 Design Objectives Whenever a DS repository Table Definition or job link Column List relates directly to a desired SAP BW InfoObject or InfoSource definition, allow that table definition or list to drive the creation of the SAP BW Object(s) Allow users to create InfoObjects while in the process of creating an InfoSource that might contain that InfoObject Supply user controllable default values to reduce repetitive data entry when creating an InfoObject or InfoSource Make use of DataStage data elements (that will ship with the Load PACK) to facilitate conversions from a SQL data type to its equivalent SAP type. Example: NUMC becomes CHAR and a custom data element BW_NUMC performs strong data type checking and/or conversion logic to all runtime data for that column
22
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 22 22 Design Objectives (cont.) Maintain an InfoObject catalog for all Objects created by the 3 rd Party Source System Provide visibility of the InfoObject catalog - distinguishing between those objects created by the 3 rd Party Source System as compared with the entire list of InfoObjects in SAP BW Support for Object modeling based on templates derived from the InfoObject catalog Provide support for InfoPackage creation, scheduling and external invocation
23
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 23 23 Full Visibility of Transfer Structure Details Meta data for selected transfer structure is always visible. Source System and InfoSource selection/management is available on the same screen.
24
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 24 24 Entry Point to Meta Data Import Utilities extremely intuitive Transfer Structure tab provides access to all of the InfoObject and InfoSource capabilities. The GUI’s functional hierarchy is extremely intuitive.
25
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 25 25 Create BW Meta Data from DataStage Meta Data Add InfoObjectsfeeds drives Press Add InfoObjects and DataStage feeds the columns into InfoObjects. Simply highlight fields in a DataStage Table Definition. Selected meta data drives the creation of InfoObjects in SAP BW.
26
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 26 26 InfoObject Defaults Add All All InfoObject values contain defaults. Columns can be added sequentially – just click the Add All button.
27
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 27 27 All InfoObject Properties can be Edited Properties All Properties are accessible…
28
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 28 28 Intuitive Dependent Property Management Attributescreatedadded InfoObjects Attributes Select columns from the pop-up DataStage Column list. The Load PACK will know whether the selected rows can simply be selected as Attributes or need to be created and added to the InfoCatalog before the corresponding InfoObjects can be selected. Dependent InfoObjects (Attributes) can be selected from BW InfoCatalogs or generated directly from DataStage Columns. Example: Select or Create InfoObjects to be used as Attributes for the current Object.
29
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 29 29 The Load PACK Maintains it’s own InfoCatalog InfoCatalog To support data integrity, the Load PACK maintains its own InfoCatalog in SAP BW. InfoObjects generated by the Load PACK are cataloged. When generating new InfoObjects, this catalog is queried for possible matches, thereby avoiding unintended meta data redundancy. searched All SAP BW InfoCatalogs can be searched from the Load PACK. All InfoObjectsall Data Sources All InfoObjects from all Data Sources are available for use in the Load PACK.
30
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 30 30 Create BW InfoSources createedit The Load PACK can create and edit SAP BW InfoSources – including Communication Structures, Transfer Rules and Transfer Structures. createpopulate Use DataStage meta data to create and populate Master/Text/Hierarchy and Transaction InfoSources. The Load PACK’s intuitive GUI allows DataStage job designers access to the DS Repository. InfoSources can draw content (InfoObjects) from the DS Repository, the InfoObject catalog or from InfoObjects generated as part of the InfoSource creation process.
31
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 31 31 Design InfoSources to Match non-SAP DataSources define Streamline the ETL – SAP BW Load process – Create the InfoSource while designing a BW Load job. Allow the non-SAP operational data to define SAP BW business content.
32
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 32 32 DataStage Data Elements and Transforms DataStage Data Elements support data typing across disparate meta data. The new Load PACK exploits this capability. SAP proprietary data types (DATS, NUMC, etc) are automatically mapped to DataStage Data Elements. Powerful Transforms can now be mapped effortlessly to incoming non-SAP data. Data transformations are handled consistently. Supplied Custom Transforms convert SQL dates to SAP format automatically BW Load PACK automatically supplies correct Data Element based on SAP BW Transfer Structure
33
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 33 33 DataStage Job Log in BW Monitor
34
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 34 34 Agenda SAP BW Business Content for Oracle Financials SAP / Ascential Partnership BW Load PACK 3.0 BW MetaBroker
35
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 35 35 SAP BW MetaBroker Capabilities SAP BW MetaBroker imports SAP BW meta data into MetaStage InfoSource transfer & communication structures BW ODS structures BW InfoCube structures InfoSource to ODS & InfoCube relationships (end-to-end data lineage)
36
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 36 36 SAP BW MetaBroker
37
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 37 37 What’s New in DataStage 6.0? Significant Performance Enhancements DataStage Server Link Partitioner and Collector Stages Point-and-Click graphical distribution of single job workload across multiple SMP processors. IPC Stage New Row buffering option increases performance, particularly on multiple- CPU systems, by enabling two simultaneously executing work processes in the same DataStage job to pass data more efficiently. In-memory Hashed Files Eliminates memory overhead and initial setup time of multiple server-side copies of reference data when used by multiple DataStage jobs.
38
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 38 38 Platforms and Software Compatibility DataStage PACKs for SAP BW Platforms Windows NT / 2000 / XP IBM AIX SUN Solaris HP HP-UX Compaq Tru64 (upon request) Software Compatibility DataStage 5.1+ SAP BW 2.0B, 2.1C, 3.0B, 3.1 Content MetaStage & SAP BW MetaBroker Platforms Windows NT / 2000 / XP Software Compatibility DataStage XE 6.0 SAP BW 3.0B, 3.1 Content
39
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 39 39 Agenda SAP BW Business Content for Oracle Financials SAP / Ascential Partnership BW Load PACK 3.0 BW MetaBroker
40
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 40 40 BW Load Pack ^ RDBMS SAP BW Business Content for Oracle FI SAP BW BAPI Oracle Appl. PACK RDBMS Oracle FI Access via Application Business Content Predifined DataStage Jobs +
41
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 41 41 Example for Application Pack‘s Oracle Application PACK (Oracle Release 11i) Direct Access Stage: ‚ Add Business View‘ functionality accesses the underlying datamodel via the Business Object level (using Panels and Panel Groups) ‚Add Table View‘ functionality accesses the underlying datamodel directly via DDIC information from Oracle (list of tablenames) Using the metadata description for tables, views and fields as defined in the Oracle Application Delta capabilities are given Automatic search for ‚effective Date‘ fields within Oracle (Type: Timestamp). Automatic creation of a delta-file with the date of the last job run. Hierarchy Stage Supports all in BW needed hierachy data needed in BW.
42
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 42 42 Oracle BW integration Business Content from Oracle Financials Oracle Projects Oracle Human Resources Standard BW Content (BW 3.0B +) DataSources InfoCubes (e.g. Flexible General Ledger, Profitability Analysis, Project Accounting) Web Cockpits (with drill down and navigation, graphical representation, period comparison) Extraction Tools Developed in cooperation with Ascential for BW 3.1 Content, available for pilots September 2002
43
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 43 43 BW 3.0B Content Flexible General Ledger, Profitability Analysis All debits and credits form Oracle GL Balances for actual, plan and encumbrance data. Amounts and quantities for statistical postings Information on the origin of the costs from multiple account assignments as setup in the accounting flexfield. Alternatively, assignment to financial items is possible for profitability analysis. Project Accounting All costs, revenues and consumption quantities for personnel and non-personnel resources. DataSources for all transaction data and for all master data used in theses InfoCubes (32 InfoObjects)
44
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 44 44 BW Web Cockpits based on Oracle Financials Personalizable (e.g. My Cost Centers) One-Click Drilldown from Overview to Detail Switch between table and chart Automatic selection of predefined time frames Web-Cockpits for General Ledger: Costs, Statistical Keyfigures, Profitability Projects: Status, Employees, Resource Consumption
45
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 45 45 Oracle Integration Overview Oracle Applications: Financials Projects Human Resources … BW Business Analytics Content Web Cockpits/ Business Packages Info Cubes Info Sources Cross ERP data models... Extractors for all relevant Master and Transaction Data SAP Business Warehouse Direct Access Native Integration for Operations Oracle Self Services Inquiries and Transactions Management Reporting on operational data Direct access to application modules
46
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 46 46 Q&A
47
SAP AG 2002, Ascential DataStage BW Load PACK 3.0, BI RIG 47 47 © Copyright 2002 SAP AG. All rights reserved. No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® and SQL Server® are registered trademarks of Microsoft Corporation. IBM®, DB2®, DB2 Universal Database, OS/2®, Parallel Sysplex®, MVS/ESA, AIX®, S/390®, AS/400®, OS/390®, OS/400®, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere®, Netfinity®, Tivoli®, Informix and Informix® Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries. ORACLE® is a registered trademark of ORACLE Corporation. UNIX®, X/Open®, OSF/1®, and Motif® are registered trademarks of the Open Group. Citrix®, the Citrix logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® and other Citrix product names referenced herein are trademarks of Citrix Systems, Inc. HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. JAVA® is a registered trademark of Sun Microsystems, Inc. JAVASCRIPT® is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. SAP, SAP Logo, R/2, RIVA, R/3, SAP ArchiveLink, SAP Business Workflow, WebFlow, SAP EarlyWatch, BAPI, SAPPHIRE, Management Cockpit, mySAP, mySAP.com, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. MarketSet and Enterprise Buyer are jointly owned trademarks of SAP Markets and Commerce One. All other product and service names mentioned are the trademarks of their respective owners. Copyright 2002 SAP AG. All Rights Reserved
Similar presentations
© 2025 SlidePlayer.com Inc.
All rights reserved.