1. Data Consistency in SAP BW Know How Network Conference Call May 29 th 2003 Mike Eacrett BW RIG, SAP Labs, LLC

2. SAP AG 2003, Data Consistency, M. Eacrett / 2 Agenda Motivation Measures Consistency Check Important Check Tools Summary

3. SAP AG 2003, Data Consistency, M. Eacrett / 3 Why a Data Consistency Project? SAP BW has grown to be the most important information system for many companies SAP BW provides key information for all core business areas Confidence in correct data is essential to the success of a data warehouse Delivery of information must be trusted on an ongoing basis

4. SAP AG 2003, Data Consistency, M. Eacrett / 4 What does SAP do? In relation to other vendors, SAP BW get high marks in the field of data consistency. All information on data consistency questions are published in SAP notes which can be accessed very easily via OSS or SAP Service Marketplace. To provide an additional service for our customers, partners, and consultants, SAP has compiled these notes into a comprehensive document, made available on the SAP Service Marketplace. Furthermore, a Guideline document on usage of the check tools is provided. Thus, SAP assures that customers, partners, and consultants have a fast access to: the needed information in case of questions in the area of data consistency the appropriate tools to validate your data consistency

5. SAP AG 2003, Data Consistency, M. Eacrett / 5 Agenda Motivation Measures Consistency Check Important Check Tools Summary

6. SAP AG 2003, Data Consistency, M. Eacrett / 6 Analysis Analysis of SAP BW for potential improvements Consideration for erroneous user behavior Misperceptions regarding functionality Design optimization Groups involved in design Developers Customer Support Customers Consultants Partners

7. SAP AG 2003, Data Consistency, M. Eacrett / 7 Improvements BW Developments Protects system better against inexperienced or erroneous user behavior Automatic checks implemented Check tools Scheduled checks Manual checks Continuous improvements Consistency Check Service Check relevant notes Use check tools Recommendations for customers

8. SAP AG 2003, Data Consistency, M. Eacrett / 8 Agenda Motivation Measures Consistency Check Important Check Tools Summary

9. SAP AG 2003, Data Consistency, M. Eacrett / 9 Information in SAP Service Marketplace Results of the Data Consistency Project are available on the SAP Service Marketplace: Alias BW -> Section: Data Consistency

10. SAP AG 2003, Data Consistency, M. Eacrett / 10 Information in SAP Service Marketplace A Guideline Document describes the necessary steps for performing a system check and introduces the available check tools. A Notes List provides you the following information: Tables detailing SAP note checklists by SAP BW release A list of existing check tools (incl. documentation notes) A list of SAP notes arranged by functional areas

11. SAP AG 2003, Data Consistency, M. Eacrett / 11 Agenda Motivation Measures Consistency Check Important Check Tools Summary

12. SAP AG 2003, Data Consistency, M. Eacrett / 12 RSRV: Analysis and Repair of BW Objects Transaction RSRV Referential integrity of the star schema Correctness of master data / hierarchy tables Technical parameter validation for correctness Information on each check is provided via check descriptions (right click on check) Combined Tests with multiple related checks provided Reduces scheduling and administration time More through testing Checks can be run manually (immediately) Checks can be scheduled via packages Results are made available in application log

13. SAP AG 2003, Data Consistency, M. Eacrett / 13 RSRV: Analysis and Repair of BW Objects A sample of the extensive selection of checks available: Functional Master Data: Data structure and value consistency Transaction Data: InfoCube Dimension, DB, and data consistency. ODS Object key relationships etc.. Hierarchy: Definition and data consistency Aggregates: Definition and Data consistency PSA and Documents can also be checked Technical Database parameters and partition integrity Database Indices, statistics, DB and Star schema Information Additional check tools are provided on an ongoing basis via support packages.

14. SAP AG 2003, Data Consistency, M. Eacrett / 14 RSRV: Analysis and Repair of BW Objects Scheduling RSRV checks: 1.Create a Test Package Test packages can be reloaded & edited in the future)

15. SAP AG 2003, Data Consistency, M. Eacrett / 15 RSRV: Analysis and Repair of BW Objects Scheduling RSRV checks: 2.Execute the Package

16. SAP AG 2003, Data Consistency, M. Eacrett / 16 RSRV: Analysis and Repair of BW Objects Repair functionality is made available wherever possible Based of results stored in the application logs Analysis of the errors found should be performed before just clicking repair. Loss of diagnostic information as data and/or object is corrected Difficulty in resolving issues real cause if resolved Repair should be executed after analysis Repairs for some checks are not available due to: Technical issues e.g. DB constraints or shutdown/restart required Functional issues Design or Configuration issues Data consistency may be effected and automatic repair rules do not exist

17. SAP AG 2003, Data Consistency, M. Eacrett / 17 Analysis of Aggregates (SAP BW 3.x) Automatic Aggregate Check (Note 584609) Check report available (as of 3.0B SP9 / 3.1 SP3) Can be scheduled to run in background via a variant Can also be scheduled in process chains via ABAP process chain Automatic scheduling possible after aggregate maintenance processes

18. SAP AG 2003, Data Consistency, M. Eacrett / 18 Details: Three Check Modes For Aggregates Complete Check (Mode A): Rebuild aggregate out of InfoCube or parent aggregate as internal table and compare with aggregate on DB. Check time approximately the same time as for rebuilding the aggregate. Check of key figure sums (Mode Q): Summarizes aggregate and source (InfoCube or parent aggregate) over all characteristics and compare the sum of each key figure. Check time approx. 3-4 times faster than mode A. Check-Aggregates (Mode C): Create new aggregates summarized over all characteristics (except package and unit dimension) with the fixed value combination of the aggregate to be checked. Very fast, but additional aggregates are created and have to be maintained.

19. SAP AG 2003, Data Consistency, M. Eacrett / 19 Analysis of Aggregates - Execution Execution via ABAP The ABAP can be executed online or via a background job. Recommendation: Execute weekly for critical aggregates with check mode C. (Do not execute during aggregate maintenance or rollup!) Aggregate Technical name Check the Parent InfoCube/Aggregate Write a log file Check mode*

20. SAP AG 2003, Data Consistency, M. Eacrett / 20 Analysis of Aggregates - Execution Execution automatically during aggregate functions Check mode C, Q, A respectively Execution timing: 1. After a change run 2. After a roll up 3. After data deletion Aggregate selection

21. SAP AG 2003, Data Consistency, M. Eacrett / 21 Agenda Motivation Measures Consistency Check Important Check Tools Summary

22. SAP AG 2003, Data Consistency, M. Eacrett / 22 Recommendations & Outlook How to proceed: Read the Guideline Documents carefully Check your BW system using the Notes List provided in SAP Service Marketplace Please be aware of regular updates of this list! Check your system regularly to ensure data consistency and maintain data confidence Future Outlook: Integration check tools in Process Chain Process types. Ongoing deployment of check tools in RSRV

23. SAP AG 2003, Data Consistency, M. Eacrett / 23 Questions

24. SAP AG 2003, Data Consistency, M. Eacrett / 24 No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® and SQL Server® are registered trademarks of Microsoft Corporation. IBM®, DB2®, DB2 Universal Database, OS/2®, Parallel Sysplex®, MVS/ESA, AIX®, S/390®, AS/400®, OS/390®, OS/400®, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere®, Netfinity®, Tivoli®, Informix and Informix® Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries. ORACLE® is a registered trademark of ORACLE Corporation. UNIX®, X/Open®, OSF/1®, and Motif® are registered trademarks of the Open Group. Citrix®, the Citrix logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® and other Citrix product names referenced herein are trademarks of Citrix Systems, Inc. HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. JAVA® is a registered trademark of Sun Microsystems, Inc. JAVASCRIPT® is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One. SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and service names mentioned are trademarks of their respective companies. Copyright 2003 SAP AG. All Rights Reserved