Presentation is loading. Please wait.

Presentation is loading. Please wait.

Robert Hickman Pragmatic Information Inc. March 5, 2002 Data Quality Data Quality … a venture into some personal experiences.

Similar presentations


Presentation on theme: "Robert Hickman Pragmatic Information Inc. March 5, 2002 Data Quality Data Quality … a venture into some personal experiences."— Presentation transcript:

1 Robert Hickman Pragmatic Information Inc. March 5, 2002 Data Quality Data Quality … a venture into some personal experiences and insights

2 March 5, 2002(c) Pragmatic Information Inc.2 Data Quality Topics Data Quality The Real Ugliness Romantic Reality Cowboys (and Cowgirls)

3 March 5, 2002(c) Pragmatic Information Inc.3 Data Quality Data Quality Is It Important? “Data and information are now as vital to an organization's well being and future success as oxygen is to human’s.” “The Data Warehousing Institute estimates that data quality problems cost U.S. businesses more that $600 billion a year.” Wayne W. Eckerson - The Data Quality Report

4 March 5, 2002(c) Pragmatic Information Inc.4 Data Quality Data Quality Why do “Information” Quality? Performing work once Performing work correctly Trust the data vs. investigating the data Report against the data vs. applying data calculations and reformatting Making the right decisions Action on business opportunities Source: Larry English

5 March 5, 2002(c) Pragmatic Information Inc.5 Data Quality Data Quality Does is have value? Time Errors

6 March 5, 2002(c) Pragmatic Information Inc.6 Data Warehouse Legacy/OLTP Applications CRM Applications Source Data External Data Sources DM Data Quality Data Quality … is a Process owned by management Quality

7 March 5, 2002(c) Pragmatic Information Inc.7 The Real Ugliness The Real Ugliness Quality Quote #1 The real ugliness lies in the relationship between the people who produce the technology and the things they produce, which results in a similar relationship between the people who use the technology and the things they use. Robert M. Pirsig [Zen and the Art of Motorcycle Maintenance]

8 March 5, 2002(c) Pragmatic Information Inc.8 Data DataProcessing Presentation The Real Ugliness The Real Ugliness Data Presentation - The Business Viewpoint

9 March 5, 2002(c) Pragmatic Information Inc.9 The Real Ugliness The Real Ugliness Puzzle #1 - Technical

10 March 5, 2002(c) Pragmatic Information Inc Store 105 Store 106 Store 107 Store 108 Store 109 Store 110 Store 111 Location Product JANFEBMAR Time Hockey Sticks Total The Real Ugliness The Real Ugliness “Blank” Result

11 March 5, 2002(c) Pragmatic Information Inc Store 105 Store 106 Store 107 Store 108 Store 109 Store 110 Store 111 Location Product JANFEBMAR Time Hockey Sticks Total The Real Ugliness The Real Ugliness “Null” Result

12 March 5, 2002(c) Pragmatic Information Inc Store 105 Store 106 Store 107 Store 108 Store 109 Store 110 Store 111 Location Product JANFEBMAR Time Hockey Sticks Total The Real Ugliness The Real Ugliness “Expected” Result Store 112

13 March 5, 2002(c) Pragmatic Information Inc.13 The Real Ugliness The Real Ugliness Puzzle #2 –Technical/Business Current Address: 48 Yonge St. Data Reported: 06/98 Previous Address: 96 Toronto St,Date Reported: 01/99 Prior Address: 19B6-96 Toronto St E,Date Reported: 06/98

14 March 5, 2002(c) Pragmatic Information Inc Store 105 Store 106 Store 107 Store 108 Store 109 Store 110 Store 111 Location Product JANFEBMAR Time Hockey Sticks Total The Real Ugliness The Real Ugliness Puzzle #3 - Business Store 112

15 March 5, 2002(c) Pragmatic Information Inc Tom Mary Megan Sharon Susan Mike Robert Sales Person Product JANFEBMAR Time Hockey Sticks The Real Ugliness The Real Ugliness Puzzle #4 – Business Beth.

16 March 5, 2002(c) Pragmatic Information Inc.16 The Real Ugliness The Real Ugliness The Technology/Business Relationship

17 March 5, 2002(c) Pragmatic Information Inc.17 Romantic Reality Romantic Reality Quality Quote #2 Romantic reality is the cutting edge of experience. It's the leading edge of the train of knowledge that keeps the whole train on the track. Traditional knowledge is only the collective memory of where that leading edge has been. Robert M. Pirsig [Zen and the Art of Motorcycle Maintenance]

18 March 5, 2002(c) Pragmatic Information Inc.18 Romantic Reality Romantic Reality A Good Data Quality Habit “See For Yourself” The Seven Habits of Highly Effective Data Modellers – Daniel Moody

19 March 5, 2002(c) Pragmatic Information Inc.19 Romantic Reality Romantic Reality Manufacturing data, or manufacturing data errors … Un-displayable characters (hex on) 34,190 null descriptions exist in a single dimension column Time dimension was not populated Dimensional hierarchies were incomplete 71 states in the United States Many others

20 March 5, 2002(c) Pragmatic Information Inc.20 Romantic Reality Romantic Reality Beyond … Corporate vs. Department Calculations Globalization Currency Multiculturalism Names

21 March 5, 2002(c) Pragmatic Information Inc.21 Romantic Reality Romantic Reality Spanish Double Surnames Fathers’ last name & mother’s maiden name Double first name Example: “Juan José Martínez Sánchez” First names are Juan José Father’s last name is Martínez Mother’s maiden name is Sánchez Hyphen use? Source:

22 March 5, 2002(c) Pragmatic Information Inc.22 Cowboys Cowboys Quote #3 One thing about pioneers that you don't hear mentioned is that they are invariably, by their nature, mess makers. They go forging ahead, seeing only their noble, distant goal, and never notice any of the crud and debris they leave behind them. Someone else gets to clean that up and it's not a very glamorous or interesting job. Robert M. Pirsig [Zen and the Art of Motorcycle Maintenance]

23 March 5, 2002(c) Pragmatic Information Inc.23 Cowboys Cowboys Clouds of Sunshine Department A Department B Department C Company = 1500 units = 3700 units = 5000 units (1900?) = 1700 units

24 March 5, 2002(c) Pragmatic Information Inc.24 Cowboys Cowboys Data Pools Data Warehouse Legacy/OLTP Applications ERP Applications Source Data External Data Sources Data

25 March 5, 2002(c) Pragmatic Information Inc.25 Cowboys Cowboys Proprietary Solutions (Silos) Data Warehouse Legacy/OLTP Applications CRM Application Source Data External Data Sources CRM DB

26 March 5, 2002(c) Pragmatic Information Inc.26 Cowboys Cowboys Data Quality Because there is no monitoring... Dependent on the viewpoint, “The data is clean or it’s not clean”

27 March 5, 2002(c) Pragmatic Information Inc.27 Cowboys Cowboys Data Quality No Data Quality Plan Status of Data Quality Plans No Plans 48 % Developing Plan20 % Implementing21 % Implemented11% Source TDWI

28 March 5, 2002(c) Pragmatic Information Inc.28 Cowboys Cowboys A data quality model Start-up (1998) Required culture change Business owned process Data quality program Data integrity incentives Started with purchased data Applied the data quality program Data quality ROI: –Large contract awarded –Increased market share

29 March 5, 2002(c) Pragmatic Information Inc.29 Conclusions Data Quality – Important The Real Ugliness – Relationship Romantic Reality – See for yourself Cowboys – Beware Get the Commitment from the top Develop a Data Quality Program Start Now

30 March 5, 2002(c) Pragmatic Information Inc.30 Selected References Books Improving Data Warehouse and Business Information Quality – Larry English Managing the Data Warehouse – W. Inmon, J. Welch, K. Glassey The Data Warehouse Lifecycle Toolkit – R. Kimball, L. Reeves, M. Ross, W. Thornthwaite Zen and the Art of Motorcycle Maintenance – Robert Pirsig White papers TDWI’s Data Quality Report – Presentations The Seven Habits of Highly Effective Data Modellers – Daniel Moody Web Sites Source:


Download ppt "Robert Hickman Pragmatic Information Inc. March 5, 2002 Data Quality Data Quality … a venture into some personal experiences."

Similar presentations


Ads by Google