Module 1: Introduction to Data Warehousing and OLAP

Slides:



Advertisements
Similar presentations
An overview of Data Warehousing and OLAP Technology Presented By Manish Desai.
Advertisements

OCS Infotech Proprietary & Confidential Typical BI solution Architecture.
Data Warehousing CPS216 Notes 13 Shivnath Babu. 2 Warehousing l Growing industry: $8 billion way back in 1998 l Range from desktop to huge: u Walmart:
Data Warehousing M R BRAHMAM.
2/10/05Salman Azhar: Database Systems1 On-Line Analytical Processing Salman Azhar Warehousing Data Cubes Data Mining These slides use some figures, definitions,
Exploiting the DW data DW is a platform for creating a wide array of reports It solves data feed problems, but does not lead to specific decision support.
Data Sources Data Warehouse Analysis Results Data visualisation Analytical tools OLAP Data Mining Overview of Business Intelligence Data visualisation.
Advanced Querying OLAP Part 2. Context OLAP systems for supporting decision making. Components: –Dimensions with hierarchies, –Measures, –Aggregation.
COMP 578 Data Warehousing And OLAP Technology Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
Lab3 CPIT 440 Data Mining and Warehouse.
CSE6011 Warehouse Models & Operators  Data Models  relations  stars & snowflakes  cubes  Operators  slice & dice  roll-up, drill down  pivoting.
Chapter 13 The Data Warehouse
Introduction to Building a BI Solution 권오주 OLAPForum
Data Warehousing DSCI 4103 Dr. Mennecke Introduction and Chapter 1.
Online Analytical Processing (OLAP) Hweichao Lu CS157B-02 Spring 2007.
Copying, Managing, and Transforming Data With DTS.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
SQL Analysis Services Microsoft® SQL Server 2005 Analysis Services provides unified, fully integrated views of your business data to support online.
Data Warehouse & Data Mining
On-Line Analytic Processing Chetan Meshram Class Id:221.
IMS 6217: Data Warehousing / Business Intelligence Part 3 1 Dr. Lawrence West, Management Dept., University of Central Florida Analysis.
Activity Running Time DurationIntro0 2 min Setup scenario 2 2 min SQL BI components & concepts 4 5 min Data input (Let’s go shopping) 9 7 min Whiteboard.
DW-1: Introduction to Data Warehousing. Overview What is Database What Is Data Warehousing Data Marts and Data Warehouses The Data Warehousing Process.
Datawarehouse & Datamart OLAPs vs. OLTPs Dimensional Modeling Creating Physical Design Using SQL Mgt. Studio Module II: Designing Datamarts 1.
Atlanta Microsoft Database Forum Introduction to Data Warehousing Concepts Brian Thomas Solution Builders, Inc. Presented by March 8, 2004
Presented By: Muhammad Rizvi Raghuram Vempali Surekha Vemuri.
DIMENSIONAL MODELLING. Overview Clearly understand how the requirements definition determines data design Introduce dimensional modeling and contrast.
1 Data Warehouses BUAD/American University Data Warehouses.
13 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management 4th Edition Peter Rob & Carlos Coronel.
OLAP & DSS SUPPORT IN DATA WAREHOUSE By - Pooja Sinha Kaushalya Bakde.
Data Warehouse Design Xintao Wu University of North Carolina at Charlotte Nov 10, 2008.
BI Terminologies.
MIS2502: Data Analytics The Information Architecture of an Organization.
October 28, Data Warehouse Architecture Data Sources Operational DBs other sources Analysis Query Reports Data mining Front-End Tools OLAP Engine.
Decision Support and Date Warehouse Jingyi Lu. Outline Decision Support System OLAP vs. OLTP What is Date Warehouse? Dimensional Modeling Extract, Transform,
1 Technology in Action Chapter 11 Behind the Scenes: Databases and Information Systems Copyright © 2010 Pearson Education, Inc. Publishing as Prentice.
Designing a Data Warehousing System. Overview Business Analysis Process Data Warehousing System Modeling a Data Warehouse Choosing the Grain Establishing.
DW-2: Designing a Data Warehousing System 용 환승 이화여자대학교
Fox MIS Spring 2011 Data Warehouse Week 8 Introduction of Data Warehouse Multidimensional Analysis: OLAP.
UNIT-II Principles of dimensional modeling
Chapter 5 DATA WAREHOUSING Study Sections 5.2, 5.3, 5.5, Pages: & Snowflake schema.
CMPE 226 Database Systems October 21 Class Meeting Department of Computer Engineering San Jose State University Fall 2015 Instructor: Ron Mak
Data Mining Data Warehouses.
Business Intelligence Transparencies 1. ©Pearson Education 2009 Objectives What business intelligence (BI) represents. The technologies associated with.
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
CSE 5331/7331 F'071 CSE 5331/7331 Fall 2007 Dimensional Modeling Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist University.
Advanced Database Concepts
Copyright© 2014, Sira Yongchareon Department of Computing, Faculty of Creative Industries and Business Lecturer : Dr. Sira Yongchareon ISCG 6425 Data Warehousing.
1 Copyright © 2009, Oracle. All rights reserved. Oracle Business Intelligence Enterprise Edition: Overview.
SQL Server Analysis Services Understanding Unified Dimension Model (UDM)
1 Database Systems, 8 th Edition Star Schema Data modeling technique –Maps multidimensional decision support data into relational database Creates.
Introduction to OLAP and Data Warehouse Assoc. Professor Bela Stantic September 2014 Database Systems.
An Overview of Data Warehousing and OLAP Technology
1 Management Information Systems M Agung Ali Fikri, SE. MM.
Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 9: DATA WAREHOUSING.
Defining Data Warehouse Structures Data Warehouse Data Access End User Data Access Data Sources Staging Area Data Marts Data Extract, Transform, and Load.
Business Intelligence Overview
Jaclyn Hansberry MIS2502: Data Analytics The Things You Can Do With Data The Information Architecture of an Organization Jaclyn.
Intro to MIS – MGS351 Databases and Data Warehouses
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Data warehouse and OLAP
Chapter 13 The Data Warehouse
Data Warehouse.
Databases & Data Warehouses
Data Warehouse and OLAP
Introduction of Week 9 Return assignment 5-2
Chapter 13 The Data Warehouse
Data Warehouse and OLAP
Data Warehousing.
Presentation transcript:

Module 1: Introduction to Data Warehousing and OLAP

Overview Introducing Data Warehousing Defining OLAP Solutions Understanding Data Warehouse Design Understanding OLAP Models Applying OLAP Cubes

Introducing Data Warehousing Raw Data vs. Business Information OLTP Source Systems Data Warehouse Characteristics Data Warehouse System Components

Raw Data vs. Business Information Capturing Raw Data Gathering data recorded in everyday operations Deriving Business Information Deriving meaningful information from raw data Turning Data into Information Implementing a decision support system

OLTP Source Systems OLTP System Characteristics Processes real-time transactions of a business Contains data structures optimized for entries and edits Provides limited decision support capabilities OLTP Examples Order tracking Customer service Point-of-sales Service-based sales Banking functions

Data Warehouse Characteristics Provides Data for Business Analysis Processes Integrates Data from Heterogeneous Source Systems Combines Validated Source Data Organizes Data into Non-Volatile, Subject-Specific Groups Stores Data in Structures that Are Optimized for Extraction and Querying

Data Warehouse System Components Data Access User Data Sources Data Marts Data Input Staging Area

Defining OLAP Solutions OLAP Databases Common OLAP Applications Relational Data Marts and OLAP Cubes OLAP in SQL Server 2000

OLAP Databases Optimized Schema for Fast User Queries Robust Calculation Engine for Numeric Analysis Conceptual, Intuitive Data Model Multidimensional View of Data Drill down and drill up Pivot views of data

Common OLAP Applications Executive Information Systems Performance measures Exception reporting Sales/Marketing Applications Booking/billing Product analysis Customer analysis Financial Applications Reporting Planning Analysis Operations Applications Manufacturing Customer service Product cost

Relational Data Marts and OLAP Cubes Data Storage Data Structure N-dimensional Data structure Data Content Detailed and Summarized Data Data Sources Relational and Non-relational Sources Data Retrieval Fast Performance for Data Extract Queries Faster Performance for

OLAP in SQL Server 2000 Microsoft Is One of Several OLAP Vendors Analysis Services Is Bundled with Microsoft SQL Server 2000 Analysis Services Include OLAP engine Data mining technology

Understanding Data Warehouse Design The Star Schema Fact Table Components Dimension Table Characteristics The Snowflake Schema

The Star Schema Employee_Dim Dimension Table Fact Table Time_Dim EmployeeKey EmployeeID ... Dimension Table Fact Table Time_Dim TimeKey TheDate ... Product_Dim ProductKey ProductID ... Sales_Fact TimeKey EmployeeKey ProductKey CustomerKey ShipperKey Sales Amount Unit Sales ... Shipper_Dim ShipperKey ShipperID ... Customer_Dim CustomerKey CustomerID ...

Fact Table Components Dimension Tables sales_fact Table customer_dim Foreign Keys Measures 201 ALFI Alfreds customer_key product_key time_key quantity_sales amount_sales product_dim 201 25 134 400 10,789 25 123 Chai 134 1/1/2000 time_dim The grain of the sales_fact table is defined by the lowest level of detail stored in each dimension

Dimension Table Characteristics Describes Business Entities Contains Attributes That Provide Context to Numeric Data Presents Data Organized into Hierarchies

The Snowflake Schema Defines Hierarchies by Using Multiple Dimension Tables Is More Normalized than a Single Table Dimension Is Supported within Analysis Services

Understanding OLAP Models OLAP Database Components OLAP Dimensions vs. Relational Dimensions Dimension Fundamentals Dimension Family Relationships Cube Measures Relational Data Sources

OLAP Database Components Numeric Measures Dimensions Cubes

OLAP Dimensions vs. Relational Dimensions REGION West East STATE REGION CA West OR West MA East NY East REGION West CA OR East MA NY

Dimension Fundamentals

Dimension Family Relationships USA is the parent of North West and South West USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California USA North West Oregon Washington South West California North West and South West are children of USA North West and California are descendants of USA North West and USA are ancestors of Washington North West and South West are siblings Oregon and California are cousins All are dimension members

Cube Measures Are the Numeric Values of Principle Interest Correspond to Fact Table Facts Intersect All Dimensions at All Levels Are Aggregated at All Levels of Detail Form a Dimension

Relational Data Sources Star and Snowflake Schemas Are required to build a cube with Analysis Services Fact Table Contains measures Contains keys that join to dimension tables Dimension Tables Must exist in same database as fact table Contain primary keys that identify each member

Applying OLAP Cubes Defining a Cube Querying a Cube Defining a Cube Slice Working with Dimensions and Hierarchies Visualizing Cube Dimensions Connecting to an OLAP Cube

Defining a Cube Atlanta Chicago Market Dimension Denver Grapes Cherries Detroit Melons Products Dimension Apples Q1 Q2 Q3 Q4 Time Dimension

Querying a Cube Sales Fact Atlanta Chicago Markets Dimension Denver Grapes Cherries Dallas Melons Apples Products Dimension Q1 Q2 Q3 Q4 Time Dimension

Defining a Cube Slice Atlanta Chicago Markets Dimension Denver Grapes Cherries Detroit Melons Apples Products Dimension Q1 Q2 Q3 Q4 Time Dimension

Working with Dimensions and Hierarchies Dimensions Allow You to Slice Dice Hierarchies Allow You to Drill Down Drill Up

Visualizing Cube Dimensions

Connecting to an OLAP Cube

Review Introducing Data Warehousing Defining OLAP Solutions Understanding Data Warehouse Design Understanding OLAP Models Applying OLAP Cubes