Pindaro Demertzoglou Data Resource Management – MGMT 4170 Lally School of Management Rensselaer Polytechnic Institute.

Slides:



Advertisements
Similar presentations
Dimensional Modeling.
Advertisements

BY LECTURER/ AISHA DAWOOD DW Lab # 2. LAB EXERCISE #1 Oracle Data Warehousing Goal: Develop an application to implement defining subject area, design.
OLAP Services Business Intelligence Solutions. Agenda Definition of OLAP Types of OLAP Definition of Cube Definition of DMR Differences between Cube and.
OLAP. Overview Traditional database systems are tuned to many, small, simple queries. Some new applications use fewer, more time-consuming, analytic queries.
Data Sources Data Warehouse Analysis Results Data visualisation Analytical tools OLAP Data Mining Overview of Business Intelligence Data visualisation.
Advanced Querying OLAP Part 2. Context OLAP systems for supporting decision making. Components: –Dimensions with hierarchies, –Measures, –Aggregation.
COMP 578 Data Warehousing And OLAP Technology Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
Lab3 CPIT 440 Data Mining and Warehouse.
Data Warehousing. On-Line Analytical Processing (OLAP) Tools The use of a set of graphical tools that provides users with multidimensional views of their.
CSE6011 Warehouse Models & Operators  Data Models  relations  stars & snowflakes  cubes  Operators  slice & dice  roll-up, drill down  pivoting.
Chapter 13 The Data Warehouse
DATA WAREHOUSE (Muscat, Oman).
Online Analytical Processing (OLAP) Hweichao Lu CS157B-02 Spring 2007.
1 Basic concepts of On-Line Analytical processing DT211 /4.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
SharePoint 2010 Business Intelligence Module 6: Analysis Services.
Sayed Ahmed Logical Design of a Data Warehouse.  Free Training and Educational Services  Training and Education in Bangla: Training and Education in.
1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.
Chapter 6: Foundations of Business Intelligence - Databases and Information Management Dr. Andrew P. Ciganek, Ph.D.
OnLine Analytical Processing (OLAP)
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
Using SAS® Information Map Studio
Faster and Smarter Data Warehouses with Oracle OLAP 11g.
DIMENSIONAL MODELLING. Overview Clearly understand how the requirements definition determines data design Introduce dimensional modeling and contrast.
Data Warehouse. Design DataWarehouse Key Design Considerations it is important to consider the intended purpose of the data warehouse or business intelligence.
OLAP & DSS SUPPORT IN DATA WAREHOUSE By - Pooja Sinha Kaushalya Bakde.
Data Warehousing.
BUSINESS ANALYTICS AND DATA VISUALIZATION
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Section D.  OLAP (or Online Analytical Processing) has been growing in popularity due to the increase in data volumes and the recognition of the business.
DATABASES AND DATA WAREHOUSES
By N.Gopinath AP/CSE. There are 5 categories of Decision support tools, They are; 1. Reporting 2. Managed Query 3. Executive Information Systems 4. OLAP.
UNIT-II Principles of dimensional modeling
A POWER OF OLAP TECHNOLOGY National Technical University of Ukraine “Kiev Polytechnic Institute” Heat and energy design faculty Department of automation.
Business Intelligence Transparencies 1. ©Pearson Education 2009 Objectives What business intelligence (BI) represents. The technologies associated with.
What is OLAP?.
CSE 5331/7331 F'071 CSE 5331/7331 Fall 2007 Dimensional Modeling Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist University.
Data Warehousing.
The Data Warehouse Chapter Operational Databases = transactional database  designed to process individual transaction quickly and efficiently.
Copyright© 2014, Sira Yongchareon Department of Computing, Faculty of Creative Industries and Business Lecturer : Dr. Sira Yongchareon ISCG 6425 Data Warehousing.
SQL Server Analysis Services Understanding Unified Dimension Model (UDM)
Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support Chapter 25.
Introduction to OLAP and Data Warehouse Assoc. Professor Bela Stantic September 2014 Database Systems.
Data Warehouses and OLAP 1.  Review Questions ◦ Question 1: OLAP ◦ Question 2: Data Warehouses ◦ Question 3: Various Terms and Definitions ◦ Question.
Or How I Learned to Love the Cube…. Alexander P. Nykolaiszyn BLOG:
Data Resource Management – MGMT An overview of where we are right now SQL Developer OLAP CUBE 1 Sales Cube Data Warehouse Denormalized Historical.
CSE6011 Implementing a Warehouse  Monitoring: Sending data from sources  Integrating: Loading, cleansing,...  Processing: Query processing, indexing,...
Data Mining & OLAP What is Data Mining? Data Mining is the set of activities used to find new, hidden, or unexpected patterns in data.
Data Resource Management MGMT 4170 Lally School of Management Data Structures in Organizations.
Data Analysis and OLAP Dr. Ms. Pratibha S. Yalagi Topic Title
Reporting and Analysis With Microsoft Office
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Data warehouse and OLAP
Chapter 13 The Data Warehouse
Applying Data Warehouse Techniques
CMPE 226 Database Systems April 11 Class Meeting
MANAGING DATA RESOURCES
Data Warehouse and OLAP
Enhance BI Applications and Simplify Development
University of Houston-Clear Lake Kaiser Permanente San Jose
Applying Data Warehouse Techniques
MIS2502: Data Analytics Dimensional Data Modeling
DataMart (Data Warehouse) Tool:
Applying Data Warehouse Techniques
MIS2502: Data Analytics Dimensional Data Modeling
Introduction of Week 9 Return assignment 5-2
Data Warehouse and OLAP
Data Warehousing.
Presentation transcript:

Pindaro Demertzoglou Data Resource Management – MGMT 4170 Lally School of Management Rensselaer Polytechnic Institute

Our goal is to talk about what we can actually see in our labs and completely understand. Let us have a look at the following diagram: Lots of theory behind OLAP

An overview of where we are right now SQL Developer OLAP CUBE 1 Sales Cube Data Warehouse Denormalized Historical Data OLAP CUBE 2 Warehouse Cube OLAP CUBE 3 Store Cube Transaction Processing System -RDBMS- Relational Data ETL Packages Cube/MDX Developer DW DeveloperETL Developer

SQL is an involved language that needs serious training to operate efficiently. SQL requires knowledge of relational databases. End users need a simplified approach to access the wealth of information in the data warehouse. Why not use SQL to get information out of the DW?

OLAP’s goal is to provide easy and interactive access to analytic resources to support decision-making in the organization. Online Analytical Processing

OLAP organizes data into multidimensional cubes very similar to cross tabbing and pivoting in relational databases. Example of cross tabbing Example of pivoting The ancestors of OLAP

An OLAP Cube Cheese Cola Milk Cream Store1 Store 2 Store 3 Unit Sales as a function of stores and product 3/1 3/2 3/3 3/ Units of Milk sold in store 3 the 3 rd of March Dimensions Measure

Dimension Hierarchies In each dimension table we have built in this class we have some hierarchies to analyze data in different levels of detail. Let us have a look at a graph to explain exactly what we mean.

Dimension Hierarchies Customers Dimension All Customers CountryStateCityZip Date Dimension All TimeYearSemesterQuarterMonth Product Dimension All Products Product Line Product SKU Product Brand Product Name

OLAP Cube Slicing Slicing a cube means that we select data across the same dimension. Since we have multiple dimensions in a cube, we have multiple ways to slice data.

OLAP Cube Dicing Dicing a cube means that we obtain a sub-cube of the current cube. That is we might select all dimensions but with filters for those dimensions. For example, we might not want to see all international stores but only stores in the US.

Calculations in OLAP cubes We can define calculations like profit, sales year to date, and sales same period last year. We can do this easily and right in the cube if the calculation has not been provided to us by the DW or the base cube.

ROLAP OLAP The database in which we store our data is in a regular Relational Database Management System (RDBMS). Simply the dimensional model is different than the ERD model for an OLTP system. It is a quite scalable and robust solution. Performance might be an issue

OLAP preprocesses these cubes to provide maximum performance for queries that summarize data in various ways and a query for a specific time, product, store, or customer can be answered in a few seconds or less regardless of how many hundreds of millions of rows of data are stored in the data warehouse database. Cube Pre-Processing for speed

It is not designed to support update transactions. The inherent nature of historical data in a data warehouse enables OLAP to provide its performance in rapidly summarizing information for analytical queries. Not made for updates of historical data

Query Speed Query speed is the first reason most businesses are attracted to OLAP. OLAP offers excellent dimensional query performance.

Excellent User front-end environment Easy for users to use the Cube front end to obtain the data they need from multiple software packages. Users can create their own OLAP cubes using as a base an existing OLAP cube without the need to access the DW. Ability to combine facts from multiple business processes (fact tables).

Security Complex security rules: One of the challenges of providing ad hoc access to the data warehouse is to secure detailed data but provide open access to summarized data. This is particularly true for ad hoc use. OLAP enables complex security rules that help keep the DW safe but give full access of information to people who need it.