On-Line Analytical Processing (OLAP)

Slides:



Advertisements
Similar presentations
OLAP Tuning. Outline OLAP 101 – Data warehouse architecture – ROLAP, MOLAP and HOLAP Data Cube – Star Schema and operations – The CUBE operator – Tuning.
Advertisements

Chapter 18: Data Analysis and Mining Kat Powell. Chapter 18: Data Analysis and Mining ➔ Decision Support Systems ➔ Data Analysis and OLAP ➔ Data Warehousing.
Data Warehousing CPS216 Notes 13 Shivnath Babu. 2 Warehousing l Growing industry: $8 billion way back in 1998 l Range from desktop to huge: u Walmart:
Jennifer Widom On-Line Analytical Processing (OLAP) Introduction.
Data Warehousing - 2 ISYS 650. Data Warehouse Design - Star Schema - Dimension tables – contain descriptions about the subjects of the business such as.
2/10/05Salman Azhar: Database Systems1 On-Line Analytical Processing Salman Azhar Warehousing Data Cubes Data Mining These slides use some figures, definitions,
Decision Support and Data Warehouse. Decision supports Systems Components Data management function –Data warehouse Model management function –Analytical.
OLAP. Overview Traditional database systems are tuned to many, small, simple queries. Some new applications use fewer, more time-consuming, analytic queries.
Advanced Querying OLAP Part 2. Context OLAP systems for supporting decision making. Components: –Dimensions with hierarchies, –Measures, –Aggregation.
Business Intelligence. On-Line Analytical Processing (OLAP) Tools The use of a set of graphical tools that provides users with multidimensional views.
Data Warehousing. On-Line Analytical Processing (OLAP) Tools The use of a set of graphical tools that provides users with multidimensional views of their.
CSE6011 Warehouse Models & Operators  Data Models  relations  stars & snowflakes  cubes  Operators  slice & dice  roll-up, drill down  pivoting.
CS346: Advanced Databases
On-Line Application Processing Warehousing Data Cubes Data Mining 1.
8/20/ Data Warehousing and OLAP. 2 Data Warehousing & OLAP Defined in many different ways, but not rigorously. Defined in many different ways, but.
Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke1 Decision Support Chapter 23.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
©Silberschatz, Korth and Sudarshan18.1Database System Concepts - 5 th Edition, Aug 26, 2005 Buzzword List OLTP – OnLine Transaction Processing (normalized,
On-Line Analytic Processing Chetan Meshram Class Id:221.
OnLine Analytical Processing (OLAP)
Cube Intro. Decision Making Effective decision making Goal: Choice that moves an organization closer to an agreed-on set of goals in a timely manner Goal:
Presented By: Muhammad Rizvi Raghuram Vempali Surekha Vemuri.
Data Warehouse Design Xintao Wu University of North Carolina at Charlotte Nov 10, 2008.
Data Warehousing.
October 28, Data Warehouse Architecture Data Sources Operational DBs other sources Analysis Query Reports Data mining Front-End Tools OLAP Engine.
Data Warehousing. Databases support: Transaction Processing Systems –operational level decision –recording of transactions Decision Support Systems –tactical.
Decision Support and Date Warehouse Jingyi Lu. Outline Decision Support System OLAP vs. OLTP What is Date Warehouse? Dimensional Modeling Extract, Transform,
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Ch3 Data Warehouse Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009.
Winter 2006Winter 2002 Keller, Ullman, CushingJudy Cushing 19–1 Warehousing The most common form of information integration: copy sources into a single.
Ayyat IT Group Murad Faridi Roll NO#2492 Muhammad Waqas Roll NO#2803 Salman Raza Roll NO#2473 Junaid Pervaiz Roll NO#2468 Instructor :- “ Madam Sana Saeed”
Fox MIS Spring 2011 Data Warehouse Week 8 Introduction of Data Warehouse Multidimensional Analysis: OLAP.
1 On-Line Analytic Processing Warehousing Data Cubes.
Decision supports Systems Components
ADVANCED TOPICS IN RELATIONAL DATABASES Spring 2011 Instructor: Hassan Khosravi.
Business Intelligence Transparencies 1. ©Pearson Education 2009 Objectives What business intelligence (BI) represents. The technologies associated with.
OLAP On Line Analytic Processing. OLTP On Line Transaction Processing –support for ‘real-time’ processing of orders, bookings, sales –typically access.
What is OLAP?.
CSE 5331/7331 F'071 CSE 5331/7331 Fall 2007 Dimensional Modeling Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist University.
Data Warehousing.
The Data Warehouse Chapter Operational Databases = transactional database  designed to process individual transaction quickly and efficiently.
Copyright© 2014, Sira Yongchareon Department of Computing, Faculty of Creative Industries and Business Lecturer : Dr. Sira Yongchareon ISCG 6425 Data Warehousing.
Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support.
Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support Chapter 25.
Introduction to OLAP and Data Warehouse Assoc. Professor Bela Stantic September 2014 Database Systems.
An Overview of Data Warehousing and OLAP Technology
Data Warehouses and OLAP 1.  Review Questions ◦ Question 1: OLAP ◦ Question 2: Data Warehouses ◦ Question 3: Various Terms and Definitions ◦ Question.
Databases 2 On-Line Application Processing: Warehousing, Data Cubes, Data Mining.
Or How I Learned to Love the Cube…. Alexander P. Nykolaiszyn BLOG:
Data Warehousing and OLAP Outline u Models & operations u Implementing a warehouse u Future directions.
CSE6011 Implementing a Warehouse  Monitoring: Sending data from sources  Integrating: Loading, cleansing,...  Processing: Query processing, indexing,...
Data Analysis Decision Support Systems Data Analysis and OLAP Data Warehousing.
Data Mining and Data Warehousing: Concepts and Techniques What is a Data Warehouse? Data Warehouse vs. other systems, OLTP vs. OLAP Conceptual Modeling.
On-Line Application Processing
BTM 382 Database Management Chapter 13: Business intelligence and data warehousing Chapter 14-4: Data analytics Chitu Okoli Associate Professor in Business.
Pertemuan <<13>> Data Warehousing dan Decision Support
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Data Warehouse.
On-Line Analytic Processing
Data warehouse and OLAP
On-Line Analytic Processing
Chapter 5: Advanced SQL Database System concepts,6th Ed.
Data Warehouse and OLAP
Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009
On-Line Application Processing
DATA CUBES E0 261 Jayant Haritsa Computer Science and Automation
Data Warehouse and OLAP
Data Warehousing.
Presentation transcript:

On-Line Analytical Processing (OLAP) Introduction

OLTP – Online Transaction Processing OLAP: Intro Two broad types of database activity OLTP – Online Transaction Processing Short transactions Simple queries Touch small portions of data Frequent updates OLAP – Online Analytical Processing Long transactions Complex queries Touch large portions of the data Infrequent updates

Data warehousing More terminology Decision support system (DSS) OLAP: Intro More terminology Data warehousing Bring data from operational (OLTP) sources into a single “warehouse” for (OLAP) analysis Decision support system (DSS) Infrastructure for data analysis E.g., data warehouse tuned for OLAP

Fact table “Star Schema” Dimension tables OLAP: Intro Updated frequently, often append-only, very large Dimension tables Updated infrequently, not as large

Star Schema – fact table references dimension tables OLAP: Intro Star Schema – fact table references dimension tables Sales(storeID, itemID, custID, qty, price) Store(storeID, city, state) Item(itemID, category, brand, color, size) Customer(custID, name, address)

Join  Filter  Group  Aggregate Performance OLAP: Intro OLAP queries Join  Filter  Group  Aggregate Performance Inherently very slow: special indexes, query processing techniques Extensive use of materialized views Sales(storeID, itemID, custID, qty, price) Store(storeID, city, state) Item(itemID, category, brand, color, size) Customer(custID, name, address)

Data Cube (a.k.a. multidimensional OLAP) OLAP: Intro Data Cube (a.k.a. multidimensional OLAP) Dimension data forms axes of “cube” Fact (dependent) data in cells Aggregated data on sides, edges, corner

Fact table uniqueness for data cube OLAP: Intro Fact table uniqueness for data cube If dimension attributes not key, must aggregate Date can be used to create key Dimension or dependent? Sales(storeID, itemID, custID, qty, price)

Drill-down and Roll-up OLAP: Intro Drill-down and Roll-up

Drill-down and Roll-up OLAP: Intro Drill-down and Roll-up Examining summary data, break out by dimension attribute Select state, brand, Sum(qty*price) From Sales F, Store S, Item I Where F.storeID = S.storeID And F.itemID = I.itemID Group By state, brand

Drill-down and Roll-up OLAP: Intro Drill-down and Roll-up Examining data, summarize by dimension attribute Select state, brand, Sum(qty*price) From Sales F, Store S, Item I Where F.storeID = S.storeID And F.itemID = I.itemID Group By state, brand

SQL Constructs OLAP: Intro With Cube and With Rollup Add to result: faces, edges, and corner of cube using NULL values Select dimension-attrs, aggregates From tables Where conditions Group By dimension-attrs With Cube

SQL Constructs OLAP: Intro With Cube and With Rollup For hierarchical dimensions, portion of With Cube Select dimension-attrs, aggregates From tables Where conditions Group By dimension-attrs With Rollup

OLTP – Online Transaction Processing OLAP: Intro Two broad types of database activity OLTP – Online Transaction Processing Short transactions Simple queries Touch small portions of data Frequent updates OLAP – Online Analytical Processing Long transactions Complex queries Touch large portions of the data Infrequent updates Star schemas Data cubes With Cube and With Rollup Special indexes and query processing techniques