David Gilmore & Richard Blevins Senior Consultants April 17th, 2012

Slides:



Advertisements
Similar presentations
Supervisor : Prof . Abbdolahzadeh
Advertisements

Business Intelligence (BI) PerformancePoint in SharePoint 2010 Sayed Ali – SharePoint Administrator.
AXC01 DIXF: The Microsoft Dynamics AX Data Import and Export Framework
C6 Databases.
Management Information Systems, Sixth Edition
Chapter 3 Database Management
Accelerated Access to BW Al Weedman Idea Integration.
BUSINESS DRIVEN TECHNOLOGY
M ODULE 5 Metadata, Tools, and Data Warehousing Section 4 Data Warehouse Administration 1 ITEC 450.
ETL By Dr. Gabriel.
BUSINESS INTELLIGENCE/DATA INTEGRATION/ETL/INTEGRATION AN INTRODUCTION Presented by: Gautam Sinha.
IT – DBMS Concepts Relational Database Theory.
L/O/G/O Metadata Business Intelligence Erwin Moeyaert.
SSIS Over DTS Sagayaraj Putti (139460). 5 September What is DTS?  Data Transformation Services (DTS)  DTS is a set of objects and utilities that.
5.1 © 2007 by Prentice Hall 5 Chapter Foundations of Business Intelligence: Databases and Information Management.
Understanding Data Warehousing
BI Technical Infrastructure Approach
Database Design - Lecture 1
Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.
Jean-Pierre Dijcks Principal Product Manager Oracle Warehouse Builder Oracle Corporation.
1 INTRODUCTION TO DATABASE MANAGEMENT SYSTEM L E C T U R E
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie.
ETL Overview February 24, DS User Group - ETL - February ETL Overview “ETL is the heart and soul of business intelligence (BI).” -- TDWI ETL.
Session 4: The HANA Curriculum and Demos Dr. Bjarne Berg Associate professor Computer Science Lenoir-Rhyne University.
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
1 Data Warehouses BUAD/American University Data Warehouses.
Right In Time Presented By: Maria Baron Written By: Rajesh Gadodia
Storing Organizational Information - Databases
C6 Databases. 2 Traditional file environment Data Redundancy and Inconsistency: –Data redundancy: The presence of duplicate data in multiple data files.
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
Carey Probst Technical Director Technology Business Unit - OLAP Oracle Corporation.
Decision Support and Date Warehouse Jingyi Lu. Outline Decision Support System OLAP vs. OLTP What is Date Warehouse? Dimensional Modeling Extract, Transform,
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
DATABASES AND DATA WAREHOUSES
Metadata By N.Gopinath AP/CSE Metadata and it’s role in the lifecycle. The collection, maintenance, and deployment of metadata Metadata and tool integration.
7 Strategies for Extracting, Transforming, and Loading.
1 Copyright © 2008, Oracle. All rights reserved. I Course Introduction.
SSIS – Deep Dive Praveen Srivatsa Director, Asthrasoft Consulting Microsoft Regional Director | MVP.
Data Warehousing 101 Howard Sherman Director – Business Intelligence xwave.
Oracle Business Intelligence Foundation - Commonly Used Features in Repository.
1 Copyright © Oracle Corporation, All rights reserved. Business Intelligence and Data Warehousing.
SAS BI ONLINE TRAINING Contact our Support Team : SOFTNSOL India: Skype id : softnsoltrainings id:
2 Copyright © 2006, Oracle. All rights reserved. Defining Data Warehouse Concepts and Terminology.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. Oracle Data Integrator By Lera Technologies.
Supervisor : Prof . Abbdolahzadeh
Energy Management Solution
ETL Design - Stage Philip Noakes May 9, 2015.
Intro to MIS – MGS351 Databases and Data Warehouses
Defining Data Warehouse Concepts and Terminology
Business Intelligence 101
Business Intelligence & Data Warehousing
Antonio Abalos Castillo
Chapter 13 Business Intelligence and Data Warehouses
Energy Management Solution
Data Warehouse.
Databases and Data Warehouses Chapter 3
Defining Data Warehouse Concepts and Terminology
Chapter 1 Database Systems
Database Vs. Data Warehouse
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Databases and Data Warehouses
Data warehouse.
DAT381 Team Development with SQL Server 2005
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Chapter 1 Database Systems
Data Warehousing Concepts
Analytics, BI & Data Integration
Customer 360.
Presentation transcript:

David Gilmore & Richard Blevins Senior Consultants April 17th, 2012 Project Kick-Off: Banner Operational Data Store and Banner Electronic Data Warehouse David Gilmore & Richard Blevins Senior Consultants April 17th, 2012

Introduction & Agenda Introduction Agenda The “Big Picture” Banner Operational Data Store’s (Banner ODS) Role Banner Electronic Data Warehouse’s (Banner EDW) Role Banner ODS Concepts Banner EDW Concepts ODS & EDW Administrator Technical Support Comments and Questions

The “Big Picture” Business Intelligence (BI)

What is Business Intelligence? Business intelligence is essentially timely, accurate, high-value, and actionable insights, and the work processes and technologies used to obtain them. Scheps, Swain. Business Intelligence for Dummies. Indianapolis: Wiley, 2008. Print.

BI Definition - Significant Points Timely – Allowing sufficient time for proactive action Accurate – Logically supporting insights or decisions High-Value – Nontrivial and worthy of reporting effort Actionable – Having an outcome susceptible to outcome-changing influence NOTE: Technology NOT required!!

Is this BI? Timely? Maybe! Banner Legacy Microsoft Excel Other System

Is this BI? Timely, but efficient? Banner Legacy Other System

What is Ellucian’s basic BI architecture? Data Warehouse Banner Legacy Other System Other System

What is AHC’s basic BI architecture? Data Warehouse Banner Legacy Other System Other System

Significant Architectural Points Minimizes impact of reporting on transactional system performance Promotes more consistent reporting results Supports most reporting tools Minimizes impact of transactional system maintenance Promotes a single version of the truth Promotes efficient collection of data Supports data formats, e.g. historical or aggregated, valuable for reporting but not transactional processing Supports static data retention, i.e. data freezes or snapshots

The BI Roles: Banner ODS & Banner EDW

Narrowing Our Focus Data Warehouse Banner Legacy Other System

Data Flow – Basic Overview Banner Database Data Warehouse Database Oracle Streams Banner Tables Staging ODS EDW ETL ETL

Banner Operational Data Store (Banner ODS) Some Terminology Banner Operational Data Store (Banner ODS) Ellucian’s core data warehouse product Mostly Oracle code (SQL & PL/SQL) development Primary design purpose is the extraction of Banner ERP data, the transformation of that data and the ultimate storage of that transformed data to support short-term, operational reporting needs, including ad-hoc querying Primary feature is a set of reporting views formatted especially for reporting Although data freezes are supported, most data is dynamic

Banner Electronic Data Warehouse (Banner EDW) Some Terminology Banner Electronic Data Warehouse (Banner EDW) Banner ODS add-on Also primarily composed of Oracle code (SQL & PL/SQL) development Primary design purpose is the extraction of Banner ODS data, the transformation of that data and the ultimate storage of that transformed data to support long-term, strategic reporting needs, including online analytical processing (OLAP) Most data is static and captured on significant events, e.g. census date or end of fiscal year

Extract, Transform & Load (ETL) Some Terminology Oracle Streams Built-in feature of the Oracle database Data replication and integration feature Enables the near real-time propagation of data, transactions and events from one database to another Extract, Transform & Load (ETL) Entire process of extracting data from a source system and ultimately loading it into a target system Three steps are not well-defined nor do they need to maintain any specific order of occurrence Includes any Oracle objects or code used to perform the process

Data Flow – Basic Overview Banner Database Data Warehouse Database Oracle Streams Banner Tables Staging ODS EDW ETL ETL

Extract, Transform & Load (ETL) Important Points Oracle Streams Near real-time No transformation Extract, Transform & Load (ETL) On demand or scheduled by ODS Administrator Three types for ODS: complete load, partial reload or refresh Two types for EDW: capture snapshot with and without replace Also known as load mappings or load jobs Partial reloads are required when setup changes are made to the ODS or when large amounts of data need to be loaded

Banner ODS & EDW Concepts

Data Warehouse Database ODS & EDW Extensions Banner Database Data Warehouse Database Oracle Streams EDW Banner Tables Staging ODS ETL ETL AHC Ext. AHC Ext. AHC Ext.

Data Flow – Basic Overview Banner ODS Composite Tables Security and Display Rules Reporting Views

Important Points Reporting Views All reporting views owned by one of two Oracle users, ODSMGR or ODSLOV ODSLOV owns only list-of-value (LOV) views LOV views contain Banner validation table values and some Banner rule values Some reporting views have a slotted version Slotted views present multiple rows of data as a single row by having additional columns called slots

Important Points Display Rules Two types: positional and hierarchical Positional rules used for most slotted reporting views to control selection of data presented in slotted reporting view slots Hierarchical rules used for some address reporting views to control the order in which address types are selected and returned for a entity, similar to Banner address selection rules in Job Submission jobs

Banner ODS & EDW Administrator Support

Support Tasks Security and display rule setup and maintenance Data freeze setup and maintenance Metadata maintenance Run or schedule ETL mappings or jobs Run and evaluate jobs monitoring the “health” of the Banner ODS system Run and evaluate data reconciliation reports to ensure accuracy of the ODS system data Monitor jobs control reports, i.e. logs, for warnings or errors

Troubleshooting Why is my transactional system data different than my Banner ODS system data? Timing of data refresh Differing FGAC or other security settings between transactional system and Banner Inconsistent Banner Job Submission address selection rule and Banner ODS display rule Streams stopped Error in load mapping/job

Additional Information

Reference Materials Banner Operational Data Store Handbook Banner Operational Data Store Release Guide Banner Operational Data Store Installation Guide Banner Operational Data Store Upgrade Guide GTVSDAX Handbook

Comments/Questions?

Thank You! David Gilmore Dgilmores@SIGCorp.com Richard J. Blevins Blevins@SIGCorp.com