Introduction to Business Intelligence DATE. Insight R2 “Pre-canned” reports, based on Liberate, to our business units Back-end database uses MS SQL 2005.

Slides:



Advertisements
Similar presentations
Advanced SQL Schema Customization & Reporting Presented By: John Dyke As day to day business needs become more complex so does the need for specifically.
Advertisements

Chapter 1 Business Driven Technology
Kristina Rumpff, Paul Skaife, John Simon.
Beyond the Help Desk Getting ahead of the game Mihaela Damian Dan Sexton 11 th July 2013 CSCS > School of Clinical Medicine > University of Cambridge.
Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse.
1 Real-time End-to-End Transaction Visibility into Distributed and Mainframe Applications Steve Saville Mainframe Technical Account Manager – Compuware.
Logo van Flair Polteq logo_RGB.png “Fast delivery on a slow train” Marc van 't Veer.
© 2011 IBM Corporation GBS – Business Analytics & Optimisation Experiences from using Blueprint Director in a Data Warehouse project Mattias Jönsson, Enterprise.
Unit 7: Store and Retrieve it Database Management Systems (DBMS)
7-1 INTRODUCTION: SoA Introduced SoA in Chapter 6 Service-oriented architecture (SoA) - perspective that focuses on the development, use, and reuse of.
Advance Analytics Capabilities
Page 1 More information at; gaddsoftware.comgaddsoftware.com.
Workload Management BMO Financial Group Case Study IRMAC, January 2008 Sorina Faur, Database Development Manager.
Managing Change in Production BW at General Mills Mike Ruesewald Cindy Burlet Chris Gunn.
Navision & Axapta Product Update Joyce Leung, Technical Specialist
© Copyright GNet Group 2012 Agile BI using Microsoft SQL Server 2012 Neelesh Raheja VP Consulting Services, GNet
Getting the Most Out of Blue Mountain RAM
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Microsoft Office SharePoint Server Business Intelligence Tom Rizzo Director, Microsoft Office SharePoint Server
Module 3: Business Information Systems Enterprise Systems.
Agenda The Group The Product The Process Information Systems
LOGO Business Intelligence System Mr. Natapong Wongprommoon Solution Architect G-ABLE Company Limited
Presentation to Baltimore-Washington DC Metro MPUG Chapter September 22, 2009.
Information on Demand in Action Darren Silvester – Design Authority 17 th September 2009.
Required Slide Tech Ed North America /21/2017 6:05 AM
第三組 Produce a report on 1.SAP NetWeaver 2.SAP Web Application Server 3. SAP Solution Manager ~ Team member ~ 何承恩 謝岳霖 徐翊翔 陳鼎昇.
Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS.
SharePoint 2010 Business Intelligence Module 2: Business Intelligence.
Database Systems – Data Warehousing
1DMG Confidential. Problem #1  Development and maintenance Huge demand for DMG services plus focus on short-term benefits led to shortcuts in code development.
Planning and Tracking Projects with VSTS 2010 By Ahmed Nasr 1.
Successfully Leveraging Information into a Specific Action Peter McCallum.
Dashboard & Scorecard Case Study. Introduction Hagemeyer Case Study – Background – Situation – Strategic CPM Vision – Solution – Benefits Assimil8 Overview.
Getting synergies from rapid access to data
Appendices: Introduction to Business Intelligence DATE.
1DMG Confidential. Background: Key Problem Areas  Scalability Ingest and export processes not able to handle burst traffic loads Exponential growth in.
Page 1 GADD Software & GADD Analytics 1.5 Public version, January 2015, gaddsoftware.com GADD Analytics.
1 Backend Publishing System Team February 13, 2004.
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie.
Industry SDLCs and Business Climate. Justin Kalicharan Credentials Director and Senior Technology Officer Over 14 years of coding experience in various.
IP Network Clearinghouse Solutions ENUM IP-Enabling The Global Telephone Directory Frank Estes Vice President , ext 224
Introduction to RtReports – Tony Fenn & Chris Nelson Introduction to RtReports Chris Nelson - Senior Developer Tony Fenn - Product Manager.
Introduction – Addressing Business Challenges Microsoft® Business Intelligence Solutions.
Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.
Company Confidential Leverage Your E-Business Suite as Part of Your Sales Performance Management Strategy January 17, 2008.
© 2009 IBM Corporation Maximize Cost Savings While Improving Visibility Into Lines of Business Wendy Tam, CDC Product Marketing Manager
1DMG Confidential. Problem #1  Scalability Ingest and export processes not able to handle burst traffic loads Exponential growth in storage usage and.
Reporting & Analytics Stephen Chan Senior Solution Consultant.
Rajesh Bhat Director, PLM Analytics Applications
Avanade Confidential – Do Not Copy, Forward or Circulate © Copyright 2014 Avanade Inc. All Rights Reserved. For Internal Use Only SharePoint Insights (BETA)
Ellis Paul Technical Solution Specialist – System Center Microsoft UK Operations Manager Overview.
30 Copyright © 2009, Oracle. All rights reserved. Using Oracle Business Intelligence Delivers.
CYSSC - Cluster 2.0 Partner Management Final Deliverable High Sensitivity Sep 2, 2011 Cluster 2.0 Project Team.
Momentum. Strategy & Roadmapping Business Analysis Information Architecture Usability / User Experience Rich Media Social Media (Web 2.0) Interface Design.
Patrick Ortiz Global SQL Solution Architect Dell Inc. BIN209.
Accelerating Business Velocity at Etsy Chris Bohn “CB” Senior Database Engineer 1 Cop©yCrigohpty2ri0g1h4t 2H0e1w4leHtet-wPlaecttk-aPradcDkaervdeDloepvmeelonpt.
Webinar The Perfect Order Dashboard Webinar hosted by FusionOps Speakers: Shariq Mansoor CTO, FusionOps Shariq has over a decade of technology and business.
ESR Business Intelligence Nick Adcock NHS Senior Development Advisor Turning Data Into Intelligence.
Overview of SAP Application Services By Accely. Introduction Developed organizations in any business industry will invest in SAP programs to offer progressive.
Source: Article reprinted from 2014 Cloud Survey Report, Copyright: KPMG LLP © 2015, a Delaware limited liability partnership and the U.S. member.
From RDBMS to Hadoop A case study Mihaly Berekmeri School of Computer Science University of Manchester Data Science Club, 14th July 2016 Hayden Clark,
Enterprise Processes and Systems
How Coremetrics is Priced
LS BI Jóhann Einarsson Solution lead LS BI
THE REALITY OF USING CONTAINERS TO BUILD PRODUCTS
IT and Development support services
Data Warehousing Concepts
Data Governance & Management Skills and Experience
David Gilmore & Richard Blevins Senior Consultants April 17th, 2012
Presentation transcript:

Introduction to Business Intelligence DATE

Insight R2 “Pre-canned” reports, based on Liberate, to our business units Back-end database uses MS SQL 2005 Front-end uses SAP Business Objects 3.1 BI Developments Summary 2Introduction to Business Intelligence | Date 3.1 Insight R3 19 “Universes” allowing business to create their own reports All reports based on Liberate, with additional universes added by LIME Back end uses MS SQL 2008 Front-end uses SAP Business Objects Currently being decommissioned (LIME, Macau/CTM)

Enterprise Data Warehouse / Operational Data store / KPI reporting 3 month store of operational data including Liberate and other data sources Mediation Zone + MS SQL Excel Big Data Migration to Amazon Web Services Set up and migration of EDW / ODS to AWS BI Developments Summary - Continued 3Introduction to Business Intelligence | Date Others Event Data Store (we provide the feeds) Other Legacy: MIDAS, BI Lite, Focus

Roadmap Bahamas data New data feeds into EDW (in progress) Modification of code to allow for KPI production Fixed KPIs Release Fixed KPIs for all BUs (Mobile already exists) AWS Redshift Migration Currently in design; template set up First domain (CDR classification) due to migrate April 2014 with other domains following Transition Planning Support of the Group Commercial reporting analysts – new Business Information Layers in the EDW Knowledge transfer Decommission Insight R2 and Legacy systems LIME switch off (in progress) Migration from JCC Feeds into Liberate Landing server, SQL replication Other developments Mediation Zone feeds from all sources and onwards to EDW / EDS, Campaign Management 4Introduction to the Development Team | date The BI Roadmap 2014

Insight R2 5Introduction to Business Intelligence | Date Canned reports only – scheduled to refresh daily In use at BUs: LIME (decommissioning in progress) Macau The Backend is not being switched off as most BUs do their own reporting, so have taken Insight R2 for the JCC / CIS feed TSTT / Panama / SURE

Insight R3 6Introduction to Business Intelligence | Date Self Service (users can create their own reports) 130+ “canned reports” have been carried over from R2 (scheduled to refresh daily) 19 “Universes” covering: Accounts, Adjustments, Churn, Customer queries, Debt, Faults, Pricing Plans, Product trends, Sales, Service Orders Reports are based on Liberate, with some additional universes added by LIME Accounts Adjustments Churn Customer Queries Debt Faults ….. …. None of these reports contain “usage” information! What ?..When ?.. Who? …. Why?

KPI reporting 7Introduction to Business Intelligence | Date A need was identified to have a single source of information for Group reporting, i.e. not just BU specific CWC built a set of KPI reports to allow for this senior management / exco view of data required

Operational Data Store 8Introduction to Business Intelligence | Date Requirement for “usage” data to be able to calculate revenue and trends The ODS holds 3 months / 125 days of usage data and resulting KPI information Sources are taken from Liberate and other sources (GGSN, Interconnect, Telus (call centre stats)) Current reports – subscriber active base for: Prepaid mobile Fixed lines of Business All LIME business units, except Bahamas postpaid Current users are the BI Commercial reporting team (access ODS and run adhoc SQL queries)

ODS reporting KPI ODS Comverse ONE Core mobile network GGSN InterConnect Liberate 9Introduction to Business Intelligence | Date

ODS Challenges 10Introduction to Business Intelligence | Date Big data issue: MS-SQL server 2012 good for small –> medium enterprise reporting The CDR table currently has 1.9 billion records and is 155GB in size! 1.7 TB – ODS, BIL – 430 GB (compressed) As reporting wants to join more and more data together we need to embrace newer technologies to cope with demand

The problem we are trying to overcome – Housing our Big Data efficiently: Amazon Web Services - Redshift 11Introduction to Business Intelligence | Date

We need to be able to set up and migrate our data simply: Amazon Web Services - Redshift 12Introduction to Business Intelligence | Date

Amazon Web Services - Redshift 13Introduction to Business Intelligence | Date It needs to be scalable:

And resilient Amazon Web Services - Redshift 14Introduction to Business Intelligence | Date As well as cost effective!

Big Data, Redshift, the next 6 months Our Redshift project is truly under way This is being run as an Agile project; we expect to migrate most of the ODS in 12 sprints. Solution Architecture, Designs and Templates have been created We will look to migrate the most complex and long running queries and KPIs first – particularly CDR classification. 15Introduction to Business Intelligence | Date

And it’s a big job! 16Introduction to Business Intelligence | Date

The challenge: Lots of useful usage data is wasted (location data, mobile data usage) Some CDR storage is broken (MIDAS, Comverse DB) LEA and other regulatory requirements are difficult and costly to comply with Analysing how our subscribers use our services is difficult EDS complements ODS/EDW by providing long-term usage storage with query capabilities. What EDS is: Long-term and cost-effective way to store and query detailed data Uses commodity hardware and attached disk for better $/GB performance Managed service to keep solution running within SLAs Service to Marketing to provide on-demand “what-if” queries on subscriber usage Service for LEA and other regulatory requirements Query tool for back-office charging and billing investigations Event Data Store in One Slide 17Introduction to Business Intelligence | Date

18Introduction to Business Intelligence | Date Current State of Play - Major Systems Gap Churn / Upgrades CampaignsOperations Supply Chain Network Capacity Channel Commercial / Finance Disclosure / Regulatory Product Management Sales Assurance Service Usage CRM Cust Insight CEM Customer Usage Event Data ComverseONE migration creates new usage storage requirements Retirement of legacy CDR (MIDAS) repositories creates a system gap Increased business demands to understand usage habits and trends Lack of compliance with regulatory requirements on usage storage and LEA search requests

Operational Service to our Customers 19Introduction to Business Intelligence | Date Ensure un-interrupted service of information delivery on daily, weekly and monthly basis Communicate any delays/impediments in information delivery to our customers (Commercial Analyst Team and Senior Executives) Triage with source teams and our BI development team to resolve any impediments Daily Weekly Monthly

Service back to BI DevOps 20Introduction to Business Intelligence | Date Share any exceptions in performance statistics of processes for recommendations on further performance tuning Provide operational requirements in the development stage of any new systems/developments Estimate the capacity requirements for hosting data from new source systems and run continuous capacity management

Service to Management 21Introduction to Business Intelligence | Date Publish dashboards that show operations performance quantitatively and qualitatively Help highlight the best and worst performers in terms of KPIs (zero values, long running, delayed) and data load jobs from operations perspective

Key Takeaways 22Introduction to Business Intelligence | Date Insight R2 is being decommissioned, but the backend will remain – as BUs want CIS data (JCC feed) Insight R3 is in use in LIME Enterprise Data Warehouse = Operational Data store KPI reporting -> high visibility and commercially sensitive Event Data Store –> not a BI Development project, as run by Tony Melvin and as a managed service by Cartesian Other Legacy (not in our scope): MIDAS, BI Lite, Focus End users – we get requests in from everywhere. Ideally, requirements will align to a qualified business need. Reporting requests do not necessarily come to the development team