Prediction from Quasi-Random Time Series Lorenza Saitta Dipartimento di Informatica Università del Piemonte Orientale Alessandria, Italy.

Slides:



Advertisements
Similar presentations
Time series modelling and statistical trends
Advertisements

Marian Scott SAGES, March 2009
DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 1 review: Quizzes 1-6.
Decomposition Method.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Lesson 12.
Time Series and Forecasting
Time Series Building 1. Model Identification
Building Up a Real Sector Confidence Index for Turkey Ece Oral Dilara Ece Türknur Hamsici CBRT.
Moving Averages Ft(1) is average of last m observations
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 5 Time Series Analysis
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
Chapter 13 Forecasting.
Forecasting & Time Series Minggu 6. Learning Objectives Understand the three categories of forecasting techniques available. Become aware of the four.
Quantitative Business Forecasting Introduction to Business Statistics, 5e Kvanli/Guynes/Pavur (c)2000 South-Western College Publishing.
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Part II – TIME SERIES ANALYSIS C2 Simple Time Series Methods & Moving Averages © Angel A. Juan & Carles Serrat - UPC 2007/2008.
Chapter 16 Time-Series Analysis and Forecasting
Chapter 19 Time-Series Analysis and Forecasting
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by descriptive statistic.
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Time Series and Forecasting Chapter 16.
Time Series and Forecasting
Slides 13b: Time-Series Models; Measuring Forecast Error
CHAPTER 18 Models for Time Series and Forecasting
Business Forecasting Chapter 4 Data Collection and Analysis in Forecasting.
1 1 Slide © 2009 South-Western, a part of Cengage Learning Chapter 6 Forecasting n Quantitative Approaches to Forecasting n Components of a Time Series.
Slides by John Loucks St. Edward’s University.
© 2002 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers using Microsoft Excel 3 rd Edition Chapter 13 Time Series Analysis.
Doc.Ing. Zlata Sojková, CSc.1 Time series (TS). doc.Ing. Zlata Sojková, CSc.2.
The Forecast Process Dr. Mohammed Alahmed
Non-continuous Relationships If the relationship between the dependent variable and an independent variable is non-continuous a slope dummy variable can.
TIME SERIES by H.V.S. DE SILVA DEPARTMENT OF MATHEMATICS
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
Business Forecasting Used to try to predict the future Uses two main methods: Qualitative – seeking opinions on which to base decision making – Consumer.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Chapter 17 Time Series Analysis and Forecasting ©.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Time Series Forecasting Chapter 16.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Time Series Forecasting Chapter 13.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 27 Time Series.
Definition of Time Series: An ordered sequence of values of a variable at equally spaced time intervals. The variable shall be time dependent.
It’s About Time Mark Otto U. S. Fish and Wildlife Service.
Lecture 8 Simple Linear Regression (cont.). Section Objectives: Statistical model for linear regression Data for simple linear regression Estimation.
Time series Decomposition Farideh Dehkordi-Vakil.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Time Series Forecasting and Index Numbers Statistics.
Time-Series Forecasting Overview Moving Averages Exponential Smoothing Seasonality.
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 5: Exponential Smoothing (Ch. 8) Material.
Lesson 4 -Part A Forecasting Quantitative Approaches to Forecasting Components of a Time Series Measures of Forecast Accuracy Smoothing Methods Trend Projection.
© 1999 Prentice-Hall, Inc. Chap Chapter Topics Component Factors of the Time-Series Model Smoothing of Data Series  Moving Averages  Exponential.
Copyright © 2011 Pearson Education, Inc. Time Series Chapter 27.
Economics 173 Business Statistics Lecture 26 © Fall 2001, Professor J. Petry
COMPLETE BUSINESS STATISTICS
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 16-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Time Series and Forecasting
Time-Series Forecast Models  A time series is a sequence of evenly time-spaced data points, such as daily shipments, weekly sales, or quarterly earnings.
1 1 Chapter 6 Forecasting n Quantitative Approaches to Forecasting n The Components of a Time Series n Measures of Forecast Accuracy n Using Smoothing.
Forecasting is the art and science of predicting future events.
Components of Time Series Su, Chapter 2, section II.
Time Series and Forecasting Chapter 16 McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Time Series and Forecasting Chapter 16.
Statistics for Business and Economics Module 2: Regression and time series analysis Spring 2010 Lecture 7: Time Series Analysis and Forecasting 1 Priyantha.
1 Doing Statistics for Business Doing Statistics for Business Data, Inference, and Decision Making Marilyn K. Pelosi Theresa M. Sandifer Chapter 13 Time.
Chapter 11 – With Woodruff Modications Demand Management and Forecasting Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
1 Autocorrelation in Time Series data KNN Ch. 12 (pp )
Time Series Forecasting Trends and Seasons and Time Series Models PBS Chapters 13.1 and 13.2 © 2009 W.H. Freeman and Company.
TIME SERIES MODELS. Definitions Forecast is a prediction of future events used for planning process. Time Series is the repeated observations of demand.
Yandell – Econ 216 Chap 16-1 Chapter 16 Time-Series Forecasting.
Linear Regression.
What is Correlation Analysis?
Exponential Smoothing
Presentation transcript:

Prediction from Quasi-Random Time Series Lorenza Saitta Dipartimento di Informatica Università del Piemonte Orientale Alessandria, Italy

The Problem Data –ORACLE DataBase structure: Each order may contain more than one product, or the same product with different quantities and prices –Time series representing the daily sells of 16,265 products, grouped into 1,004 categories Goal –From years 1999, 2000, > Predict year 2002

Pre-Processing Impossible to handle each product or each category separately --> Necessity to group/select products/categories Impossible to handle groups of products/categories for each client --> Necessity to group clients

Product Selection For each year : –Order products according to decreasing revenue sharing –Order products according to decreasing sold quantity –Select select products that globally cover 80% of revenue (sold quantity)

Grouping Products by Revenue Sharing Selection of those products that globally cover 80 % of revenue -> 53 Products { , , } { , , } { , , } { , , } { Value, Code, Cumulative function} { , , } { , , } { , , } ………… { , , } { , , }

Annual Data Grouping by “days” or “weeks” produces apparently random time series Grouping starts being meaningful at the “month” level Necessity of correct alignment among years

Yearly Comparison

Sequence over 31 Months

Overview of Analysis Single Products –General statistical characteristics –Yearly analysis (monthly, trimester data) –Three-year sequences –Time series analysis (trend, periodicity, oscillations, noise) Additive Model Y t = T t + C t + S t + R t Multiplicative Model Y t = T t * C t * S t * R t –Model of the selling process Products hierarchies

General Observation There is no substantial difference in behavior between the single and aggregated product analysis

Statistical Analysis Autocorrelation Coefficient (ACF) 95% Significativity Plot (No significant correlations) Partial Autocorrelation up to 6 points (PACF) 95% Significativity Plot (No significant correlations) Smoothing ( Simple moving average, Spencer's and Henderson's weighted moving averages, EWMA, 3RSS) (Series are too short)

Statistical Analysis Periodgram (Fourier Analysis ) (No clear seasonality) Randomness Test (Runs above and below median, Runs up and down, Box-Pierce test) (All serie pass every test)

Series Decomposition Trend, Seasonality, Cyclicity, Noise –Additive Model Y t = T t + C t + S t + R t –Multiplicative Model Y t = T t * C t * S t * R t Decomposition –Smooth the data using a moving average of length equal to the length of seasonality. This estimates the trend-cycle. –Divide the data by the moving average (if using the multiplicative method) or subtract the moving average from the data (if using the additive method). This estimates the seasonality. –Average the results for each season separately and rescale so that an average month equals 100 (multiplicative) or 0 (additive). This gives the seasonal indices. –Adjust the data for the estimated trend-cycle and seasonality, yielding the irregular or residual component. –Divide the original data values by the appropriate seasonal index if using the multiplicative method, or subtract the index if using the additive method. This gives the seasonally adjusted data.

Trimester Analysis By aggregating data by trimesters, a more stable behavior emerges Eight typical patterns

Trimester Analysis All relevant variables values are compared on the trimester level, year by year A unique sequence is formed for better approximability

Cumulative Analysis by Year

Global Time Series

Comparison on Cumulative Graphs

Comparison on Differential Graphs True Automatic prediction Manual prediction

Model of the Selling Process QtQt VtVt ptpt xtxt t Q = Target quantity to buy Q t = Bought quantity up to t V t = Expenditure up to t  t = Missing quantity p t = Offered price at t x t = Quantity to buy at t Parameters  t = Q - Q t

Prediction from Model Regression on Cumulative function

Comparison on Differential Graphs True Automatic prediction Manual prediction Model prediction with running adjustment

Conclusions Prediction below the monthly scale is impossible Prediction at the trimester scale is possible Real time adjustments can be made if a two months delay is acceptable Results can be used as a Min-Max strategy in Game Theory