Model Selection, Seasonal Adjustment, Analyzing Results

Slides:



Advertisements
Similar presentations
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Advertisements

Seasonal Adjustment of National Index Data at International Level
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
Using Demetra+ in daily work at NBP – SA in the time of crisis Sylwia Grudkowska, Department of Statistics, NBP.
STAT 497 APPLIED TIME SERIES ANALYSIS
Internal documentation and user documentation
REPUBLIC OF TURKEY TURKISH STATISTICAL INSTITUTE TurkStat Direct vs. Indirect Approach in Seasonal Adjustment: Proposal for a new tool Necmettin Alpay.
Moving Averages Ft(1) is average of last m observations
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
(ons) Seasonal Adjustment in Official Statistics Claudia Annoni Office for National Statistics.
Part II – TIME SERIES ANALYSIS C2 Simple Time Series Methods & Moving Averages © Angel A. Juan & Carles Serrat - UPC 2007/2008.
X-12 ARIMA Eurostat, Luxembourg Seasonal Adjustment.
Seasonal Adjustment Methods and Country Practices Based on the: Hungarian Central Statistical Office: Seasonal Adjustment Methods and Practices; UNECE.
Business Forecasting Chapter 4 Data Collection and Analysis in Forecasting.
Components of Time Series, Seasonality and Pre-conditions for Seasonal Adjustment Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Short-Term.
J. Khélif Insee July 2008 A quality report for seasonally and trading day adjusted French IIP.
OECD STESWP Paris 26 June 2007 DRAFT EUROSTAT GUIDELIENS ON SEASONAL ADJUSTMENT Cristina Calizzani - Gian Luigi Mazzi.
13-Jul-07 European Statistical System guidelines on seasonal adjustment: a major step towards PEEIs harmonisation C. Calizzani – G.L. Mazzi – R. Ruggeri.
Eurostat Seasonal Adjustment. Topics Motivation and theoretical background (Øyvind Langsrud) Seasonal adjustment step-by-step (László Sajtos) (A few)
4 May 2010 Towards a common revision for European statistics By Gian Luigi Mazzi and Rosa Ruggeri Cannata Q2010 European Conference on Quality in Official.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
United Nations Economic Commission for Europe Statistical Division Seasonal Adjustment Process with Demetra+ Anu Peltola Economic Statistics Section, UNECE.
1 Calculation of unit value indices at Eurostat Training course on Trade Indices Beirut, December 2009 European Commission, DG Eurostat Unit G3 International.
Overview of Main Quality Diagnostics Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Seasonal Adjustment 20 – 23 February 2012, Ankara,
Ketty Attal-Toubert and Stéphanie Himpens Insee, France 16th of November, 2011 ESTP course Demetra+ Demetra+ for X12 in Daily Work.
1 Departamento de Contas Nacionais / Serviço de Indicadores de Curto Prazo National Accounts Department / Short Term Statistics Unit Using Demetra+
9 th Euroindicators Working Group Luxembourg, 4 th & 5 th December 2006 Eurostat - Unit D1 Key Indicators for European Policies.
Reserve Variability – Session II: Who Is Doing What? Mark R. Shapland, FCAS, ASA, MAAA Casualty Actuarial Society Spring Meeting San Juan, Puerto Rico.
Anu Peltola Economic Statistics Section, UNECE
Ketty Attal-Toubert and Stéphanie Himpens Insee 22nd of June, 2011 An Overview of seasonal adjustment in the short term statistic department.
Testing seasonal adjustment with Demetra+ Dovnar Olga Alexandrovna The National Statistical Committee, Republic of Belarus.
Eurostat – Unit D5 Key indicators for European policies Third International Seminar on Early Warning and Business Cycle Indicators Annotated outline of.
April 2011 Testing Seasonal Adjustment with Demetra+ Ariunbold Shagdar National Statistical Office, Mongolia.
Harmonisation of Seasonal Adjustment Methods in EU and OECD Countries Ronny Nilsson Statistics Directorate.
Round Table Round Table Current State of Seasonal Adjustment in Countries/ UNECE Workshop on Short-Term Statistics (STS) and Seasonal Adjustment 14 – 17.
Towards a seasonal adjustment and a revision policy Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Seasonal Adjustment 20 – 23 February.
IMF Statistics Department The views expressed herein are those of the author and should not necessarily be attributed to the IMF, its Executive Board,
Demand Forecasting Prof. Ravikesh Srivastava Lecture-11.
1 BABS 502 Moving Averages, Decomposition and Exponential Smoothing Revised March 14, 2010.
The Box-Jenkins (ARIMA) Methodology
A Proposal for a revisions policy of Principal European Economic Indicators (PEEIs) OECD STES WP June 2008.
USING DEMETRA+ IN DAILY WORK SAUG – Luxembourg, 16 October 2012 Enrico INFANTE, Eurostat Unit B1: Quality, Methodology and Research.
Testing Seasonal Adjustment of the Price Index for tomatoes with Demetra+ Kumpeisova Dinara Agency of Statistics of the Republic of Kazakhstan, Kazakhstan.
Ketty Attal-Toubert and Stéphanie Himpens Insee 22nd of June, 2011 Using SAS to implement additional tools.
March 2011 UNECE Statistical Division 1 Challenges & Problems of Short- Term Statistics (STS) Based on the UNECE paper on Short-Term Economic Statistics.
Forecasting. Model with indicator variables The choice of a forecasting technique depends on the components identified in the time series. The techniques.
Seasonal Adjustment Methods and Country Practices
Forecasting Methods Dr. T. T. Kachwala.
Carsten Boldsen Hansen Economic Statistics Section, UNECE
Shohreh Mirzaei Yeganeh United Nations Industrial Development
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
4th Joint EU-OECD Workshop on BCS, Brussels, October 12-13
Testing seasonal adjustment with Demetra+
2.1. JDemetra+ Last updates (since 2.0.0)
Techniques for Data Analysis Event Study
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
Difficulties in Seasonal Adjustment
How to select regressors and specifications in Demetra+?
Hungarian practice on chain-linking and its implication for SA
Seasonal adjustment with Demetra+
New Demetra 2.2 Euro-indicators Working Group
STATISTICAL AGENCY UNDER PRESIDENT OF THE REPUBLIC OF TAJIKISTAN
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Time Series Analysis and Seasonal Adjustment
New innovative 3-way ANOVA a-priori test for direct vs
Problematic time series and how to treat them
Ermurachi Galina National Bureau of Statistics, Republic of Moldova
Issues on Seasonal Adjustment in the EECCA countries
BOX JENKINS (ARIMA) METHODOLOGY
Selective Editing Techniques and Seasonal Adjustment of STS
Presentation transcript:

Model Selection, Seasonal Adjustment, Analyzing Results Necmettin Alpay KOÇAK UNECE Workshop on Short-Term Statistics (STS) and Seasonal Adjustment 14 – 17 March 2011 Astana, Kazakhstan 1 27.07.2019

Model Selection Pre-treatment is the most important stage of the seasonal adjustment X-12-ARIMA and TRAMO&SEATS methods use very similar (nearly same) approaches to obtain the linearized (pre-treated) series. Both method use ARIMA model for pre-treatment. The most appropriate ARIMA model → Linearized series of top quality 27.07.2019 2

ARIMA Model selection zt = ytβ+xt Φ(B)δ(B)xt=θ(B)at (p,d,q)(P,D,Q)s → Structure of ARIMA (0,1,1)(0,1,1)4,12 For the model Parsimonious Significance of parameters Smallest BIC or AIC For the residuals Normality Lack of auto-correlation Linearity Randomness 27.07.2019 3

Diagnostics Are there really any seasonal fluctations in the series ? Seasonality test If, yes Diagnostics based on residuals are the core of the analysis. If, no No need to seasonal adjustment.

Diagnostics Seasonality test Residual diagnostics Friedman test Kruskall-wallis test Residual diagnostics Normality Skewness Kurtosis Auto-correlation First and seasonal frequencies (4 or 12) Linearity Auto-correlation in squared residuals Randomness Number of sign (+) should be equal the number of sign (-) in residuals. Final Comment... We select the appropriate model according to the state of the diagnostics.i

Seasonal Adjustment 2.1 Choice of SA approach 2.2 Consistency between raw and SA data 2.3 Geographical aggregation: direct versus indirect approach 2.4 Sectoral aggregation: direct versus indirect approach (Source : ESS Guidelines)

Choice of seasonal adjustment method Most commonly used seasonal adjustment methods Tramo-Seats X12ARIMA Tramo-Seats: model-based approach based on Arima decomposition techniques X-12-ARIMA: non parametric approach based on a set of linear filters (moving averages) Univariate or multivariate structural time series models (Source : ESS Guidelines)

Filtering data : Difference in methods X-12-ARIMA use fixed filters to obtain seasonal component in the series. A 5-term weighted moving average (3x3 ma) is calculated for each month of the seasonal-irregular ratios (SI) to obtain preliminary estimates of the seasonal factors Why is this 5-term moving average called a 3x3 moving average?

Filtering data : Difference in methods TRAMO&SEATS use a varying filter to obtain seasonal component in the series. This variation depends on the estimated ARIMA model of the time series. For example, if series follows an ARIMA model like (0,1,1)(0,1,1), it has specific filter or it follows (1,1,1)(1,1,1), it has also specific filter. Then, estimated parameters affect the filters. Wiener-Kolmogorov filters are used in Tramo&Seats. It fed with auto-covariance generating functions of the series. (more complicated than X-12-ARIMA) But, it is easily interpreted since it has statistical properties.

Consistency between raw and SA data We do not expect that the annual totals of raw and SA data are not equal. Since calendar effect exists (working days in a year) It is possible to force the sum (or average) of seasonally adjusted data over each year to equal the sum (or average) of the raw data, but from a theoretical point of view, there is no justification for this. Do not impose the equality over the year to the raw and the seasonally adjusted or the calendar adjusted data (ESS Guidelines)

Direct and indirect adjustment Direct seasonal adjustment is performed if all time series, including aggregates, are seasonally adjusted on an individual basis. Indirect seasonal adjustment is performed if the seasonally adjusted estimate for a time series is derived by combining the estimates for two or more directly adjusted series. The direct and indirect issue is relevant in different cases, e.g. within a system of time series estimates at a sector level, or aggregation of similar time series estimates from different geographical entities. Mining and Quarrying EU-27 Aggregate Industrial Production Index Manufacturing Germany France Electricity, Water, Natural Gas and etc. Spain ... Romania

Analyzing result Use a detailed set of graphical, descriptive, non-parametric and parametric criteria to validate the seasonal adjustment. Particular attention must be paid to the following suitable characteristics of seasonal adjustment series: existence of seasonality absence of residual seasonality absence of residual calendar effects absence of an over-adjustment of seasonal and calendar effects absence of significant and positive autocorrelation for seasonal lags in the irregular component stability of the seasonal component In addition, the appropriateness of the identified model used in the complete adjustment procedure should be checked using standard diagnostics and some additional considerations. An important consideration is that the number of outliers should be relatively small, and not unduly concentrated around the same period of the year.

Analyzing results Seasonally Adjusted Series

Revisions to seasonal adjustment Forward factors / current adjustment: annual analysis to determine seasonal and trading day factors Preferable for time series with constant seasonal factor or large irregular factor causing revision Concurrent adjustment: uses the data available at each reference period to re-estimate seasonal and trading day factors

Revisions to seasonal adjustment Forecast seasonal factors for the next year (current adjustment) Forecast seasonal factors for the next year, but update the forecast with new observations while the model and parameters stay the same Forecast seasonal factors for the next year, but re-estimate parameters of the model with new observations while the model stays the same (partial concurrent adjustment) Compute the optimal forecast at every period and revise the model and parameters (concurrent adjustment) Sources: Eurostat working paper on Seasonal Adjustment Policy, ESS Guidelines on Seasonal Adjustment

Evaluation of revision alternatives The use of fixed seasonal factors can lead to biased results when unexpected events occur Re-estimation in every calculation increases accuracy but also revision Re-estimation once a year decreases accuracy but also revision Re-identification usually once a year However, time series revise in every release