2. Seasonal Unit Root Tests in Long Periodicity Cases D. A. Dickey Ying Zhang

3. Natural gas-a colorless, odorless, gaseous hydrocarbon-may be stored in a number of different ways. It is most commonly held in inventory underground under pressure in three types of facilities. These are: (1) depleted reservoirs in oil and/or gas fields, (2) aquifers, and (3) salt cavern formations. (Natural gas is also stored in liquid form in above-ground tanks).

5. 1. Regression with Time Series Errors Y(t) = a + bt + seasonal effects + Z(t), Z(t) a stationary time series Seasonal effects: Sinusoids, Seasonal dummy variables 2. Dynamic Seasonal Models Y(t) = Y(t-d) + e(t) copy of last season Y(t) = Y(t-d) + e(t) –  e(t-d) EWMA of past seasons Y(t) = Y(t-1) + [Y(t-d)-Y(t-d-1)] + Z(t) Z(t) = e(t) PROC CUT&PASTE; Z(t) = e(t) –  e(t-1) –  e(t-d) +  e(t-d-1) “airline” Z(t) = (1-  B)(1-  B d ) e(t)

6. Y(t) = Y(t-1) + [Y(t-d)-Y(t-d-1)] + e(t)

7. Y(t) = 10 + t + 8X 3 – 8X 5 -5X 8 – 5X 9 – 5X 10 +e(t)

8. Summary: 1.Both models can give same predictions for pure trend + seasonal functions. 2.For data, lag model looks back 1 year and ignores (or discounts) others. Good for slowly changing seasonality. 3.For data, dummy variable model weights all years equally. Good for very regular seasonality. 4. Differences in forecast errors too!

9. Weekly natural gas data – unit root forecast

10. Weekly natural gas data – seasonal dummy variable forecast

11. A general seasonal model: Y t –f(t) =  Y t-d –f(t-d)) + e t f(t) = deterministic components H 0 :  Under H 0, period d functions annihilated. f periodic  Y t –Y t-d = (  Y t-d –f(t-d)) + e t  =1  Y t –Y t-d = e t

12. Y 1 =e 1 (Y 1,1 ) Y 2 =e 2 (Y 1,2 ) Y 3 =e 3 (Y 1,3 ) Y 4 =e 4 (Y 1,4 ) Y 5 =e 5 +  e 1 (Y 2,1 ) Y 6 =e 6 +  e 2 (Y 2,2 ) Y 7 =e 7 +  e 3 (Y 2,3 ) Y 8 =e 8 +  e 4 (Y 2,4 ) Use double subscripts: Quarterly (d=4) example, m years, f(t)=0

13. Numerator is Denominator is Known unit root facts (  2 =1): (1) Moments (d=1 case or individual terms) E{N s } = 0, E{D s } = (m-1)/(2m)  1/2 Var{N s } = (m-1)/(2m)  1/2 Var{D s } = (m-1)(m 2 -m+1)/(3m 3 )  1/3 Cov{N s, D s } = (m-1)(m-2)/(3m 2 )  1/3 (2) Studentized statistic asymptotically equivalent to (numerator sum) / (denominator sum) 1/2

14. Basic idea is simple: Large d  numerator approximately normal Large d  denominator converges to E{denominator}

15. Nice proof Grandpa! As you see, I’m very excited.

19. d=4  and N(0,1) -1.645 0 1.645 CDFs (SAS)

20. -2.386 0 2.386 d=4 md 1/2 (  -1) and N(0,2) CDFs

21. Improving the Normal Approximation: JASA paper (Dickey, Hasza, Fuller, 1984 ) gives limit distribution for studentized statistic (d=12) 5 th %ile = -1.80 95 th %ile = 1.52 50 th %ile: -0.14 (Note: (1.52-1.80)/2 = -0.14 !!) Difference: 1.52+1.80 = 3.32, 2(1.645) = 3.29 (close !!) Suggestion: shift by median CLT  limit distribution median is 0.

22. Median as function of seasonality d: 1. Get medians for d=2, 4,12 from DHF 2. Plot median vs. d -1/2 (d=2,4,12,limit)

23. Median as function of seasonality d: Regress median on d -1/2 Slope very close to ½, Intercept very close to 0. Median Shifts and Tau Percentiles. d med -1/(2 ) p01 p025 p05 p10 2 -0.35 -0.35355 -2.67990 -2.31352 -1.99841 -1.63510 4 -0.24 -0.25000 -2.57635 -2.20996 -1.89485 -1.53155 12 -0.14 -0.14434 -2.47069 -2.10430 -1.78919 -1.42589 inf 0.00 0 -2.32685 -1.96046 -1.64535 -1.28205

25. Simulation Evidence m= 100, various d values 2 sets of 40,000 t statistics at each (m,d) e.g. d=365 and m=100, (daily data 100 years) – 36500x40000 = 1.46 billion generated data points. – SAS: only 10 minutes run time ! – Overlay percentiles (adjusted t) on N(0,1) – Duplicates almost exactly the same.

27. Simulation Evidence - Detrending m= 20, d =4, 6, 12, 24, 52, 96, 168, 365 96 quarter hours/day, 168 hours/week Detrending: – None – Constant, linear, quadratic – Period d sinusoids (fundamental & harmonic) Sets of 20,000 t statistics at each (m,d).

28. 20 years of weekly data, 20,000 simulated series TAU

34. Standard tau percentiles for various adjustments Three replicates (of 20,000) per d value Conclusions: Spread between percentiles about constant (and close to N(0,1) spread) Medians smooth function of 1/sqrt(d) Degree of detrending matters Cubic smoothing regression plotted with raw %iles.

41. Claim: As d  infinity, Tau  N(0,1) for all of these forms of detrending Seasonal random walk Z, data Y. Y = X  + Z Detrend by OLS: Seasonal Random Walk has d “channels” of m values Denominator is sum of d quadratic forms Without detrending each has eigenvalues can be written as

42. k = rank of X matrix Middle matrix is diagonal. Projection => k diagonal entries 1 rest 0 Denominator quadratic form contains k times maximum eigenvalue = O(km 2 ) Upper probability bound on unnormalized quadratic form. Normalization is m 2 d so k/d  0 suffices for no limit effect of detrending. Same for numerator, estimator, tau statistic.

43. Based on Taylor series (for large m) adjustment is for regression adjustments with k columns selected from intercept and Fourier sines and cosines.

44. Your talk seems better now Grandpa!

45. Focus on Medians:

47. Allowing for augmenting terms, as in seasonal multiplicative model, follows the same proof as in DHF. Natural gas data: Procedure (1) Compute residuals (trend + harmonics) (2) AR(2) fit to span 52 differences of residuals (3) Filter with AR(2) F t = filtered series W t = span 52 differences F t – F t-52 (4) Regress W t on F t-52 W t-1 W t-2

48. The REG Procedure Dependent Variable: Diff Sum of Mean Source DF Squares Square F Value Pr > F Model 3 718362 239454 231.53 <.0001 Error 679 702233 1034.21632 Corrected Total 682 1420595 Parameter Estimates Parameter Standard Variable DF Estimate Error t Value Pr > |t| Intercept 1 -0.68125 1.23111 -0.55 0.5802 L52FY 1 -0.99746 0.03800 -26.25 <.0001 Diff1 1 0.01417 0.00777 1.82 0.0686 Diff2 1 -0.01152 0.00730 -1.58 0.1151

49. Follow up: Lag 52 coefficient near -1 suggests  52 -1 near -1 Perhaps no lag correlation in the presence of sinusoids Fit ARIMAX model as a check (AR(2), no seasonal lag): Standard Approx Parameter Estimate Error t Value Pr > |t| Lag Variable MU 727.58194 684.44164 1.06 0.2878 0 total AR1,1 1.37442 0.03379 40.67 <.0001 1 total AR1,2 -0.38964 0.03381 -11.53 <.0001 2 total NUM1 0.09520 0.04525 2.10 0.0354 0 date NUM2 -883.25146 23.18237 -38.10 <.0001 0 s1 NUM3 240.92573 23.05715 10.45 <.0001 0 c1 NUM4 -133.27021 11.51098 -11.58 <.0001 0 s2 NUM5 122.42419 11.53277 10.62 <.0001 0 c2

50. Lack of fit? Box-Ljung test on residuals Autocorrelation Check of Residuals To Chi- Pr > Lag Square DF ChiSq -------------Autocorrelations------------ 6 1.40 4 0.8449 0.008 -0.012 0.001 -0.000 -0.023 0.033 12 18.66 10 0.0448 -0.086 0.034 0.089 -0.009 0.017 0.077 18 23.67 16 0.0970 0.022 0.002 0.025 0.012 0.047 0.055 24 26.61 22 0.2263 -0.014 -0.037 0.022 -0.027 -0.028 -0.017 30 29.61 28 0.3821 0.010 0.036 0.042 -0.012 -0.021 0.012 36 33.03 34 0.5150 0.001 0.030 -0.027 -0.031 0.042 -0.010 42 46.84 40 0.2122 -0.026 -0.081 -0.035 -0.034 0.078 -0.042 48 51.65 46 0.2625 0.011 0.042 -0.044 -0.027 0.036 0.014 54 65.50 52 0.0989 -0.055 0.037 -0.024 -0.008 0.085 -0.070 60 75.05 58 0.0654 -0.096 0.023 -0.027 -0.002 -0.029 0.022 66 80.14 64 0.0838 -0.006 -0.035 -0.053 -0.030 -0.035 -0.009 72 85.28 70 0.1033 -0.060 -0.017 0.034 0.032 -0.007 0.011 78 87.52 76 0.1724 -0.034 -0.012 -0.026 -0.004 -0.027 -0.001 84 91.06 82 0.2312 0.018 -0.029 -0.011 -0.050 0.010 0.017 90 96.17 88 0.2586 0.000 -0.030 -0.048 0.049 0.006 -0.018 96 107.69 94 0.1582 -0.011 -0.053 0.006 -0.020 -0.066 -0.075 102 117.16 100 0.1158 0.082 -0.059 -0.013 0.018 0.016 -0.003 108 137.48 106 0.0215 -0.021 -0.058 0.044 0.021 -0.067 -0.112 Lag 104, 52

51. AR(2) characteristic polynomial m 2 - 1.37442 m + 0.38964 (m=1/B)

52. QUESTIONS? D. A. Dickey  D.A.D.

53. QUESTIONS? D. A. Dickey  D.A.D. OK, we’re outa here!

54. Following up – No adjustment add 1.0 /(2d 1/2 ) = (1/2 + 0(2/3) )/d 1/2 Polynomial add 2.3/(2d 1/2 ) ≈ (1/2 + 1(2/3) )/d 1/2 Sine (fund.) add 5.0 /(2d 1/2 ) ≈ (1/2 + 3(2/3) )/d 1/2 + harmonic add 7.6 /(2d 1/2 ) ≈ (1/2 + 5(2/3) )/d 1/2 Sine + linear about the same as sine Generated 3 sets of pctles (20,000 reps) for both models Sorted on d and 5 th percentile Result: percentiles interspersed (see below) Moral: Use same adjustments for sine, sine + linear.

55. -----------------20,000 reps per line------------ d=52 ----------------------- trend t_1 t_2_5 t_5 t_10 t_25 t_50 t_75 t_90 t_95 t_97_5 t_99 n harmonic -2.95 -2.58 -2.24 -1.86 -1.23 -0.53 0.16 0.78 1.14 1.48 1.85 1040 Harmonic -2.93 -2.54 -2.23 -1.84 -1.22 -0.54 0.15 0.78 1.15 1.46 1.86 1040 harmonic -2.94 -2.55 -2.21 -1.85 -1.21 -0.52 0.17 0.77 1.16 1.50 1.88 1040 sine wave -2.75 -2.36 -2.03 -1.66 -1.04 -0.35 0.34 0.95 1.34 1.65 2.03 1040 sine wave -2.73 -2.34 -2.03 -1.65 -1.03 -0.34 0.34 0.96 1.34 1.67 2.05 1040 lin&sine -2.73 -2.35 -2.03 -1.66 -1.03 -0.34 0.34 0.97 1.34 1.66 2.01 1040 sine wave -2.69 -2.35 -2.01 -1.64 -1.03 -0.34 0.34 0.95 1.31 1.65 2.03 1040lin&sine -2.71 -2.33 -1.98 -1.62 -1.01 -0.33 0.35 0.98 1.35 1.65 2.04 1040 mean -2.49 -2.15 -1.83 -1.47 -0.84 -0.17 0.52 1.13 1.48 1.80 2.16 1040 mean -2.52 -2.16 -1.83 -1.46 -0.84 -0.16 0.53 1.16 1.52 1.84 2.21 1040 linear -2.51 -2.13 -1.82 -1.45 -0.81 -0.15 0.54 1.16 1.51 1.82 2.18 1040 quadratic -2.49 -2.13 -1.82 -1.45 -0.84 -0.15 0.52 1.12 1.48 1.80 2.22 1040 linear -2.53 -2.14 -1.81 -1.45 -0.83 -0.15 0.54 1.15 1.53 1.87 2.22 1040 quadratic -2.53 -2.12 -1.80 -1.42 -0.82 -0.14 0.53 1.13 1.49 1.83 2.19 1040 mean -2.44 -2.09 -1.79 -1.44 -0.83 -0.16 0.52 1.13 1.50 1.84 2.25 1040 quadratic -2.50 -2.10 -1.78 -1.43 -0.84 -0.15 0.52 1.14 1.51 1.83 2.18 1040 linear -2.52 -2.10 -1.78 -1.42 -0.83 -0.15 0.53 1.16 1.52 1.85 2.22 1040 none -2.38 -2.05 -1.73 -1.36 -0.75 -0.07 0.62 1.23 1.60 1.90 2.25 1040 none -2.46 -2.07 -1.73 -1.36 -0.75 -0.07 0.61 1.22 1.61 1.93 2.31 1040 none -2.43 -2.04 -1.73 -1.37 -0.75 -0.07 0.62 1.23 1.59 1.90 2.27 1040