# CHOW TEST AND DUMMY VARIABLE GROUP TEST

## Presentation on theme: "CHOW TEST AND DUMMY VARIABLE GROUP TEST"— Presentation transcript:

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST N In the dummy variable sequences and in the Chow test sequence we investigated whether the cost functions for occupational and regular schools are different. 1

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST N In each case we performed tests that showed that the functions are significantly different. Could the two approaches have led to different conclusions? 2

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST N The answer is no. The Chow test is equivalent to an F test testing the explanatory power of the dummy variables as a group. 3

CHOW TEST AND DUMMY VARIABLE GROUP TEST
. reg COST N Source | SS df MS Number of obs = F( 1, 72) = Model | e e Prob > F = Residual | e e R-squared = Adj R-squared = Total | e e Root MSE = 1.1e+05 COST | Coef. Std. Err t P>|t| [95% Conf. Interval] N | _cons | With both approaches the starting point is a simple regression of annual recurrent expenditure on the number of students enrolled, using the entire sample. We make a note of RSS. 4

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST N The regression line is shown graphically. 5

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST occupational school regular school N We now make a distinction between occupational schools and regular schools. 6

CHOW TEST AND DUMMY VARIABLE GROUP TEST
. reg COST N OCC NOCC Source | SS df MS Number of obs = F( 3, 70) = Model | e e Prob > F = Residual | e e R-squared = Adj R-squared = Total | e e Root MSE = COST | Coef. Std. Err t P>|t| [95% Conf. Interval] N | OCC | NOCC | _cons | With the dummy variable approach, we take one type of school as the reference category. We will choose regular schools for this category, but it makes no difference to the test. 7

CHOW TEST AND DUMMY VARIABLE GROUP TEST
. reg COST N OCC NOCC Source | SS df MS Number of obs = F( 3, 70) = Model | e e Prob > F = Residual | e e R-squared = Adj R-squared = Total | e e Root MSE = COST | Coef. Std. Err t P>|t| [95% Conf. Interval] N | OCC | NOCC | _cons | We add an intercept dummy and a slope dummy to allow the overhead and marginal costs of the occupational schools to be different. Again we make a note of RSS, which is smaller than before. 8

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST occupational school regular school N Here are the regression lines for the two subsamples. 9

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Whole sample COST = 24, N RSS = 8.91x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ To see if the cost functions are significantly different, we investigate whether there is a significant reduction in RSS when the dummy variables are added. 10

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Whole sample COST = 24, N RSS = 8.91x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ We perform the F test described in the sequence on slope dummy variables. The numerator of the test statistic is the reduction in RSS on adding the dummy variables, divided by the cost in terms of degrees of freedom. 11

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Whole sample COST = 24, N RSS = 8.91x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ The denominator is the RSS remaining after adding the dummy variables, divided by the number of degrees of freedom remaining. 12

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Whole sample COST = 24, N RSS = 8.91x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ The critical value of F at the 0.1% level with 2 and 70 degrees of freedom is Hence we conclude that the dummy variables do have significant explanatory power and the cost functions are different. 13

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST N With the Chow test approach we also start by running a regression using the whole sample, and make a note of the RSS. 14

CHOW TEST AND DUMMY VARIABLE GROUP TEST
. reg COST N if OCC==0 Source | SS df MS Number of obs = F( 1, 38) = Model | e e Prob > F = Residual | e e R-squared = Adj R-squared = Total | e e Root MSE = COST | Coef. Std. Err t P>|t| [95% Conf. Interval] N | _cons | We then split the sample into occupational and regular schools, and run separate regressions, again making a note of RSS. This is the regression output when COST is regressed on N for the subsample of 40 regular schools. 15

CHOW TEST AND DUMMY VARIABLE GROUP TEST
. reg COST N if OCC==1 Source | SS df MS Number of obs = F( 1, 32) = Model | e e Prob > F = Residual | e e R-squared = Adj R-squared = Total | e e Root MSE = 1.0e+05 COST | Coef. Std. Err t P>|t| [95% Conf. Interval] N | _cons | And this is the regression output when COST is regressed on N using the subsample of 34 occupational schools. 16

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST occupational school regular school N The graph shows the regression lines. 17

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ The regression equations are as shown. 18

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ The cost functions are identical to those implicit in the dummy variable regression with both intercept and slope dummies. This is because the dummy variable regression has a dummy variable for each component of the original model (here, the constant and N). 19

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ Implicit cost function for regular schools COST = 51, N ^ The intercept and the coefficient of N in the dummy variable regression are chosen so as to minimize the residual sum of squares for the reference category, the regular schools. Hence they must be the same as for the regression with regular schools only. 20

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ Implicit cost function for regular schools COST = 51, N ^ Implicit cost function for occupational schools COST = 47, N ^ The intercept and slope dummies then allow the intercept and slope coefficient to be modified so as to give the best possible fit for the occupational schools. Hence the implicit cost function must be the same as for the regression with occupational schools only. 21

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST occupational school regular school N The cost function for regular schools implicit in the dummy variable regression must coincide with the regression line for the regular schools only. 22

CHOW TEST AND DUMMY VARIABLE GROUP TEST
COST occupational school regular school N Similarly, the cost function for occupational schools implicit in the dummy variable regression must coincide with the regression line for the occupational schools only. 23

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ Implicit cost function for regular schools COST = 51, N ^ Implicit cost function for occupational schools COST = 47, N ^ Since the cost functions implicit in the dummy variable regression coincide with those in the separate regressions, the residuals will be the same. It follows that RSS for the dummy variable regression must be equal the sum of RSS for the separate regressions. 24

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ Hence the F statistics for the F tests will be the same. The starting point for both approaches is the residual sum of squares for the basic regression making no distinction between types of school. 25

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ In the Chow test approach, RSS is reduced by splitting the sample. In the dummy variable approach, RSS is reduced by adding the intercept and slope dummies. RSS after making the change will be the same because the residuals will be the same. 26

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ This also means that the first part of the denominator of the F statistic will be the same. 27

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ ` The cost of the improvement in the fit is the same, since either way two extra parameters have to be estimated. 28

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ ` And either way, the number of degrees of freedom remaining will be 70, since the number of observations is 74 and 4 parameters have to be estimated. 29

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ Thus all the components of the F statistics are the same, and the outcome of the test must be the same. In this case, the null hypothesis of identical cost functions for the two types of school was rejected at the 0.1% level. 30

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ What are the advantages and disadvantages of the two approaches? 31

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ The Chow test is quick. You just run the three regressions and compute the test statistic. But it does not tell you how the functions differ, if they do. 32

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ The dummy variable approach involves more preparation because you have to define a dummy variable for the intercept and for each slope coefficient. 33

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Regular schools, subsample regression COST = 51, N RSS = 1.22x1011 ^ Occupational schools, subsample regression COST = 47, N RSS = 3.49x1011 ^ Whole sample, with dummy variables COST = 51,000 – 4,000OCC + 152N + 284NOCC RSS = 4.71x1011 ^ However, it is more informative because you can perform t tests on the individual dummy coefficients and find out where the functions differ, if they do. 34

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u A final note. The Chow test and the dummy variable group test are equivalent only if there is a full set of dummy variables. 35

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u By this is meant an intercept dummy (here D) and a slope dummy variable for every X (here DX2, DX3, … DXK). 36

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u If there is a full set of dummy variables, OLS will choose the intercept b1 and the b coefficients of X2 … XK so as to optimise the fit for the D = 0 observations. The coefficients will be exactly the same as if the regression has been run with only the subsample of D = 0 observations. 37

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u The coefficient of the intercept dummy D and the slope dummy variables will then be chosen so as to optimise the fit for the D = 1 observations. (b1+d), (b2+l2), …, (bK+lK) will be the same as the coefficients in a regression using only the subsample of D = 1 observations. 38

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u Thus with a full set of intercept and slope dummy variables, the improvement in fit on adding the dummy variables to the basic equation is the same as that obtained by splitting the sample and running separate subsample regressions. 39

CHOW TEST AND DUMMY VARIABLE GROUP TEST
Basic model Y = b1 + b2X2 + b3X3+ … + bKXK + u Model with dummy variables Y = b1 + b2X2 + b3X3+ … + bKXK + dD + l2DX2 + l3DX3 + … + lKDXK + u D = 0 Y = b1 + b2X2 + b3X3+ … + bKXK + u D = 1 Y = (b1+d) + (b2+l2)X2 + (b3+l3)X3 + … + (bK+lK)XK + u It follows that the F statistic for the test of the joint explanatory power of the intercept and slope dummy variables is equivalent to the F statistic for the Chow test. 40