1. Inference in the Simple Regression Model
Hill et al Chapter 5.

2. Interval Estimation
Provide an estimate of the range in which an unknown parameter is likely to lie.

3. Standardising the sampling distribution of the least squares estimator
Using the estimate of the variance:
Explain the notion of a sampling distribution

4. Critical values from the t distribution

5. Interpretation Note that b2 and se(b2) are both random.
The interval estimate is therefore also random.
It is an estimate.
There is no guarantee that it will contain the true value of the parameter of interest.
If we construct 95% intervals from repeated samples, 95% of them will contain the true parameter value.

6. Example
b2 = .1283
Critical value for the t dist is alpha=0.05 and 38 d.f.

7. Hypothesis testing
What is the probability that the sample estimate would be obtained given an assumption about the true value of the parameter.
Null Hypothesis (H0), a belief which we maintain until we have sufficient evidence to convince us otherwise, 2 = c.
Alternative Hypothesis (H1)
2  c
2 >c
2 < c

8. The test statistic Random variable
Has a known distribution if the null is true.
Has a different distribution if the alternative is true.
Consider:
H0: 2 = c
H1: 2  c

9. The rejection region
Rejection rule for a two-tailed test: If the value of the test statistic falls in the rejection region, either tail of the t-distribution, then we reject the null hypothesis and accept the alternative.
If the value of the test statistic falls between the critical values tc and tc, in the non-rejection region, then we do not reject the null hypothesis.

10. Example =.05. H0: 2 = .10. Degrees of freedom: (T2) = 38
Critical value tc is 2.024
H0: 2 = .10.
H1: 2  .10.
Two tailed test is t(0.025)
Since t=.93 < tc=2.024 we do not reject the null hypothesis

11. Errors Type I Type II Reject a null when it is true.
The level of significance is the probability of a type I error.
Type II
A false null is not rejected.
Increased chance of type II error with:
reduced significance level.
smaller sample.

12. p-values
The lowest level of significance at which the null hypothesis would not be rejected.
Rejection rule for a two-tailed test: When the p-value of a hypothesis test is smaller than the chosen value of , then the test procedure leads to rejection of the null hypothesis.

13. Tests of significance H0: 2 = 0. H1: 2  0
Since t=4.20 > tc=2.024 we reject the null hypothesis and accept the alternative
P=2* =

14. The least squares predictor
Given a value x0, what is the prediction of the explanatory variable:
e0 is unobservable, replace with its expectation E(e0)=0

15. The forecast error
The predictor is unbiassed.

16. Variance of the forecast error
The forecast error is estimated by substituting the estimate of 
Confidence interval:
Note that as x moves further away from its sample mean, the more unreliable the estimate.