Presentation on theme: "SADC Course in Statistics Testing a hypothesis (Session 09)"— Presentation transcript:
SADC Course in Statistics Testing a hypothesis (Session 09)
To put your footer here go to View > Header and Footer 2 Learning Objectives By the end of this session, you will be able to set up and carry out a test of hypothesis concerning a population mean interpret the results of such a t-test explain what is meant by a p-value and how it may be interpreted state conclusions resulting from a hypothesis test according to the size of the p-value
To put your footer here go to View > Header and Footer 3 An illustrative example Farmers growing maize in upland areas of Chiradzulu EPA in southern Malawi were getting average yields of 2900 kg/ha with s.d. = 780 kg/ha. A new Integrated Pest Management (IPM) approach was attempted with 16 farmers. Objective: To determine if the new approach results in an increase in maize yields. Yields from these 16 farmers (after using IPM) gave = 3454 kg/ha with standard error 168. Can we determine whether IPM has really increased maize yields?
To put your footer here go to View > Header and Footer 4 In above example, clearly the sample mean of 3454 kg/ha is greater than 2990 kg/ha But the question of interest is does this result indicate a significant increase in the yield or is it just a result of the usual random variation of yield Hypothesis testing seeks to answer such questions by looking at the observed change relative to the noise, i.e. the standard error in the sample estimate Is the yield increase real?
To put your footer here go to View > Header and Footer 5 Review of Session 8 ideas A hypothesis is a statement or a claim concerning a population or populations. The main hypothesis of interest is called the null hypothesis and usually denoted H 0. The alternative hypothesis, denoted H 1, is one that is considered to be true if the null hypothesis is false. It is thus always the case that either H 0 is true or H 1 is true, both cannot be true at the same time.
To put your footer here go to View > Header and Footer 6 H 0 and H 1 for exam ple Null hypothesis H 0 : = 2900 where is the true mean yield of farmers in the area using the new approach The promoters of the new approach are confident that yields with the new approach cannot possibly decrease. Hence the above null hypothesis needs to be tested against the alternative hypothesis H 1 : > 2900 Note: H 0 is very specific. H 1 is more general
To put your footer here go to View > Header and Footer 7 We use the distribution of the sample mean ( ) to test H 0, i.e. ~ N(, 2 /n) Assume the null hypothesis is true, i.e. IPM has no effect on yields. Then From tables of the standard normal dist n, we see that the above probability is about Classical approach to testing
To put your footer here go to View > Header and Footer 8 Interpretation This probability is very small. Unlikely to get this probability value, based on the observed mean of 3454 kg/ha, if the null hypothesis is really true. In other words, the chance of getting a z- value as large as that observed (i.e. 2.84) is very small at 0.22%. We conclude that H 0 cannot be true. IPM has really had an effect.
To put your footer here go to View > Header and Footer 9 Test statistic based approach (a) Set up the null and alternative hypotheses (b) Compute the test statistic z = ( - )/(/n) = (3454 – 2900)/(780/4) = 2.84 (c) Find the probability of getting a result, which is as extreme, or more extreme than the one observed, given H 0 is true. The smaller this probability value, the greater is the evidence against the null hypothesis. This probability is called the p-value or significance level of the test
To put your footer here go to View > Header and Footer 10 Test for mean when is unknown It is usually the case that is unknown. Instead, we could use the sample standard deviation s. The test statistic is now t = ( - )/(s/n) = (3454 – 2900)/(168) = 3.30 which follows a t-distribution with n-1=15 degrees of freedom. Exercise: Look up tables of the t-distribution and assess roughly what the p-value may be…
To put your footer here go to View > Header and Footer 11 Interpretation and conclusions It is clear from t-tables that the p-value is smaller than Using statistical software, we can get the exact p-value as (Can also use Excels function tdist(3.30,15,1) to get this) This p-value is so small, there is sufficient evidence to reject H 0. Conclusion: Use of the new IPM technology has led to an increase in maize yields (p-value=0.0024)
To put your footer here go to View > Header and Footer 12 Summary of actions to take If get a small p-value, i.e. close to zero, –Conclude null-hypothesis is unlikely to be true and select the alternative –Reject the null hypothesis and declare that the result is statistically significant Note that Statistical significance does not necessarily imply that the effect observed is practically important (more on this later) If the p-value is not small, –There is insufficient evidence to reject H 0. –The result is not significant
To put your footer here go to View > Header and Footer 13 More on interpretation of p-value Traditionally, 0.05 has been regarded as a cut-off point for a result to be declared as statistically significant Note that the p-value is essentially the chance (probability) that the null hypothesis is rejected when it is actually true Thus the p-value = = Probability of the Type I error of test
To put your footer here go to View > Header and Footer 14 Reporting the results Take care when reporting results. It is not a good idea to regard a 5% level of significance, i.e. a p-value of 0.05, as an absolute cut off value. Report results according to size of p- value. For example, evidence of an effect is : almost conclusive if p-value < and could be said to be strong if p-value < If 0.01< p-value < 0.05, results indicate some evidence of an effect. If p-value > 0.05, but close to 0.05, it may indicate something is going on, but further confirmatory study is needed.
To put your footer here go to View > Header and Footer 15 Some practical work follows… References Altman, D.G., Machin, D., Bryant, T.N., and Gardner, M.J. (2000) Statistics with confidence. (2nd Edition). BMJ Books, Bristol, UK. pp 240. (See next session for more references)