1. Introducing Hypothesis Tests
Section 4.1
Introducing Hypothesis Tests

2. Review A 99% confidence interval is
wider than a 95% confidence interval
narrower than a 95% confidence interval
the same width as a 95% confidence interval
A 99% CI contains the middle 99% of bootstrap statistics, while a 95% CI contains only the middle 95%. To be more confident that the interval contains the truth, a 99% interval has to contain more values than a 95% interval.
If a lot of people miss this, consider opening StatKey or drawing a bootstrap distribution on the board and comparing the middle 99% to the middle 95%

3. Extrasensory Perception
Is there such a thing as extrasensory perception (ESP) or a “sixth sense”? Do you believe in ESP?
Yes No

4. Extrasensory Perception

5. Extrasensory Perception
One way to test for ESP is with Zener cards:
Subjects draw a card at random and telepathically communicate this to someone who then guesses the symbol

6. Extrasensory Perception
There are five cards with five different symbols
If there is no such thing as ESP, what proportion of guesses should be correct?
p = 0
p = 1/4
p = 1/5
p = 1/2
Because there are 5 cards, each person has a 1/5 chance of guessing correctly each time, if ESP does not exist.

7. Extrasensory Perception
As we’ve learned, statistics vary from sample to sample
Even if the population proportion is 1/5, not every sample proportion will be exactly 1/5
How do we determine when a sample proportion is far enough above 1/5 to provide evidence of ESP?

8. Statistical Test
A statistical test is used to determine whether results from a sample are convincing enough to allow us to conclude something about the population.
In the ESP experiment, we want to use sample data to determine whether the population proportion of correct guesses is really higher than 1/5

9. Statistical Evidence
Let 𝑝 denote the sample proportion of correct guesses in an ESP experiment
Which of these sample statistics would give the strongest evidence for ESP?
𝑝 =0
𝑝 =1/5
𝑝 = 1/2
𝑝 = 3/4
3/4 is the highest, so provides the strongest evidence of ESP.

10. Extrasensory Perception
Let’s create our own sample proportion!
Randomly choose a letter from A B C D E, and write it down (don’t show anyone!)
Find a partner, telepathically communicate your letter (no auditory or visual clues!), and have them guess your letter. Switch roles.
Did you guess correctly?
Yes No

11. Extrasensory Perception
What is the sample proportion for our class?
This provides
Next class, we’ll learn how to quantify this evidence!
Strong evidence for ESP
Weak evidence for ESP
No evidence for ESP
Not sure

12. Statistical Hypotheses
Statistical tests are framed formally in terms of two competing hypotheses:
Null Hypothesis (H0): Claim that there is no effect or difference. Alternative Hypothesis (Ha): Claim for which we seek evidence.

13. Statistical Hypotheses
Competing claims about a population
Ho: Null hypothesis
Ha: Alternative hypothesis
The alternative hypothesis is established by observing evidence (data) that contradicts the null hypothesis and supports the alternative hypothesis

14. ESP Hypotheses For the ESP experiment: H0: ESP does not exist
Ha: ESP exists
Translate into parameters:
Ho: p = 1/5
Ha: p > 1/5
No “effect” or no “difference”
Claim we seek “evidence” for

15. Hypothesis Helpful Hints
Hypotheses are always about population parameters, not sample statistics
The null hypothesis always contains an equality
The alternative hypothesis always contains an inequality (<, >, ≠)
The type of inequality in the alternative comes from the wording of the question of interest

16. Sleep versus Caffeine
Students were given words to memorize, then randomly assigned to take either a 90 min nap, or a caffeine pill. 2 ½ hours later, they were tested on their recall ability.
Explanatory variable: sleep or caffeine
Response variable: number of words recalled
Is sleep or caffeine better for memory?
Mednick, Cai, Kanady, and Drummond (2008). “Comparing the benefits of caffeine, naps and placebo on verbal, motor and perceptual memory,” Behavioral Brain Research, 193,

17. Sleep versus Caffeine
What is the parameter of interest in the sleep versus caffeine experiment?
Proportion
Difference in proportions
Mean
Difference in means
Correlation
The response variable (number of words recalled) is quantitative and the explanatory variable (sleep or caffeine) is categorical, so we are interested in a difference in means.

18. Sleep versus Caffeine H0: s ≠ c, Ha: s = c
Let s and c be the mean number of words recalled after sleeping and after caffeine.
Is there a difference in average word recall between sleep and caffeine?
What are the null and alternative hypotheses?
H0: s ≠ c, Ha: s = c
H0: s = c, Ha: s ≠ c
H0: s ≠ c, Ha: s > c
H0: s = c, Ha: s > c
H0: s = c, Ha: s < c
The null hypotheses is “no difference,” or that the means are equal. The alternative hypothesis is that there is a difference.

19. Difference in Hypotheses
Note: the following two sets of hypotheses are equivalent, and can be used interchangeably:
H0: 1 = 2
Ha: 1 ≠ 2
H0: 1 – 2 = 0
Ha: 1 – 2 ≠ 0

20. Hypotheses
Take a minute to write down the hypotheses for each of the following situations:
Does the proportion of people who support gun control differ between males and females?
Is the average hours of sleep per night for college students less than 7?

21. Hypotheses
Take a minute to write down the hypotheses for each of the following situations:
Does the proportion of people who support gun control differ between males and females?
Is the average hours of sleep per night for college students less than 7?
H0: pf = pm
Ha: pf ≠ pm
pf: proportion of females who support gun control
pm: proportion of males who support gun control
H0:  =7
Ha:  < 7
: average hours of sleep per night for college students

22. Your Own Hypotheses
Come up with a situation where you want to establish a claim based on data
What parameter(s) are you interested in?
What would the null and alternative hypotheses be?
What type of data would lead you to believe the null hypothesis is probably not true?

23. Evidence
The goal of a hypothesis test is to determine whether the sample data provide enough evidence to refute the null hypothesis in favor of the alternative hypothesis.

24. ESP Evidence H0: p = 1/5 = 0.2 Ha: p > 1/5
Which 𝑝 would give the strongest evidence against H0 and in favor of Ha?
𝑝 =0
𝑝 =1/6
𝑝 =1/5
𝑝 = 1/4
𝑝 = 1/2
1/2 is the farthest above 1/5, so is the strongest evidence against H0: p = 1/5 and in favor of Ha: p > 1/5

25. ESP Evidence How high does 𝑝 ℎ𝑎𝑣𝑒 𝑡𝑜 𝑏𝑒 𝑡𝑜 𝑠𝑎𝑦 𝐸𝑆𝑃 𝑒𝑥𝑖𝑠𝑡𝑠??? 𝑝 = 1/3
H0: p = 1/5
Ha: p > 1/5
Discuss the following in terms of evidence against H0 and in favor of Ha:
𝑝 =1/6
No evidence against H0 or in favor of Ha
𝑝 =1/5
𝑝 = 1/4
Some evidence against H0 or in favor of Ha (enough??)
𝑝 = 1/3
Stronger evidence against H0 or in favor of Ha (enough??)
How high does 𝑝 ℎ𝑎𝑣𝑒 𝑡𝑜 𝑏𝑒 𝑡𝑜 𝑠𝑎𝑦 𝐸𝑆𝑃 𝑒𝑥𝑖𝑠𝑡𝑠???

26. Coming Attractions!
How do we measure strength of evidence against H0 and in favor of Ha?
Next class!
How do we know whether we have enough evidence to reject H0 in favor of Ha?
The following class!

27. Summary
Statistical tests use data from a sample to assess a claim about a population
Statistical tests are usually formalized with competing hypotheses:
Null hypothesis (H0): no effect or no difference
Alternative hypothesis (Ha): what we seek evidence for
A hypothesis test examines whether sample data provide enough evidence to refute the null hypothesis and support the alternative hypothesis.