Power and Error What is it?.

Slides:



Advertisements
Similar presentations
Unlocking the Mysteries of Hypothesis Testing
Advertisements

Introduction to Hypothesis Testing
Type I and Type II Errors. Ms. Betts Chapter 9 Quiz.
Our goal is to assess the evidence provided by the data in favor of some claim about the population. Section 6.2Tests of Significance.
Pitfalls of Hypothesis Testing + Sample Size Calculations.
Anthony Greene1 Simple Hypothesis Testing Detecting Statistical Differences In The Simplest Case:  and  are both known I The Logic of Hypothesis Testing:
 When we perform a hypothesis test, we make a decision to either Reject the Null Hypothesis or Fail to Reject the Null Hypothesis.  There is always the.
+ Chapter 10 Section 10.4 Part 2 – Inference as Decision.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Hypothesis Testing: Type II Error and Power.
Hypothesis Testing.
1 Lecture 19: Hypothesis Tests Devore, Ch Topics I.Statistical Hypotheses (pl!) –Null and Alternative Hypotheses –Testing statistics and rejection.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
AP STATISTICS LESSON 10 – 4 ( DAY 1 ) INFERENCE AS DECISION.
CHAPTER 17: Tests of Significance: The Basics
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
Copyright © Cengage Learning. All rights reserved. 8 Introduction to Statistical Inferences.
Statistics 101 Chapter 10 Section 2. How to run a significance test Step 1: Identify the population of interest and the parameter you want to draw conclusions.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Statistics for Business and Economics 8 th Edition Chapter 9 Hypothesis Testing: Single.
Ch 10 – Intro To Inference 10.1: Estimating with Confidence 10.2 Tests of Significance 10.3 Making Sense of Statistical Significance 10.4 Inference as.
ERRORS: TYPE 1 (  ) TYPE 2 (  ) & POWER Federal funds are to be allocated for financial aid to students for the cost of books. It is believe the mean.
Education 793 Class Notes Decisions, Error and Power Presentation 8.
Using Inference to MAKE DECISIONS The Type I and Type II Errors in Hypothesis Testing.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Unit 5: Hypothesis Testing.
Power of a test. power The power of a test (against a specific alternative value) Is In practice, we carry out the test in hope of showing that the null.
+ Homework 9.1:1-8, 21 & 22 Reading Guide 9.2 Section 9.1 Significance Tests: The Basics.
Unit 9.1B: Testing a Claim Significance Tests: The Basics Using α-levels Type I and Type II Errors The Power of a Test 1.
More on Inference.
Warm Up Check your understanding p. 563
CHAPTER 9 Testing a Claim
Type I & Type II Errors And Power
Section Testing a Proportion
Power of a test.
CHAPTER 9 Testing a Claim
Chapter 21 More About Tests.
Power of a test.
Power of a test.
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
More about Tests and Intervals
More on Inference.
P-value Approach for Test Conclusion
Unlocking the Mysteries of Hypothesis Testing
CHAPTER 9 Testing a Claim
AP Statistics: Chapter 21
Chapter 9: Hypothesis Tests Based on a Single Sample
CHAPTER 9 Testing a Claim
Introduction to Inference
Statistical Inference for Managers
Power of a Test.
Section 10.3 Making Sense of Statistical Significance
CHAPTER 9 Testing a Claim
Introduction to Inference
Statistics Chapter 10 Section 4.
Chapter 11: Introduction to Hypothesis Testing Lecture 5c
Power of a test.
Power of a test.
Power of a test.
More on Testing 500 randomly selected U.S. adults were asked the question: “Would you be willing to pay much higher taxes in order to protect the environment?”
Chapter 9: Testing a Claim
CHAPTER 9 Testing a Claim
Homework: pg. 727 & ) A. Ho: p=0.75, Ha:p>0.75
Power of a test.
Power Problems.
Inference as Decision Section 10.4.
AP STATISTICS LESSON 10 – 4 (DAY 2)
CHAPTER 9 Testing a Claim
A Brief Introduction to Power
Statistical Test A test of significance is a formal procedure for comparing observed data with a claim (also called a hypothesis) whose truth we want to.
CHAPTER 9 Testing a Claim
Presentation transcript:

Power and Error What is it?

Hypothesis Testing Remember that tests of significance are to assess the evidence the null hypothesis When statisticians make decisions based off the strength of evidence against a null hypothesis they also must also worry about the possiblity of making a wrong decision.

Types of wrong decisions TYPE 1 ERROR: if we reject the null hypothesis when it is actually true. TYPE 2 ERROR: if we fail to reject the null when if fact the Alternative is true.

Type I error Therefore: α is the probability of type I error!! Is set by the statistician! Remember: P-value: probability of a null hypothesis being true given then sample data. α= probability that the test will reject the null hypothesis Therefore: α is the probability of type I error!!

Type II Error This is a much harder calculation! This assumes that the alternative is true but we failed to reject the null. To calculate this error we need to know what the alternative parameter actually is… this is rarely known! High type II error implies that the test is not sensitive enough to detect the alternative.

POWER The probability at a fixed significance level that we will reject the null when the particular alternative value is true! POWER= 1-type II error. P-values describes the probability of a situation given the null is true. Power describes the probability given a particular alternative value is true!

fail to reject Ho reject Ho power type II error

and the power increases! fail to reject Ho reject Ho What if we increased alpha? power type II error and the power increases!

fail to reject Ho reject Ho What if we increased sample size? Well, the standard deviation would get smaller. power type II error What happened to power? To a type II error?

What if the alternative (truth?) were further from Ho? fail to reject Ho reject Ho What if the alternative (truth?) were further from Ho? power type II error power is near 1 type II error is near 0

So it’s a balancing act. What is most important in the context of the problem? Which error would be most costly or dangerous?

To raise the power of a test (that is, to increase the probability of correctly rejecting Ho if it is NOT true) increase sample size decrease variation move alternative further from Ho increase alpha (prob. of type I error)