Presentation on theme: "STATISTICAL INFERENCE PART VI"— Presentation transcript:
1 STATISTICAL INFERENCE PART VI HYPOTHESIS TESTING
2 TESTS OF HYPOTHESISA hypothesis is a statement about a population parameter.The goal of a hypothesis test is to decide which of two complementary hypothesis is true, based on a sample from a population.
3 TESTS OF HYPOTHESISSTATISTICAL TEST: The statistical procedure to draw an appropriate conclusion from sample data about a population parameter.HYPOTHESIS: Any statement concerning an unknown population parameter.Aim of a statistical test: test a hypothesis concerning the values of one or more population parameters.
4 NULL AND ALTERNATIVE HYPOTHESIS NULL HYPOTHESIS=H0E.g., a treatment has no effect or there is no change compared with the previous situation.ALTERNATIVE HYPOTHESIS=HAE.g., a treatment has a significant effect or there is development compared with the previous situation.
5 TESTS OF HYPOTHESISSample Space, A: Set of all possible values of sample values x1,x2,…,xn.(x1,x2,…,xn) AParameter Space, : Set of all possible values of the parameters.=Parameter Space of Null Hypothesis Parameter Space of Alternative Hypothesis= 0 1H0:0H1: 1
6 Not Reject H0 if (x1,x2,…,xn)C΄ TESTS OF HYPOTHESISCritical Region, C, is a subset of A which leads to rejection region of H0.Reject H0 if (x1,x2,…,xn)CNot Reject H0 if (x1,x2,…,xn)C΄A test defines the critical region.A test is a rule which leads to a decision to fail to reject or reject H0 on the basis of the sample information.
7 TEST STATISTIC AND REJECTION REGION TEST STATISTIC: The sample statistic on which we base our decision to reject or not reject the null hypothesis.REJECTION REGION: Range of values such that, if the test statistic falls in that range, we will decide to reject the null hypothesis, otherwise, we will not reject the null hypothesis.
8 TESTS OF HYPOTHESISIf the hypothesis completely specify the distribution, then it is called a simple hypothesis. Otherwise, it is composite hypothesis.=(1, 2)H0:1=3f(x;3, 2)H1:1=5f(x;5, 2)Composite HypothesisIf 2 is known, simple hypothesis.
9 Tests are based on the following principle: TESTS OF HYPOTHESISH0 is FalseH0 is TrueReject H0Do not reject H0Type I errorP(Type I error) = Correct DecisionType II errorP(Type II error) = 1-1-Tests are based on the following principle:Fix , minimize .()=Power function of the test for all .= P(Reject H0)=P((x1,x2,…,xn)C)
10 TESTS OF HYPOTHESISType I error=Rejecting H0 when H0 is true
11 PROCEDURE OF STATISTICAL TEST Determining H0 and HA.Choosing the best test statistic.Deciding the rejection region (Decision Rule).Conclusion.
12 HOW TO DERIVE AN APPROPRIATE TEST Definition: A test which minimizes the Type II error (β) for fixed Type I error (α) is called a most powerful test or best test of size α.
13 MOST POWERFUL TEST (MPT) H0:=0 Simple HypothesisH1:=1 Simple HypothesisReject H0 if (x1,x2,…,xn)CThe Neyman-Pearson Lemma:Reject H0 ifProof: Available in text books (e.g. Bain & Engelhardt, 1992, p.g.408)
14 EXAMPLES where 0 > 1. X~N(, 2) where 2 is known. H0: = 0 Find the most powerful test of size .
16 Solution, cont. What is c?: It is a constant that satisfies since X~N(, 2).For a pre-specified α, most powerful test says,Reject Ho if
17 Examples Example2: See Bain & Engelhardt, 1992, p.g.410 Find MPT of Ho: p=p0 vs H1: p=p1 > p0Example 3: See Bain & Engelhardt, 1992, p.g.411 Find MPT ofHo: X~Unif(0,1) vs H1: X~Exp(1)
18 UNIFORMLY MOST POWERFUL (UMP) TEST If a test is most powerful against every possible value in a composite alternative, then it will be a UMP test.One way of finding UMPT is to find MPT by Neyman-Pearson Lemma for a particular alternative value, and then show that test does not depend on the specific alternative value.Example: X~N(, 2), we reject Ho ifNote that this does not depend on particular value of μ1, but only on thefact that 0 > 1. So this is a UMPT of H0: = 0 vs H1: < 0.
19 UNIFORMLY MOST POWERFUL (UMP) TEST To find UMPT, we can also use Monotone Likelihood Ratio (MLR).If L=L(0)/L(1) depends on (x1,x2,…,xn) only through the statistic y=u(x1,x2,…,xn) and L is an increasing function of y for every given 0>1, then we have a monotone likelihood ratio (MLR) in statistic y.If L is a decreasing function of y for every given 0>1, then we have a monotone likelihood ratio (MLR) in statistic −y.
20 UNIFORMLY MOST POWERFUL (UMP) TEST Theorem: If a joint pdf f(x1,x2,…,xn;) has MLR in the statistic Y, then a UMP test of size for H0:0 vs H1:>0 is to reject H0 if Yc where P(Y c0)=.for H0:0 vs H1:<0 is to reject H0 if Yc where P(Y c0)=.
21 EXAMPLEX~Exp()H0:0H1:>0Find UMPT of size .
22 EXAMPLE Xi~Poi(), i=1,2,…,n Determine whether (X1,…,Xn) has MLR property.Find a UMP level α test for testing H0:=0 versus H1:<0.
23 GENERALIZED LIKELIHOOD RATIO TEST (GLRT) GLRT is the generalization of MPT and provides a desirable test in many applications but it is not necessarily a UMP test.
24 GENERALIZED LIKELIHOOD RATIO TEST (GLRT) H0:0 H1: 1andLetMLE of MLE of under H0
25 GENERALIZED LIKELIHOOD RATIO TEST (GLRT) GLRT: Reject H0 if 0