STAT 5372: Experimental Statistics Wayne Woodward Office: Office: 143 Heroy Phone: Phone: (214)768-2457 URL: URL: faculty.smu.edu/waynew.

Slides:



Advertisements
Similar presentations
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
Advertisements

Inferential Statistics
Hypothesis Testing A hypothesis is a claim or statement about a property of a population (in our case, about the mean or a proportion of the population)
Is it statistically significant?
Chapter 12 Tests of Hypotheses Means 12.1 Tests of Hypotheses 12.2 Significance of Tests 12.3 Tests concerning Means 12.4 Tests concerning Means(unknown.
Our goal is to assess the evidence provided by the data in favor of some claim about the population. Section 6.2Tests of Significance.
Introduction to Statistics
STATISTICAL INFERENCE PART V
Class Handout #3 (Sections 1.8, 1.9)
Lecture 3 Miscellaneous details about hypothesis testing Type II error
1 MF-852 Financial Econometrics Lecture 4 Probability Distributions and Intro. to Hypothesis Tests Roy J. Epstein Fall 2003.
9-1 Hypothesis Testing Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental.
Hypothesis : Statement about a parameter Hypothesis testing : decision making procedure about the hypothesis Null hypothesis : the main hypothesis H 0.
Sampling Distributions
Chapter 8 Introduction to Hypothesis Testing
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 8 Introduction to Hypothesis Testing.
BCOR 1020 Business Statistics Lecture 21 – April 8, 2008.
Inferences About Process Quality
Chapter 9 Hypothesis Testing.
Statistics for Managers Using Microsoft® Excel 5th Edition
©2006 Thomson/South-Western 1 Chapter 10 – Hypothesis Testing for the Mean of a Population Slides prepared by Jeff Heyl Lincoln University ©2006 Thomson/South-Western.
Statistical Inference for Two Samples
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Hypothesis Testing.
Experimental Statistics - week 2
Overview Definition Hypothesis
8 - 1 © 2003 Pearson Prentice Hall Chi-Square (  2 ) Test of Variance.
Fundamentals of Hypothesis Testing: One-Sample Tests
Chapter 8 Introduction to Hypothesis Testing
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
More About Significance Tests
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Statistical Inferences Based on Two Samples Chapter 9.
STATISTICAL INFERENCE PART VII
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
Section 9.2 Testing the Mean  9.2 / 1. Testing the Mean  When  is Known Let x be the appropriate random variable. Obtain a simple random sample (of.
Introduction to Hypothesis Testing: One Population Value Chapter 8 Handout.
STA Statistical Inference
9-1 Hypothesis Testing Statistical Hypotheses Definition Statistical hypothesis testing and confidence interval estimation of parameters are.
Confidence intervals are one of the two most common types of statistical inference. Use a confidence interval when your goal is to estimate a population.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Section Inference about Two Means: Independent Samples 11.3.
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
Introduction to Inferece BPS chapter 14 © 2010 W.H. Freeman and Company.
1 Chapter 9 Hypothesis Testing. 2 Chapter Outline  Developing Null and Alternative Hypothesis  Type I and Type II Errors  Population Mean: Known 
The z test statistic & two-sided tests Section
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 8 Hypothesis Testing.
Lecture 9 Chap 9-1 Chapter 2b Fundamentals of Hypothesis Testing: One-Sample Tests.
Economics 173 Business Statistics Lecture 4 Fall, 2001 Professor J. Petry
Chap 8-1 Fundamentals of Hypothesis Testing: One-Sample Tests.
STATISTICAL INFERENCE PART IV CONFIDENCE INTERVALS AND HYPOTHESIS TESTING 1.
MeanVariance Sample Population Size n N IME 301. b = is a random value = is probability means For example: IME 301 Also: For example means Then from standard.
AP Statistics Section 11.1 B More on Significance Tests.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
© Copyright McGraw-Hill 2004
Applied Quantitative Analysis and Practices LECTURE#14 By Dr. Osman Sadiq Paracha.
AP Statistics Chapter 11 Notes. Significance Test & Hypothesis Significance test: a formal procedure for comparing observed data with a hypothesis whose.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Understanding Basic Statistics Fourth Edition By Brase and Brase Prepared by: Lynn Smith Gloucester County College Chapter Nine Hypothesis Testing.
Copyright © 1998, Triola, Elementary Statistics Addison Wesley Longman 1 Assumptions 1) Sample is large (n > 30) a) Central limit theorem applies b) Can.
Chapter 12 Tests of Hypotheses Means 12.1 Tests of Hypotheses 12.2 Significance of Tests 12.3 Tests concerning Means 12.4 Tests concerning Means(unknown.
Uncertainty and confidence Although the sample mean,, is a unique number for any particular sample, if you pick a different sample you will probably get.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 7 Inferences Concerning Means.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 1 FINAL EXAMINATION STUDY MATERIAL III A ADDITIONAL READING MATERIAL – INTRO STATS 3 RD EDITION.
DSCI 346 Yamasaki Lecture 1 Hypothesis Tests for Single Population DSCI 346 Lecture 1 (22 pages)1.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
4-1 Statistical Inference Statistical inference is to make decisions or draw conclusions about a population using the information contained in a sample.
©2003 Thomson/South-Western 1 Chapter 8 – Hypothesis Testing for the Mean and Variance of a Population Slides prepared by Jeff Heyl, Lincoln University.
Chapter Nine Hypothesis Testing.
Statistics for Managers Using Microsoft® Excel 5th Edition
STAT 5372: Experimental Statistics
STAT 1301 Tests of Significance about Averages.
Presentation transcript:

STAT 5372: Experimental Statistics Wayne Woodward Office: Office: 143 Heroy Phone: Phone: (214) URL: URL: faculty.smu.edu/waynew Hours: Hours: 2:00 - 3:00 MWF 3:00 - 4:00 Th - others by appointment

2 Name Major (undergraduate/graduate) Previous stat courses: –STAT 5371? –STAT/CSE/EMIS 4340? –other – describe briefly Have you used SAS? On a sheet of paper:

3 Review Sampling Distributions Statistical Inference –Confidence Intervals –Hypothesis Tests

4 Sampling / Sampling Distributions Population -- totality of all observations of interest Random Variable (rv) -- a characteristic that can take on different values from object to object Sample -- subset of a population –random sample: –random sample: observations made independently and at random  Parameter – a characteristic of a population Y 1, Y 2, …, Y n – typical notation for a random sample -- population mean (  ), standard deviation (  ), …

5 Discrete – you can count the possible outcomes –Discrete distributions:  binomial, Poisson, … Continuous – possible values fall along a continuum –Continuous distributions:  normal (Gaussian), chi-square, t, F, … Random Variables

6 Normal Curve: -- symmetric, bell-shaped -- for this particular distribution: - data concentrated about 60 - very few data values above 100 or less than 20

7 Standard Normal Standard Normal (Z-score)  Normal table gives P[Z ≤ z]  Has mean zero and standard deviation 1  Graph of standard normal is symmetric about 0

8

9

10 Find: P[Z≤ 2.5] Suppose  = 50 and  = 10. Find: P[X≤ 45] P[Z > 1.6] P[X > 70]

11 Examples of Statistics: sample mean sample variance Statistic - function of random variables - typically used to estimate parameters

12 Statistics are random variables and have their own distributions Key Concept - called sampling distributions

13 Sampling Distribution of the Sample Mean IF: Data are Normally distributed Observations are independent Then: The Sample Mean has a Normal Probability Distribution with -- Mean  -- Standard Error  n has a standard normal distribution

14 Suppose  = 50 and  = 10 for a normal population and suppose further that a random sample of size n = 25 is taken. Find:

15 Central Limit Theorem IF: Independent Observations Sample Size is Sufficiently Large Then: approximate has a an approximate Standard Normal distribution

16 Suppose  = 50 and  = 10 for a non-normal population and suppose further that a random sample of size n = 50 is taken. Find:

17 Distribution of Sample Mean -  Unknown IF: Data Values are Normally Distributed Observations are Independent Then: Student’s t has a Student’s t distribution with n - 1 df

18 t-distribution -- Figure 5.16, page 229

19

20 tt  t   Notation z  is obtained from bottom (inf.) row of t-table

21 (1-  )x100% Confidence Intervals for  Setting: Data are Normally Distributed Observations are Independent We want an interval that probably contains the population mean  Case 1:  known Case 2:  unknown

22 CI Example An insurance company is concerned about the number and magnitude of hail damage claims it received this year. A random sample 20 of the thousands of claims it received this year showed an average claim amount of $6,500 and a standard deviation of $1,500. (You can assume that claims have a normal distribution. Find a a 95% confidence interval on the mean claim damage amount. Suppose that company actuaries believe the company does not need to increase insurance rates for hail damage if the mean claim damage amount is no greater than $7,000. Use the above information to make a recommendation regarding whether rates should be raised.

23 Last time we found 95% CI to be: ($5798, $7202) What does this mean? “There is a.95 probability that the population mean (  is between $5798 and $7202”? Not exactly.

24 Interpretation of 95% Confidence Interval 100 different 95% CI plotted in the case for which true mean is 80 i.e. about 95% of these confidence intervals should “cover” the true mean

25 Last time we found 95% CI to be: ($5798, $7202) What does this mean? “There is a.95 probability that the population mean (  ) is between $5798 and $7202”? Not exactly. “About 95% of confidence intervals obtained in this manner will cover the true mean.” A better statement; We say: “we are 95% confident that the mean falls in the interval … ”

Concern has been mounting that SAT scores are falling. 3 years ago -- National AVG = 955 Random Sample of 200 graduating high school students this year (sample average = 935) (each year the standard deviation is about 100) Question: Have SAT scores dropped ? Procedure: Determine how “extreme” or “rare” our sample AVG of 935 is if population AVG really is 955.

27 If Population average = 955, what is the probability of getting a sample average (from a sample of size 200) that is less than or equal to 935?

We must decide: The sample came from population with population AVG = 955 and just by chance the sample AVG is “small.” OR We are not willing to believe that the pop. AVG this year is really 955. (Conclude SAT scores have fallen.)

29 Statistical Hypothesis - statement about the parameters of one or more populations Null Hypothesis ( H 0 Null Hypothesis ( H 0 ) - hypothesis to be “tested” (standard, traditional, claimed, etc.) - hypothesis of no change, effect, or difference (usually what the investigator wants to disprove) Alternative Hypothesis ( H a Alternative Hypothesis ( H a ) - null is not correct (usually what the hypothesis the investigator suspects or wants to show) Hypothesis Testing Terminology

30 Basic Hypothesis Testing Question: Do the Data provide sufficient evidence to refute the Null Hypothesis? Test Statistic - measures how far the observed statistic is from the hypothesized parameter (under H 0 ) Example: H 0 :  = 50 Test statistic:

31 Critical Region (Rejection Region) Critical Region (Rejection Region) - region of test statistic that leads to rejection of null (i.e. t > c, etc.) Critical Value - endpoint of critical region Significance Level - probability that the test statistic will be in the critical region if null is true - probability of rejecting H 0 when it is true Hypothesis Testing (cont.)

32 Types of Hypotheses One-Sided Tests Two-sided Tests

33 Rejection Regions for One- and Two-Sided Alternatives -t-t Critical Value 

34 A Standard Hypothesis Test Write-up 1. State the null and alternative 2. Give significance level, test statistic,and the rejection region 3. Show calculations 4. State the conclusion - statistical decision - give conclusion in language of the problem

35 Hypothesis Testing Example 1 A solar cell requires a special crystal. If properly manufactured, the mean weight of these crystals is.4g. Suppose that 25 crystals are selected at random from a batch of crystals and it is calculated that for these crystals, the average is.41g with a standard deviation of.02g. At the  =.01 level of significance, can we conclude that the batch is bad?

36 Hypothesis Testing Example 2 A box of detergent is designed to weigh on the average 3.25 lbs per box. A random sample of 18 boxes taken from the production line on a single day has a sample average of lbs and a standard deviation of lbs. Test whether the boxes seem to be underfilled.

37 Actual Situation Errors in Hypothesis Testing Null is TrueNull is False Do Not Reject H o Conclusion Correct Decision Correct Decision (  ) (  )( 1 -  ) ( 1 -  ) (Power) Type II Error Type I Error Power

38 Note: There are many ways that H 0 can be false Example: H 0 :  50 This null hypothesis is “false” if: (a)  (b)  (c)   If (c) is the actual situation, then the “power” of the test will probably be large  In the case of (a), the “power” will likely be small

39 p- Value (observed value of t) p-value Suppose t = is observed from data for test above Note: “ Large negative values” of t make us believe alternative is true the probability of an observation as extreme or more extreme than the one observed when the null is true

40 Note: -- if p-value is less than or equal to  then we reject null at the  significance level -- the p-value is the smallest level of significance at which the null hypothesis would be rejected

41 Find the p-values for Examples 1 and 2