Evaluation challenges - Reporting

Slides:



Advertisements
Similar presentations
Comparing Two Means: One-sample & Paired-sample t-tests Lesson 12.
Advertisements

Class 14 Testing Hypotheses about Means Paired samples 10.3 p
Sampling: Final and Initial Sample Size Determination
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Determining Sample Size  The required sample size can be.
Launching into Inference: From Common Core to AP Statistics Daren Starnes The Lawrenceville School CMC South 2013.
Confidence Intervals © Scott Evans, Ph.D..
Chapter 8 Estimation: Additional Topics
Stat 301 – Day 15 Comparing Groups. Statistical Inference Making statements about the “world” based on observing a sample of data, with an indication.
Estimation and Testing for Population Proportions Introduction to Business Statistics, 5e Kvanli/Guynes/Pavur (c)2000 South-Western College Publishing.
1 A heart fills with loving kindness is a likeable person indeed.
Tuesday, October 22 Interval estimation. Independent samples t-test for the difference between two means. Matched samples t-test.
IEEM 3201 Two-Sample Estimation: Paired Observation, Difference.
Chap 9-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 9 Estimation: Additional Topics Statistics for Business and Economics.
Part IV – Hypothesis Testing Chapter 4 Statistics for Managers Using Microsoft Excel, 7e © 2014 Pearson Prentice-Hall, Inc. Philip A. Vaccaro, PhD MGMT.
A new sampling method: stratified sampling
1 (Student’s) T Distribution. 2 Z vs. T Many applications involve making conclusions about an unknown mean . Because a second unknown, , is present,
AP STATISTICS.   Theoretical: true mathematical probability  Empirical: the relative frequency with which an event occurs in a given experiment  Subjective:
1 1 Slide Interval Estimation Chapter 8 BA Slide A point estimator cannot be expected to provide the exact value of the population parameter.
Lab 5 Hypothesis testing and Confidence Interval.
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Aim: How do we find confidence interval? HW#9: complete question on last slide on loose leaf (DO NOT ME THE HW IT WILL NOT BE ACCEPTED)
HULL HIGH SCHOOL 10 th Grade MCAS Results and Comparisons Spring of 2008 Testing.
Sampling January 9, Cardinal Rule of Sampling Never sample on the dependent variable! –Example: if you are interested in studying factors that lead.
Chapter 7 Statistical Inference: Confidence Intervals
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
AP STATISTICS LESSON COMPARING TWO PROPORTIONS.
STANDARDS FOR MATHEMATICS 1. Uses a variety of strategies in the PROBLEM- SOLVING PROCESS 2. Understands and applies basic and advanced properties of the.
On teaching statistical inference: What do p values (not) mean? Bruce Blaine, PhD, PStat® Department of Mathematical and Computing Sciences St. John Fisher.
Basics of Hypothesis Testing 8.2 Day 2. Homework Answers.
1 OTC-TFM Monograph: Statistical Issues of Study Design and Analyses Thamban Valappil, Ph.D. Mathematical Statistician OPSS/OB/DBIII Nonprescription Drugs.
S-012 Testing statistical hypotheses The CI approach The NHST approach.
Tests of Hypotheses Involving Two Populations Tests for the Differences of Means Comparison of two means: and The method of comparison depends on.
Module 23: Proportions: Confidence Intervals and Hypothesis Tests, Two Samples This module examines confidence intervals and hypothesis test for.
CONFIDENCE INTERVAL FOR 2-SAMPLE MEANS
CHEMISTRY ANALYTICAL CHEMISTRY Fall
Ledolter & Hogg: Applied Statistics Section 6.2: Other Inferences in One-Factor Experiments (ANOVA, continued) 1.
Illustrations using R B. Jones Dept. of Political Science UC-Davis.
: An alternative representation of level of significance. - normal distribution applies. - α level of significance (e.g. 5% in two tails) determines the.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 9-1 Chapter 9 Fundamentals of Hypothesis Testing: One-Sample Tests Business Statistics,
© 2001 Prentice-Hall, Inc.Chap 7-1 BA 201 Lecture 11 Sampling Distributions.
Joint survey on volunteering The main aim was to observe and compare the past and present activities in order to define the challenges of the future in.
Various Topics of Interest to the Inquiring Orthopedist Richard Gerkin, MD, MS BGSMC GME Research.
Week 7 Chapter 6 - Introduction to Inferential Statistics: Sampling and the Sampling Distribution & Chapter 7 – Estimation Procedures.
Doing the Right Thing! … statistically speaking...
9-1 ESTIMATION Session Factors Affecting Confidence Interval Estimates The factors that determine the width of a confidence interval are: 1.The.
Statistics The big picture.... Populations We want to learn about a population. A population is any large collection of objects or individuals, such as.
Week 101 Test on Pairs of Means – Case I Suppose are iid independent of that are iid. Further, suppose that n 1 and n 2 are large or that are known. We.
Chapter 8: Confidence Intervals for One Population Mean 8.3 Margin of Error.
Chapter 7 Inference Concerning Populations (Numeric Responses)
Chapter 9 – Statistical Estimation Statistical estimation involves estimating a population parameter with a sample statistic. Two types of estimation:
Margin of Error S-IC.4 Use data from a sample survey to estimate a population mean or proportion; develop a margin of error through the use of simulation.
EEF Evaluators’ Conference 25 th June Session 1: Interpretation / impact 25 th June 2015.
MATH Section 7.2.
How does the Unpaired t-Test work?
Chapter 7 Inferences Based on a Single Sample
8-1 of 23.
Statistics in Applied Science and Technology
Statistics Branch of mathematics dealing with the collection, analysis, interpretation, presentation, and organization of data. Practice or science of.
SA3202 Statistical Methods for Social Sciences
(or why should we learn this stuff?)
Mean, Median, Mode The Mean is the simple average of the data values. Most appropriate for symmetric data. The Median is the middle value. It’s best.
Summary of Tests Confidence Limits
Exact Test Fisher’s Statistics
Determining Which Method to use
Confidence Interval.
CS639: Data Management for Data Science
Testing Hypotheses I Lesson 9.
The Normal Distribution
Chapter 9 Estimation: Additional Topics
P aeruginosa-free survival curves analyzed by center and group using information either from all respiratory secretion cultures (A) or from specimens taken.
Presentation transcript:

Evaluation challenges - Reporting

Informally, a p-value is the probability under a specified statistical model that a statistical summary of the data (e.g., the sample mean difference between two compared groups) would be equal to or more extreme than its observed value. American Statistical Association

80% agreement?

(95% confidence interval) Estimated months’ progress Subject area Group Effect size (95% confidence interval) Estimated months’ progress EEF security rating EEF cost rating Mathematics Treatment vs. control +0.09 (-0.04, 0.20) 1 £ Treatment vs. control (FSM only) +0.16 (0.01, 0.30) 2 n/a Science +0.12 (0.01, 0.23) +0.11 (-0.04, 0.26) English +0.15 (0.00, 0.30) +0.12 (-0.07, 0.30)

Thank you! Danielle.mason@eefoundation.org.uk