How to Handle Intervals in a Simulation-Based Curriculum? Robin Lock Burry Professor of Statistics St. Lawrence University 2015 Joint Statistics Meetings.

Slides:



Advertisements
Similar presentations
Panel at 2013 Joint Mathematics Meetings
Advertisements

Review bootstrap and permutation
What Can We Do When Conditions Arent Met? Robin H. Lock, Burry Professor of Statistics St. Lawrence University BAPS at 2012 JSM San Diego, August 2012.
Statistical Inference Using Scrambles and Bootstraps Robin Lock Burry Professor of Statistics St. Lawrence University MAA Allegheny Mountain 2014 Section.
What Can We Do When Conditions Aren’t Met? Robin H. Lock, Burry Professor of Statistics St. Lawrence University BAPS at 2014 JSM Boston, August 2014.
Using Randomization Methods to Build Conceptual Understanding in Statistical Inference: Day 1 Lock, Lock, Lock Morgan, Lock, and Lock MAA Minicourse –
Using Randomization Methods to Build Conceptual Understanding in Statistical Inference: Day 1 Lock, Lock, Lock, Lock, and Lock MAA Minicourse – Joint Mathematics.
StatKey Online Tools for Teaching a Modern Introductory Statistics Course Robin Lock Burry Professor of Statistics St. Lawrence University
Early Inference: Using Bootstraps to Introduce Confidence Intervals Robin H. Lock, Burry Professor of Statistics Patti Frazer Lock, Cummings Professor.
Intuitive Introduction to the Important Ideas of Inference Robin Lock – St. Lawrence University Patti Frazer Lock – St. Lawrence University Kari Lock Morgan.
Models and Modeling in Introductory Statistics Robin H. Lock Burry Professor of Statistics St. Lawrence University 2012 Joint Statistics Meetings San Diego,
A new approach to introductory statistics Nathan Tintle Hope College.
A Fiddler on the Roof: Tradition vs. Modern Methods in Teaching Inference Patti Frazer Lock Robin H. Lock St. Lawrence University Joint Mathematics Meetings.
Connecting Simulation- Based Inference with Traditional Methods Kari Lock Morgan, Penn State Robin Lock, St. Lawrence University Patti Frazer Lock, St.
Dr. Kari Lock Morgan Department of Statistics Penn State University Teaching the Common Core: Making Inferences and Justifying Conclusions ASA Webinar.
Starting Inference with Bootstraps and Randomizations Robin H. Lock, Burry Professor of Statistics St. Lawrence University Stat Chat Macalester College,
Using Simulation Methods to Introduce Statistical Inference Patti Frazer Lock Kari Lock Morgan Cummings Professor of Mathematics Assistant Professor of.
Building Conceptual Understanding of Statistical Inference with Lock 5 Dr. Kari Lock Morgan Department of Statistical Science Duke University Wake Forest.
Bootstrapping: Let Your Data Be Your Guide Robin H. Lock Burry Professor of Statistics St. Lawrence University MAA Seaway Section Meeting Hamilton College,
Bootstrap spatobotp ttaoospbr Hesterberger & Moore, chapter 16 1.
Introducing Inference with Simulation Methods; Implementation at Duke University Kari Lock Morgan Department of Statistical Science, Duke University
StatKey Online Tools for Teaching a Modern Introductory Statistics Course Robin Lock Burry Professor of Statistics St. Lawrence University
Using Bootstrap Intervals and Randomization Tests to Enhance Conceptual Understanding in Introductory Statistics Kari Lock Morgan Department of Statistical.
Statistics: Unlocking the Power of Data Lock 5 Inference for Proportions STAT 250 Dr. Kari Lock Morgan Chapter 6.1, 6.2, 6.3, 6.7, 6.8, 6.9 Formulas for.
Introducing Inference with Bootstrap and Randomization Procedures Dennis Lock Statistics Education Meeting October 30,
4.1 Introducing Hypothesis Tests 4.2 Measuring significance with P-values Visit the Maths Study Centre 11am-5pm This presentation.
One Sample  M ean μ, Variance σ 2, Proportion π Two Samples  M eans, Variances, Proportions μ1 vs. μ2 σ12 vs. σ22 π1 vs. π Multiple.
Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University
Using Simulation Methods to Introduce Inference Kari Lock Morgan Duke University In collaboration with Robin Lock, Patti Frazer Lock, Eric Lock, Dennis.
Statistics: Unlocking the Power of Data Lock 5 Normal Distribution STAT 250 Dr. Kari Lock Morgan Chapter 5 Normal distribution Central limit theorem Normal.
Statistics: Unlocking the Power of Data Lock 5 Synthesis STAT 250 Dr. Kari Lock Morgan SECTIONS 4.4, 4.5 Connecting bootstrapping and randomization (4.4)
Using Lock5 Statistics: Unlocking the Power of Data
What Can We Do When Conditions Aren’t Met? Robin H. Lock, Burry Professor of Statistics St. Lawrence University BAPS at 2011 JSM Miami Beach, August 2011.
Estimation: Sampling Distribution
Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University
Statistics: Unlocking the Power of Data Lock 5 STAT 101 Dr. Kari Lock Morgan 9/18/12 Confidence Intervals: Bootstrap Distribution SECTIONS 3.3, 3.4 Bootstrap.
Introducing Inference with Simulation Methods; Implementation at Duke University Kari Lock Morgan Department of Statistical Science, Duke University
Ch 8 Estimating with Confidence. Today’s Objectives ✓ I can interpret a confidence level. ✓ I can interpret a confidence interval in context. ✓ I can.
Robin Lock St. Lawrence University USCOTS Opening Session.
StatKey Online Tools for Teaching a Modern Introductory Statistics Course Robin Lock Burry Professor of Statistics St. Lawrence University
Confidence Intervals: Bootstrap Distribution
Introducing Inference with Bootstrapping and Randomization Kari Lock Morgan Department of Statistical Science, Duke University with.
Implementing a Randomization-Based Curriculum for Introductory Statistics Robin H. Lock, Burry Professor of Statistics St. Lawrence University Breakout.
Statistics: Unlocking the Power of Data Lock 5 Bootstrap Intervals Dr. Kari Lock Morgan PSU /12/14.
Building Conceptual Understanding of Statistical Inference Patti Frazer Lock Cummings Professor of Mathematics St. Lawrence University Canton, New York.
Using Bootstrapping and Randomization to Introduce Statistical Inference Robin H. Lock, Burry Professor of Statistics Patti Frazer Lock, Cummings Professor.
Give your data the boot: What is bootstrapping? and Why does it matter? Patti Frazer Lock and Robin H. Lock St. Lawrence University MAA Seaway Section.
+ Using StatCrunch to Teach Statistics Using Resampling Techniques Webster West Texas A&M University.
Early Inference: Using Randomization to Introduce Hypothesis Tests Kari Lock, Harvard University Eric Lock, UNC Chapel Hill Dennis Lock, Iowa State Joint.
Statistics: Unlocking the Power of Data Lock 5 Inference for Means STAT 250 Dr. Kari Lock Morgan Sections 6.4, 6.5, 6.6, 6.10, 6.11, 6.12, 6.13 t-distribution.
Statistics: Unlocking the Power of Data Lock 5 Section 4.5 Confidence Intervals and Hypothesis Tests.
Reflections on making the switch to a simulation-based inference curriculum Panelists: Julie Clark, Lacey Echols, Dave Klanderman, Laura Shultz Moderator:
Constructing Bootstrap Confidence Intervals
Comparing Two Proportions. AP Statistics Chap 13-2 Two Population Proportions The point estimate for the difference is p 1 – p 2 Population proportions.
Confidence Intervals for a Population Proportion Excel.
StatKey Online Tools for Teaching a Modern Introductory Statistics Course Robin Lock Burry Professor of Statistics St. Lawrence University
Bootstraps and Scrambles: Letting a Dataset Speak for Itself Robin H. Lock Patti Frazer Lock ‘75 Burry Professor of Statistics Cummings Professor of MathematicsSt.
Notes on Bootstrapping Jeff Witmer 10 February 2016.
Reflections on Using Simulation Based Methods to Teach Statistical Methods Amanda Ellis and Melissa Pittard University of Kentucky, Department of Statistics.
Using Randomization Methods to Build Conceptual Understanding in Statistical Inference: Day 1 Lock, Lock, Lock, Lock, and Lock Minicourse – Joint Mathematics.
Making computing skills part of learning introductory stats
Patti Frazer Lock Cummings Professor of Mathematics
Introducing Statistical Inference with Resampling Methods (Part 1)
Application of the Bootstrap Estimating a Population Mean
When we free ourselves of desire,
Connecting Intuitive Simulation-Based Inference to Traditional Methods
Using Simulation Methods to Introduce Inference
Using Simulation Methods to Introduce Inference
CHAPTER 6 Statistical Inference & Hypothesis Testing
Teaching with Simulation-Based Inference, for Beginners
Presentation transcript:

How to Handle Intervals in a Simulation-Based Curriculum? Robin Lock Burry Professor of Statistics St. Lawrence University 2015 Joint Statistics Meetings – Seattle, WA August 2015

Simulation-Based Inference (SBI) Projects Lock 5 lock5stat.com Tintle, et al math.hope.edu/isi Catalst Tabor/Franklin Open Intro

SBI Blog How should we teach about intervals when using simulation-based inference?

Assumptions 1. We agree with George Cobb (TISE 2007): 2. Statistical inference has two main components: “Randomization-based inference makes a direct connection between data production and the logic of inference that deserves to be at the core of every introductory course.” Estimation (confidence interval) Hypothesis test (p-value)

Assumptions 3. For a randomized experiment to compare two groups: Confidence interval via simulation?  ??? Hypothesis test via simulation?  Randomization (permutation) test 3. For a parameter based on a single sample:

CI: Potential Initial Approaches 1. Invert hypothesis tests CI =plausible parameter values that would not be rejected 3. Traditional formulas

Example: Proportion of Orange Reese’s Pieces Key question: How accurate is a proportion estimated from 150 Reese’s pieces?

Invert the Test Guess/check:   95% CI for p (, 0.562) Repeat for the lower tail or use symmetry

Invert the Test Pros: Reinforces ideas from hypothesis tests Makes connection with CI as “plausible” values for the parameter Cons: Tedious (especially with randomization tests)-even with technology Harder to make a direct connection with variability (SE) of the sample statistic Requires tests first How do we do a CI for a single mean?

Bootstrap Basic idea: Sample (with replacement) from the original sample Compute the statistic for each bootstrap sample Repeat 1000’s of times to get bootstrap distribution Estimate the SE of the statistic

Simulated Reese’s Population Sample from this “population”

Original Sample Bootstrap Sample ●●●●●● Bootstrap Statistic Sample Statistic Bootstrap Statistic ●●●●●● Bootstrap Distribution Many times We need technology!

StatKey

Same process used for different parameters Bootstrap Confidence Intervals

Why does the bootstrap work?

Sampling Distribution Population µ BUT, in practice we don’t see the “tree” or all of the “seeds” – we only have ONE seed

Bootstrap Distribution Bootstrap “Population” What can we do with just one seed? Grow a NEW tree! µ Chris Wild: Use the bootstrap errors that we CAN see to estimate the sampling errors that we CAN’T see.

Transition to Traditional Formulas Use z* or t*

Bootstrap Cons: Requires software Tedious to demonstrate “by hand” Doesn’t always “work”

Want to Know More? What Teachers Should Know about the Bootstrap: Resampling in the Undergraduate Statistics Curriculum Tim Hesterberg Thanks for listening