Lack of independent replicates: A common pitfall in experimental design.

Slides:



Advertisements
Similar presentations
C82MST Statistical Methods 2 - Lecture 2 1 Overview of Lecture Variability and Averages The Normal Distribution Comparing Population Variances Experimental.
Advertisements

Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
STA291 Statistical Methods Lecture 23. Difference of means, redux Default case: assume no natural connection between individual observations in the two.
CHAPTER TWELVE ANALYSING DATA I: QUANTITATIVE DATA ANALYSIS.
Genetic Statistics Lectures (5) Multiple testing correction and population structure correction.
Statistical Inference in Wildlife Science Goals Concerns with Nulls Better Approaches? –Information-theoretic –Metareplication –Data dredging Important.
Statistics in Science  Role of Statistics in Research.
Experiments with both nested and “crossed” or factorial factors
Pre-Quiz (work with a partner) Low temp High temp E. C. Enders, D. Boisclair, P. Boily, P. Magnan 2006 Med. temp Explain in plain English what this figure.
ANOVA: ANalysis Of VAriance. In the general linear model x = μ + σ 2 (Age) + σ 2 (Genotype) + σ 2 (Measurement) + σ 2 (Condition) + σ 2 (ε) Each of the.
The Statistical Analysis Partitions the total variation in the data into components associated with sources of variation –For a Completely Randomized Design.
Comparing Means: Independent-samples t-test Lesson 14 Population APopulation B Sample 1Sample 2 OR.
Experimental Design.
Chapter 3 Analysis of Variance
Measuring Biological Diversity EEEB G6185 James A. Danoff-Burg Dept. Ecol., Evol., & Envir. Biol. Columbia University.
Comparing Means: Independent-samples t-test Lesson 13 Population APopulation B Sample 1Sample 2 OR.
13-1 Designing Engineering Experiments Every experiment involves a sequence of activities: Conjecture – the original hypothesis that motivates the.
Multivariate Statistics for the Environmental Sciences Peter J. A. Shaw Chapter 1 Introduction.
Principles of Experimental Design
Biostatistics-Lecture 9 Experimental designs Ruibin Xi Peking University School of Mathematical Sciences.
5-1 Introduction 5-2 Inference on the Means of Two Populations, Variances Known Assumptions.
QNT 531 Advanced Problems in Statistics and Research Methods
1 1 Slide © 2006 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 Slide © 2005 Thomson/South-Western Chapter 13, Part A Analysis of Variance and Experimental Design n Introduction to Analysis of Variance n Analysis.
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Psychology of Learning EXP4404 Chapter 2: The Study of Learning and Behavior Dr. Steve.
Much of the meaning of terms depends on context. 1.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Experimental Design and Analysis of Variance Chapter 10.
ANOVA. Independent ANOVA Scores vary – why? Total variability can be divided up into 2 parts 1) Between treatments 2) Within treatments.
ANOVA: Analysis of Variance
Experimental design. Experiments vs. observational studies Manipulative experiments: The only way to prove the causal relationships BUT Spatial and temporal.
1 Experimental Design. 2  Single Factor - One treatment with several levels.  Multiple Factors - More than one treatment with several levels each. 
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
Blocks and pseudoreplication
Scientific Process METHODS Question to Experimental Design to Data Analysis.
Chapter coverage Part A Part A –1: Practical tools –2: Consulting –3: Design Principles Part B (4-6) One-way ANOVA Part B (4-6) One-way ANOVA Part C (7-9)
ANALYSIS OF VARIANCE (ANOVA) BCT 2053 CHAPTER 5. CONTENT 5.1 Introduction to ANOVA 5.2 One-Way ANOVA 5.3 Two-Way ANOVA.
ANOVA Assumptions 1.Normality (sampling distribution of the mean) 2.Homogeneity of Variance 3.Independence of Observations - reason for random assignment.
Ledolter & Hogg: Applied Statistics Section 6.2: Other Inferences in One-Factor Experiments (ANOVA, continued) 1.
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
ETM U 1 Analysis of Variance (ANOVA) Suppose we want to compare more than two means? For example, suppose a manufacturer of paper used for grocery.
Retain H o Refute hypothesis and model MODELS Explanations or Theories OBSERVATIONS Pattern in Space or Time HYPOTHESIS Predictions based on model NULL.
Repeated Measures Analysis of Variance Analysis of Variance (ANOVA) is used to compare more than 2 treatment means. Repeated measures is analogous to.
Chapter 10 The t Test for Two Independent Samples.
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal
Section 6.4 Inferences for Variances. Chi-square probability densities.
ANalysis Of VAriance can be used to test for the equality of three or more population means. H 0 :  1  =  2  =  3  = ... =  k H a : Not all population.
Week 101 Test on Pairs of Means – Case I Suppose are iid independent of that are iid. Further, suppose that n 1 and n 2 are large or that are known. We.
Chapter 11: Test for Comparing Group Means: Part I.
WELCOME TO BIOSTATISTICS! WELCOME TO BIOSTATISTICS! Course content.
STA248 week 121 Bootstrap Test for Pairs of Means of a Non-Normal Population – small samples Suppose X 1, …, X n are iid from some distribution independent.
Observational Study vs. Experimental Design
Applied Business Statistics, 7th ed. by Ken Black
Design of Experiments.
Lecture 2: Replication and pseudoreplication
Statistics for Business and Economics (13e)
Econ 3790: Business and Economic Statistics
Tests for Two Means – Normal Populations
Methods of Economic Investigation Lecture 12
Single-Factor Studies
Single-Factor Studies
Nested Designs and Repeated Measures with Treatment and Time Effects
Scientific Process METHODS
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Experimental design.
Principles of Experimental Design
Experimental Design Statistics.
Chapter 10 – Part II Analysis of Variance
Design of Experiments.
Principles of Experimental Design
Presentation transcript:

Lack of independent replicates: A common pitfall in experimental design.

Replication the number of individual samples included in an average greater replication provides greater statistical strength –reduces variance; strengthens the generality of the mean

Replicates must be Independent all statistical analyses assume replicate values are independent observations –a single value does not depend on one, more than it does on another failures of the assumption of independence –lack of truly random sampling or assignment to treatment groups –pseudoreplication (Hurlbert, S.H Ecological Monographs 54(2): )

Inhibition of Biofilm Formation Chemical 1 Chemical 2 Chemical 3 Control

Replicates are not independent because they are all in the same dish Differences between dishes will be misinterpreted as differences between treatments

Inhibition of Biofilm Formation Chemical 1 Chemical 2 Chemical 3 Control

Pseudoreplication Stuart Hurlbert Ecological Monographs 54(2): Treating multiple measurements from/on the same sample the same as single measurements made from/on multiple samples The multiple measurements are not independent because they are all from the same sample; hence they are not replicates

At which temperature will Serratia marcescens grow best? 20  C25  C35  C45  C Measure absorbance of five samples from each flask.

Pseudoreplication because... Multiple measurements from the same flask are treated as if they were single measurements from multiple flasks Each flask represents a single replicate, because multiple samples taken from each flask are not independent of one another

Five flasks incubated at each temperature. 20  C25  C35  C45  C Measure absorbance of one sample from each of the 20 flasks.