Designing Experiments

Slides:



Advertisements
Similar presentations
DESIGNING EXPERIMENTS
Advertisements

Chapter 13: Experiments & observational studies
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
EXPERIMENTS AND OBSERVATIONAL STUDIES Chance Hofmann and Nick Quigley
Chapter 2 – Experimental Design and Data Collection Math 22 Introductory Statistics.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2010 Pearson Education, Inc. Slide
Chapter 13 Notes Observational Studies and Experimental Design
Chapter 13 Observational Studies & Experimental Design.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
Slide 13-1 Copyright © 2004 Pearson Education, Inc.
LT 4.2 Designing Experiments Thanks to James Jaszczak, American Nicaraguan School.
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
AP STATISTICS Section 5.2 Designing Experiments. Objective: To be able to identify and use different experimental design techniques. Experimental Units:
Conducting A Study Designing Sample Designing Experiments Simulating Experiments Designing Sample Designing Experiments Simulating Experiments.
CHAPTER 9: Producing Data: Experiments. Chapter 9 Concepts 2  Observation vs. Experiment  Subjects, Factors, Treatments  How to Experiment Badly 
Section 5.2 Designing Experiments. Observational Study - Observes individuals and measures variables of interest but DOES NOT attempt to influence the.
CHAPTER 9: Producing Data Experiments ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Producing Data (C11-13 BVD) C13: Experiments and Observational Studies.
Producing Data Designing Experiments 3 Basic Principals of Experimental Design Control Control the effects of lurking variables on the response, most.
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 12, Slide 1 Chapter 12 Experiments and Observational Studies.
CHAPTER 9: Producing Data Experiments ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
1 Chapter 11 Understanding Randomness. 2 Why Random? What is it about chance outcomes being random that makes random selection seem fair? Two things:
CHAPTER 9: Producing Data Experiments ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
AP Statistics Review Day 2 Chapter 5. AP Exam Producing Data accounts for 10%-15% of the material covered on the AP Exam. “Data must be collected according.
Copyright © 2009 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Chapter 4: Designing Studies
Chapter 5 Data Production
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 9 Designing Experiments
Observational Studies and Experiments
Observational Studies and Experiments
Principles of Experiment
Chapter 13- Experiments and Observational Studies
Experiments and Observational Studies
Chapter 13 Experimental and Observational Studies
Tuesday, October 25, 2016 Warm-up
Chapter 3 Producing Data
Section 5.2 Designing Experiments
CHAPTER 4 Designing Studies
Ten things about Experimental Design
WARM - UP An astronaut wants to examine the effects of space exposure on the percent of bone loss. The bone mass of lab rats are recorded before they.
CHAPTER 4 Designing Studies
CHAPTER 9: Producing Data— Experiments
Chapter 4: Designing Studies
Observational Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Experiments & Observational Studies
CHAPTER 4 Designing Studies
Chapter 9 Designing Experiments
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Chapter 3 producing data
Designing Experiments
Principles of Experimental Design
Experimental Design Statistics.
CHAPTER 4 Designing Studies
Principles of Experimental Design
CHAPTER 4 Designing Studies
10/28/ B Experimental Design.
Presentation transcript:

Designing Experiments AP Statistics Chapter 5.2 Designing Experiments

Designing Experiments: If we want to observe individuals and record data without any intervention, we conduct an observational study. Observational studies can look at data that has already been collected (called a retrospective study) or it can look at data as it occurs (called a prospective study). Observational studies are valuable for discovering trends and possible relationships, but they cannot demonstrate causal relationships.

If we want to examine a cause-and-effect relationship, we must conduct a controlled experiment rather than an observational study.

The individuals on which the experiment is done are called experimental units. If the units are people, they are called subjects.

The experimental condition we apply to the units is called the treatment. The explanatory variables (causing a change in the other variables) are called factors. These factors may be applied in different levels.

When designing an experiment we want to minimize the effect of lurking variables so that our results are not biased. Because we may not be able to identify and eliminate all lurking variables, it is essential that we use a control group. The control group gets either no treatment, or a fake treatment to counter the placebo effect and/or any other lurking variables present. Having a control group allows us to compare the results of the treatments.

Step 1: Choose treatments Identify factors and levels Control Group Experimental Design Step 1: Choose treatments Identify factors and levels Control Group Step 2: Assign the experimental units to the treatments Matching (similar units in each group) Randomization

Remember, if we want to examine a cause-and-effect relationship, we conduct an experiment. If an experiment is well-designed, a strong association in the data does imply causation, since any possible lurking variables are controlled.

Principles of Experimental Design: 1. Control the effects of lurking variables by comparing several treatments (include a control group if possible/applicable). 2. Use randomization to assign subjects/units to treatments. Without randomization, we do not have a valid experiment and will not be able to draw conclusions from your study. 3. Replicate the experiment on many subjects/units to reduce chance variation in the results. If the experimental group is not representative of the population of interest, we may need to replicate the entire experiment for different groups in different places and/or at different times.

An effect is called statistically significant if it is too great to be caused simply by chance.

Even a well-designed experiment can contain hidden bias, so it is extremely important to handle the subjects/units in exactly the same way. One way to avoid hidden bias is to conduct a blind experiment. In a double-blind experiment, neither the subjects nor the people who have contact with them know which treatment a subject has received.

Types of Experimental Design: In a completely randomized design, all subjects are randomly assigned to treatment groups. In a block design, subjects are first split into groups called blocks. Subjects within each block have some common characteristic (for example: gender, age, education, ethnicity, etc.) Then, within each block, subjects are randomly assigned to treatment groups. In a matched pairs design , there are only two treatments. In each block, there is either: a single_subject receiving both treatments or a pair of_subjects each receiving a different_treatment.

Lurking and Confounding Variables: A lurking variable creates an association between two other variables that tempts us to think that one may cause the other. A lurking variable is usually thought of as a prior cause of both y and x that makes it appear that x may be causing y.

Confounding can arise in experiments when some other variables associated with a factor have an effect on the response variable. Unlike a lurking variable, a confounding variable is associated in a noncausal way with a factor and affects the response. Because of the confounding, we find that we can’t tell whether any effect we see was caused by our factor or by the confounding factor (or by both working together).