Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? 1234567 Don’t Delicious like.

Slides:



Advertisements
Similar presentations
PhD Research Seminar Series: Valid Research Designs
Advertisements

Agenda Group Hypotheses Validity of Inferences from Research Inferences and Errors Types of Validity Threats to Validity.
Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.
Variance in Research Design Sources, threats to internal validity, and “Noise”
Inadequate Designs and Design Criteria
GROUP-LEVEL DESIGNS Chapter 9.
The Basics of Experimentation I: Variables and Control
Between- vs. Within-Subjects Designs
Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs.
©2005, Pearson Education/Prentice Hall CHAPTER 5 Experimental Strategies.
Questions  Is Exam 2 going to be cumulative or will it just cover the second part of the information?  Are cause-and-effect relationships the same as.
Correlation AND EXPERIMENTAL DESIGN
Jeff Beard Lisa Helma David Parrish Start Presentation.
EXPERIMENTAL DESIGNS Criteria for Experiments
CHAPTER 8 EXPERIMENTAL DESIGN.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Reliability and Validity in Experimental Research ♣
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Lecture 10 Psyc 300A. Types of Experiments Between-Subjects (or Between- Participants) Design –Different subjects are assigned to each level of the IV.
Using Between-Subjects and Within-Subjects Experimental Designs
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 4 Choosing a Research Design.
Criteria for Establishing Causal Relationships Concomitant variation Temporal ordering of variables Control over other possible causal factors.
Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.
Experimental Research
Experimental Research
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Chapter 8 Experimental Research
Statistical Analyses & Threats to Validity
PSYC2030 Exam Review #2 March 13th 2014.
Applying Science Towards Understanding Behavior in Organizations Chapters 2 & 3.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Choosing a Research Design.
Variation, Validity, & Variables Lesson 3. Research Methods & Statistics n Integral relationship l Must consider both during planning n Research Methods.
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Final Study Guide Research Design. Experimental Research.
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Experimental Research Validity and Confounds. What is it? Systematic inquiry that is characterized by: Systematic inquiry that is characterized by: An.
ECON ECON Health Economic Policy Lab Kem P. Krueger, Pharm.D., Ph.D. Anne Alexander, M.S., Ph.D. University of Wyoming.
Single-Factor Experimental Designs
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: ec6310.htm Office:
Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
1 Experimental Research Cause + Effect Manipulation Control.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Introduction section of article
Experimental Research
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Using Between-Subjects and Within- Subjects Experimental Designs.
1.) *Experiment* 2.) Quasi-Experiment 3.) Correlation 4.) Naturalistic Observation 5.) Case Study 6.) Survey Research.
Chapter 6 Research Validity. Research Validity: Truthfulness of inferences made from a research study.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.
Chapter Six: The Basics of Experimentation I: Variables and Control.
Chapter 8: Between Subjects Designs
Aim: What factors must we consider to make an experimental design?
EXPERIMENTAL DESIGNS. Categories Lab experiments –Experiments done in artificial or contrived environment Field experiments –Experiments done in natural.
Chapter Nine Primary Data Collection: Experimentation and
Experimental Research Design Causality & Validity Threats to Validity –Construct (particular to experiments) –Internal –External – already discussed.
11 Chapter 9 Experimental Designs © 2009 John Wiley & Sons Ltd.
1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.
CHOOSING A RESEARCH DESIGN
Experiments Why would a double-blind experiment be used?
Stats/Methods II JEOPARDY.
Research Methods 3. Experimental Research.
Chapter 6 Research Validity.
The Experimental Method in Psychology
Chapter 6 Research Validity.
Internal Validity - The extent to which all explanations for changes in the DV between conditions have been eliminated -- other than the IV. ie(7a)
Experiments: Part 2.
Experiments in Marketing Research: Part I
Presentation transcript:

Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like it 2. Do you think it could be low fat or regular? 1. How would you rate chip “g” from 1 - 7? 1 Don’t like it 7 Delicious 2. Is it low fat or regular?

Consumer Preference Test ______________ Design ________________ Counterbalance means... How to prevent Carryover effects?

Experimental Research Researchers manipulate independent variable - 2 levels And measure the other (dependent variable) Give treatment to participants and observe if it causes changes in behavior Compare experimental group (w/ treatment) with a control group (no treatment) Can say IV caused change in the DV

Experimental research design 1.Control extraneous variables 1.Hold constant 2.The only difference between experimental group and control group is the manipulated variable. 1.Treat groups equally except for treatment. 3.Randomize effects across treatments 4.Design to eliminate alternative explanations

Random Assignment –A way to assign participants in your sample to the various treatment conditions (groups that will receive different level of the IV) –Any member of your sample has equal chance of being assigned in any treatment group

Control Variable The variable you want to keep constant in order to clarify the relationship between Dependent Variable and Independent Variable “Confounding” variable (if not controlled)

Internal Validity Ability of your research design to adequately test your hypothesis Showing that variation in I.V. CAUSED the variation in the D.V. in experiment In correlational study, Showing that changes in value of criterion variable relate solely to changes in value of predictor variable

Question: Does new teaching method work better than traditional method in intro psych course? Method: Teaches class in morning using new method. Teaches afternoon class using traditional method. Both classes will use same book, tests, etc. Example

Findings Results: Students exposed to new method have higher grades. Concludes: New method better. Justified? Why or why not?

Confounding Whenever 2 or more variables combine in a way that their effects cannot be separated = confounding. Thus, the teaching method study as designed lacks internal validity.

Dr. “Lee’s” study Geography dept. had 10 Mac computers for their students to use Anthro. dept. had 10 IBM-type pc computers. Research question: How does the type of computer affect the quality of students’ papers? Collected papers from each department’s student computer lab

Method: Two graduate students in the English dept. rated the quality of the papers. Results: the quality of the papers was higher in one department than in the other. What can you conclude?

What are the independent variables in this study? What are the dependent variables? What variables are confounded with the independent variable? Does this study have internal validity? Explain. Does study have much external validity?

Threats to Internal Validity -- 7 Sources of Confounding Campbell & Stanley (1963) History –Other events occur that affect results Maturation –Effect of age or fatigue Testing

Threats to validity continued Instrumentation –Changes in criteria used by observers or –instrument - (is scale set to 0?) Statistical regression –If participants selected cause of extreme scores, will tend to be closer to average of pop. upon re-measure.

Threats to internal validity cont. Biased selection of subjects –If participants differ in ways that affect their scores on DV Experimental mortality –People drop out of study due to frustration, … those that remain differ than drop outs.

Within-Subjects/ Groups Design Repeated measures Each participant’s performance is measured under Treatment A and again under Treatment B Advantages reduce error from variation in participants Disadvantages - attrition, carryover effects

Matched random assignment When participant characteristics correlate w/ Dependent Variable –Assess the participants for the characteristics –Group participants w/ matching characteristics. Matched sets of participants distributed at random, one per group. Advantages Effect of error , effect of characteristic distributed evenly across treatments.

Carryover effects Previous treatment alters the behavior observed in subsequent treatment Sources –learning –fatigue –habituation - repeated exposure -- reduced responsiveness To  effect - (breaks between treatments, change treatment order)