Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs.

Slides:



Advertisements
Similar presentations
Andrea M. Landis, PhD, RN UW LEAH
Advertisements

Experimental and Quasi-Experimental Research
Variance in Research Design Sources, threats to internal validity, and “Noise”
Non-experimental Designs
GROUP-LEVEL DESIGNS Chapter 9.
Experimental Research Designs
Research Design and Validity Threats
QUASI-EXPERIMENTS w Compare subjects in different conditions on a DV w Lacks one or more criteria for an experiment (cause, comparison, control) w Interpreted.
Quasi & Non-Experimental Designs
PSYC 235: Research Methods ALT DESIGN. Quasi Experiments.
Non-Experimental designs: Developmental designs & Small-N designs
QUASI-EXPERIMENTS What is a Quasi-Experiment?
Non-Experimental designs: Developmental designs & Small-N designs
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 10 Using Specialized Research Designs.
Questions What is the best way to avoid order effects while doing within subjects design? We talked about people becoming more depressed during a treatment.
Non-Experimental designs
Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.
9 Quantitative Research Designs.
Chapter 9 Experimental Research Gay, Mills, and Airasian
Problem identification Research questions Constructs & Variables Research design.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Non-true-experimental Designs, cont. PSY 231 Research Methods in Psychology.
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Experimental Design The Gold Standard?.
Research Design Methodology Part 1. Objectives  Qualitative  Quantitative  Experimental designs  Experimental  Quasi-experimental  Non-experimental.
I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.
I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.
Experimental and Quasi-Experimental Designs
Chapter 12: Quasi-Experimental Designs
I want to test a wound treatment or educational program in my clinical setting with patient groups that are convenient or that already exist, How do I.
Quantitative Research Designs
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Day 6: Non-Experimental & Experimental Design
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Research methods in adult development
Learning Objectives Copyright © 2004 John Wiley & Sons,Inc Primary Data Collection: Experimentation CHAPTER Seven.
SINGLE - CASE, QUASI-EXPERIMENT, AND DEVELOPMENT RESEARCH © 2012 The McGraw-Hill Companies, Inc.
Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
Copyright ©2008 by Pearson Education, Inc. Pearson Prentice Hall Upper Saddle River, NJ Foundations of Nursing Research, 5e By Rose Marie Nieswiadomy.
Group Quantitative Designs First, let us consider how one chooses a design. There is no easy formula for choice of design. The choice of a design should.
Chapter Four Experimental & Quasi-experimental Designs.
1 Experimental Research Cause + Effect Manipulation Control.
Introduction section of article
Quantitative Research SPED 500 Dr. Sandra Beyda Designs that maximize objectivity by using numbers, statistics, structure, and experimenter control Modes.
Chapter 12 Quasi-Experimental and Single-Case Designs.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
Research Design ED 592A Fall Research Concepts 1. Quantitative vs. Qualitative & Mixed Methods 2. Sampling 3. Instrumentation 4. Validity and Reliability.
Chapter 10 Finding Relationships Among Variables: Non-Experimental Research.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Using Specialized Research Designs.
Nonexperimental and Quasi- Experimental Designs Distinction is the degree of control over internal validity.
Quasi Experimental and single case experimental designs
1 Module 3 Designs. 2 Family Health Project: Exercise Review Discuss the Family Health Case and these questions. Consider how gender issues influence.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
Types of Experimental Designs (Educational research) True Experimental Quasi-Experimental.
Non-Experimental designs Psych 231: Research Methods in Psychology.
Experimental and Ex Post Facto Designs
CJ490: Research Methods in Criminal Justice UNIT #4 SEMINAR Professor Jeffrey Hauck.
1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.
Research designs Research designs Quantitative Research Designs.
Experimental Research Designs. Experimental Design Advantages  Best establishes cause-and-effect relationships Disadvantages  Artificiality of experiments.
Practical Research: Planning and Design, Ninth Edition Paul D. Leedy and Jeanne Ellis Ormrod © 2010 Pearson Education, Inc. All rights reserved. 1 Chapter.
EXPERIMENTAL RESEARCH
The Non-Experimental and Quasi- Experimental Strategies:
Experimental Research Designs
The Nonexperimental and Quasi-Experimental Strategies
Chapter 12 Quasi-Experimental Research: A Close Cousin to Experimental Research.
Types of Designs: R: Random Assignment of subjects to groups
Reminder for next week CUELT Conference.
Presentation transcript:

Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs produce an unambiguous cause-and-effect explanation?) Explain how the pretest scores in a pretest-posttest nonequivalent control group design help reduce this problem.. Describe the fundamental flaw that prevents a pre-post design from being a true experiment? (That is, why can’t these designs produce an unambiguous cause-and-effect explanation?) Explain how the series of observations before the treatment help reduce this problem.

The Non-Experimental and Quasi- Experimental Strategies:

Quasi-experimental design A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment.

Non and quasi experimental Difference The degree to which the research strategy limits confounding variables and controls threats to internal validity.

Two types of and n0n-experimental designs 1- Nonequivalent groups 2- Within subjects design

Nonequivalent group design Researcher cannot control variables or conditions that makes the two groups equivalent.

3 types of nonequivalent group design ( 1) the differential research design. ( 2) the posttest- only non-equivalent control group design. ( 3) the pretest– posttest nonequivalent control group design.

1- Differential research design Group differences are the primary interest not the cause an effect. Studies pre-existing groups No treatment This type of study often is called ex post facto research because it looks at differences “ after the fact;” that is, at differences that already exist between groups.

Examples Age differences Gender differences Difference between CSULB and CSULA students in their Math scores. Compare academic performance of 2 groups of high and low self esteem

2- The Posttest- Only Nonequivalent Control Group Design This type of study is occasionally called a static group comparison. Compares pre-existing groups Compares treatment with no-treatment group Example, Difference between those who take a course and those who don’t.

Other Examples Comparing 2 high schools one with a pregnancy prevention program and one without Comparing two classes after they were taught with 2 differbnt teaching methods.

3- The Pretest– Posttest Nonequivalent Control Group Design A much stronger version of the nonequivalent control group design is often called a pretest– posttest nonequivalent control group design and can be represented as follows: The addition of the pretest measurement allows researchers to address the problem of assignment bias that exists with all nonequivalent group research.

Threats to internal validity Although the addition of a pretest to the nonequivalent control group design reduces some threats to internal validity, it does not eliminate them completely. Example, Groups are equal in their pretest but not in their IQ

Within-subjects Pre-Post designs A series of observations is made over time. Collectively, such studies are known as pre–post designs.

two examples of pre–post studies: one- group pretest– posttest design the time- series design.

Threats to Internal Validity for Pre– Post Designs the five categories of time- related threats are history, instrumentation, testing effects, maturation, and statistical regression can threaten internal validity. In a pre–post design, it is impossible to counterbalance the order of treatments because we have only one treatment.

One- group pretest– posttest design Because the one- group pretest– posttest study precludes a cause- and- effect conclusion, this type of research is classified as non-experimental. example, political commercial April October

The Time- Series Design A time- series design requires a series of observations for each participant before and after a treatment or event. Thus, the series of observations allows a researcher to minimize most threats to internal validity. As a result, the time- series design is classified as quasi- experimental.

History It is possible for an external event ( history) to be a threat to internal validity EVEN in time- series designs, but only if the event occurs simultaneously with the treatment.

Single- Case Applications of Time- Series Designs Research designs that focus on a single case, rather than a group of participants, are occasionally called single-case time-series designs but are more often classified as single- subject or single- case designs.

DEVELOPMENTAL RESEARCH DESIGNS

DEVELOPMENTAL RESEARCH DESIGNS Two basic types of developmental research designs are the cross- sectional design and the longitudinal design.

The Cross- Sectional Developmental Research Design The cross- sectional developmental research design uses different groups of individuals, each group representing a different age. The different groups are measured at one point in time and then compared. Example, attitude toward the opposite gender

Strengths and Weaknesses One obvious advantage of the cross- sectional design is that a researcher can observe how behavior changes as people age without waiting for a group of participants to grow older. Saves cost of follow up

Weaknesses A researcher cannot say anything about how a particular individual develops over time because individuals are not followed over years.

Cohort Effect Example, drugs legalization Example 2, computer games Elementary High School Doctoral Example, drugs legalization Example 2, computer games

The Longitudinal Developmental Research Design. The longitudinal developmental research design examines development by observing or measuring a group of subjects over time. 4-8 8-12 12-15

Strength A major strength of the longitudinal research design is the absence of cohort effects because the researcher examines one group of people over time rather than comparing groups that represent different ages and come from different generations. Second, with longitudinal research, a researcher can discuss how a single individual’s behavior changes with age.

Weakness 1-longitudinal research is extremely time consuming, both for the participants ( it requires a big commitment to continue in the study) and the researcher.

Weakness 2- In addition, these designs are very expensive 3- These designs are subject to high dropout rates of participants. and it may weaken the internal validity of the research. 4- Testing effects (the same individuals are measured repeatedly).

Trend analysis compare the results obtained from separate samples . typically, this type of research is examining the development of phenomena other than individual aging. how drug use and lifestyle have changed over the past 30 years by returning to the same college every 10 years to measure freshman attitudes and behaviors. this research combines elements of cross- sectional and longitudinal designs.

Example, the trend of female participation in leadership positions 1970 1990 2010 Example, the trend of female participation in leadership positions