Causal Reasoning Inductive because it is limited by our inability to know (1) all of the relevant causes, and (2) the ways in which these causes interact.

Slides:



Advertisements
Similar presentations
Introduction to Psychology
Advertisements

1 Hypothesis Testing Chapter 8 of Howell How do we know when we can generalize our research findings? External validity must be good must have statistical.
Psychology: A Modular Approach to Mind and Behavior, Tenth Edition, Dennis Coon Appendix Appendix: Behavioral Statistics.
Table of Contents Exit Appendix Behavioral Statistics.
The Ways and Means of Psychology STUFF YOU SHOULD ALREADY KNOW BY NOW IF YOU PLAN TO GRADUATE.
Critical Thinking: Chapter 10
Critical Thinking.
HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.
2.6 The Question of Causation. The goal in many studies is to establish a causal link between a change in the explanatory variable and a change in the.
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
Chapter 10 - Part 1 Factorial Experiments.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Overview of Lecture Between Group & Within Subjects Designs Mann-Whitney Test.
Richard M. Jacobs, OSA, Ph.D.
+ Chapter 4 Designing Studies 4.1Samples and Surveys 4.2Experiments 4.3Using Studies Wisely.
Statistics: Unlocking the Power of Data Lock 5 Hypothesis Testing: Hypotheses STAT 101 Dr. Kari Lock Morgan SECTION 4.1 Statistical test Null and alternative.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 3 Correlation and Prediction.
A P STATISTICS LESSON 9 – 1 ( DAY 1 ) SAMPLING DISTRIBUTIONS.
Qualitative Studies: Case Studies. Introduction l In this presentation we will examine the use of case studies in testing research hypotheses: l Validity;
Statistics 11 Hypothesis Testing Discover the relationships that exist between events/things Accomplished by: Asking questions Getting answers In accord.
Chapter 2 Psychology: Research Methods and Critical Thinking.
BPS - 3rd Ed. Chapter 141 Tests of Significance: The Basics.
Understanding Statistics
RESEARCH STRATEGIES. A. Scientific Method: 1. Begin with theory 2. Develop hypothesis – the testable prediction 3. Description – gather information about.
Psychology’s Statistics Statistical Methods. Statistics  The overall purpose of statistics is to make to organize and make data more meaningful.  Ex.
Research & Statistics Looking for Conclusions. Statistics Mathematics is used to organize, summarize, and interpret mathematical data 2 types of statistics.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Essential Statistics Chapter 131 Introduction to Inference.
Inductive Generalizations Induction is the basis for our commonsense beliefs about the world. In the most general sense, inductive reasoning, is that in.
Copyright © Allyn & Bacon 2006 by Pearson Education. Reproduced by permission of the publisher. Further reproduction is prohibited without written permission.
LT 4.2 Designing Experiments Thanks to James Jaszczak, American Nicaraguan School.
Research Process Parts of the research study Parts of the research study Aim: purpose of the study Aim: purpose of the study Target population: group whose.
Agresti/Franklin Statistics, 1 of 56  Section 4.3 What Are Good Ways and Poor Ways to Experiment?
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Causal Reasoning Inductive because it is limited by our inability to know (1) all of the relevant causes, and (2) the ways in which these causes interact.
Warm-Up.
Research Methods in Psychology. Laboratory Field Internet Experimental Designs Randomization Manipulation Control Sample Population Independent Experimental.
Chapter 2 Doing Sociological Research Key Terms. scientific method Involves several steps in research process, including observation, hypothesis testing,
BPS - 3rd Ed. Chapter 141 Tests of significance: the basics.
Hypothesis Testing An understanding of the method of hypothesis testing is essential for understanding how both the natural and social sciences advance.
INDUCTIVE LOGIC DEDUCTION= DRAWING OUT IMPLICIT “KNOWLEDGE” OR CLAIMS FROM PREMISES. INDUCTION= EXPANDING “KNOWLEDGE” BY TESTING TRUTH OF THE PREMISES.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Components of a Statistical Study Target Population: This is the group about which you want to make an overall judgment. It could be all people, voters,
Non-Experimental Design Where are the beakers??. What kind of research is considered the “gold standard” by the Institute of Education Sciences? A.Descriptive.
Invitation to Critical Thinking Chapter 12 Lecture Notes Chapter 12.
Inferential Statistics Inferential statistics allow us to infer the characteristic(s) of a population from sample data Slightly different terms and symbols.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Graduate School for Social Research Autumn 2015 Research Methodology and Methods of Social Inquiry socialinquiry.wordpress.com Causality.
Chapter Two Methods in the Study of Personality. Gathering Information About Personality Informal Sources of Information: Observations of Self—Introspection,
Philosophy 104 Chapter 8 Notes (Part 1). Induction vs Deduction Fogelin and Sinnott-Armstrong describe the difference between induction and deduction.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Organizing and Analyzing Data. Types of statistical analysis DESCRIPTIVE STATISTICS: Organizes data measures of central tendency mean, median, mode measures.
Section 4.3 Using Studies Wisely By: Michelle Rondilla & Alexander Hasson Period 4.
Producing Data: Experiments BPS - 5th Ed. Chapter 9 1.
Research Design Vocabulary
Research: Analyzing the Data Now that data has been gathered from a correlational, descriptive, or experimental research method, it’s time to analyze.
Unit 4: Gathering Data LESSON 4-4 – EXPERIMENTAL STUDIES ESSENTIAL QUESTION: WHAT ARE GOOD WAYS AND POOR WAYS TO EXPERIMENT?
Inferential Statistics Psych 231: Research Methods in Psychology.
Experimental Research
CHAPTER 4 Designing Studies
Critical Thinking Lecture 13 Inductive arguments
Inductive Argument Forms
Chapter 4: Inductive Arguments
Chapter 8 Inductive Reasoning.
Chapter 12 Power Analysis.
Basic Practice of Statistics - 3rd Edition Introduction to Inference
10/28/ B Experimental Design.
Presentation transcript:

Causal Reasoning Inductive because it is limited by our inability to know (1) all of the relevant causes, and (2) the ways in which these causes interact Inductive because it is limited by our inability to know (1) all of the relevant causes, and (2) the ways in which these causes interact We can address uncertainty by speaking not of CAUSES, but of CAUSAL FACTORS We can address uncertainty by speaking not of CAUSES, but of CAUSAL FACTORS Main danger to avoid is the Post Hoc fallacy: inferring that X caused Y because it happened prior to Y. This creates a False Cause. Main danger to avoid is the Post Hoc fallacy: inferring that X caused Y because it happened prior to Y. This creates a False Cause.

Mill’s Methods for Analyzing Causes Method of Agreement: look for common factor in all cases where the effect is present Method of Agreement: look for common factor in all cases where the effect is present Method of Difference: look for factor that is present when the effect occurs, and absent when the effect does not occur Method of Difference: look for factor that is present when the effect occurs, and absent when the effect does not occur Joint Method: combination of Agreement and Difference Joint Method: combination of Agreement and Difference Method of Concomitant Variation: used when effect comes in degrees; look for a factor that varies along with effect (correlation) Method of Concomitant Variation: used when effect comes in degrees; look for a factor that varies along with effect (correlation)

Correlation A correlation is a (statistical) measurement of the association of two variables. A correlation is a (statistical) measurement of the association of two variables. Positive Correlation: As one variable increases, the other increases. (Examples: cigarette smoking and lung cancer; education and income; unemployment and homelessness) Positive Correlation: As one variable increases, the other increases. (Examples: cigarette smoking and lung cancer; education and income; unemployment and homelessness) Negative Correlation: As one variable increases, the other decreases. (Examples: caffeine intake and sleep; age and working memory capacity; stress and life expectancy) Negative Correlation: As one variable increases, the other decreases. (Examples: caffeine intake and sleep; age and working memory capacity; stress and life expectancy)

Identifying and Assessing Correlations Correlations are identified by: r=. Correlations are identified by: r=. Correlations range between -1 and 1; positive numbers identify positive correlation, negative numbers identify negative correlation. r=0 is no correlation. Correlations range between -1 and 1; positive numbers identify positive correlation, negative numbers identify negative correlation. r=0 is no correlation. The further away from 0 the correlation is, the more strongly the variables are related. Correlations above.5 or below -.5 are strong correlations; correlations between.2 and.5 (or -.2 and -.5) are moderate correlations. The further away from 0 the correlation is, the more strongly the variables are related. Correlations above.5 or below -.5 are strong correlations; correlations between.2 and.5 (or -.2 and -.5) are moderate correlations. r 2 will give us the percentage of difference in one variable that is due to difference in the other. (Example: if the correlation between smoking and lung cancer is.7, 49% of differences in lung cancer rates are due to differences in smoking levels.) r 2 will give us the percentage of difference in one variable that is due to difference in the other. (Example: if the correlation between smoking and lung cancer is.7, 49% of differences in lung cancer rates are due to differences in smoking levels.)

2 Basic Forms of Statistical Reasoning Statistical Syllogism: x% of A is B; p is an A; therefore p is a B (to x% likelihood). (Example: 86% of college students are broke. Fred is a college student, so it’s pretty likely that he’s broke.) Statistical Syllogism: x% of A is B; p is an A; therefore p is a B (to x% likelihood). (Example: 86% of college students are broke. Fred is a college student, so it’s pretty likely that he’s broke.) Inductive Generalization: x% of known As are Bs; therefore x% of As are Bs. (Example: Almost all of the students in this logic class hated the Deductive Reasoning assignment. Thus, I should expect that almost all students in any logic class would hate that assignment.) Inductive Generalization: x% of known As are Bs; therefore x% of As are Bs. (Example: Almost all of the students in this logic class hated the Deductive Reasoning assignment. Thus, I should expect that almost all students in any logic class would hate that assignment.)

Components of a Statistical Study Target Population: This is the group about which you want to make an overall judgment. It could be all people, voters, college students, etc. Target Population: This is the group about which you want to make an overall judgment. It could be all people, voters, college students, etc. Sample (or Experimental) Group: This is the group studied or experimented upon to get information used to infer claims about the Target Population. Sample (or Experimental) Group: This is the group studied or experimented upon to get information used to infer claims about the Target Population. Control Group: Needed whenever one is looking for differences between groups; this group serves as an “anchor” against which to evaluate the Experimental Group. The Control Group helps to weed out spurious results. (Example: If you want to see if viewing pornography alters perceptions about women, you need a Control Group that takes the same questionnaire but does not view pornography beforehand.) Control Group: Needed whenever one is looking for differences between groups; this group serves as an “anchor” against which to evaluate the Experimental Group. The Control Group helps to weed out spurious results. (Example: If you want to see if viewing pornography alters perceptions about women, you need a Control Group that takes the same questionnaire but does not view pornography beforehand.)

Sample Size Indicated by: N=. (Also sometimes ss=.) Indicated by: N=. (Also sometimes ss=.) Good statistical studies should tell you both (1) how many subjects one has overall, and (2) how many subjects are in each group. Good statistical studies should tell you both (1) how many subjects one has overall, and (2) how many subjects are in each group. Sample size gives us information about how well results can be generalized from the Sample Group to the Target Group. The larger, the better. Sample size gives us information about how well results can be generalized from the Sample Group to the Target Group. The larger, the better. This is because in large samples, extreme and otherwise unrepresentative cases are more likely to be balanced off. This is because in large samples, extreme and otherwise unrepresentative cases are more likely to be balanced off.

Hasty Generalization Small or atypical sample sizes lead to the fallacy of Hasty Generalization. Small or atypical sample sizes lead to the fallacy of Hasty Generalization. The Hasty Generalization involves inferring claims about the Target Group from the Sample Group that lack sufficient support. The Hasty Generalization involves inferring claims about the Target Group from the Sample Group that lack sufficient support.

Sample Diversity Sample Diversity is important because it (1) helps to balance off extreme or unrepresentative cases, and (2) reduces the likelihood that the study reflects the researcher’s biases. Sample Diversity is important because it (1) helps to balance off extreme or unrepresentative cases, and (2) reduces the likelihood that the study reflects the researcher’s biases. Representative Sample: sampling picked to match, as closely as possible, the actual distribution of traits in the Target Population. Representative Sample: sampling picked to match, as closely as possible, the actual distribution of traits in the Target Population. Random Sample: sampling based on some arbitrary and irrelevant criterion. Random Sample: sampling based on some arbitrary and irrelevant criterion.

Statistical Significance Indicated by: p= ( ); this is a measurement of how likely it is that the results of the experiment are due to chance factors. Indicated by: p= ( ); this is a measurement of how likely it is that the results of the experiment are due to chance factors. This is NOT ‘significant’ in the sense of ‘large’, NOR in the sense of ‘important’. This is NOT ‘significant’ in the sense of ‘large’, NOR in the sense of ‘important’. Researchers usually declare a finding statistically significant if p <.05. Researchers usually declare a finding statistically significant if p <.05.

Statistical Significance Continued Failing to attain a statistically significant result should not necessarily be viewed as a failure. The finding that two groups do NOT differ in a reliable way (affirming the Null Hypothesis) can be a highly important finding. Failing to attain a statistically significant result should not necessarily be viewed as a failure. The finding that two groups do NOT differ in a reliable way (affirming the Null Hypothesis) can be a highly important finding. Statistical Significance is linked to the importance of replication in scientific experimentation. A study with p=.05 is still 5% likely to have its results due to chance. Think of Significance as a claim on the likelihood that repetition will produce the same results, and replication as a test of this contention. Statistical Significance is linked to the importance of replication in scientific experimentation. A study with p=.05 is still 5% likely to have its results due to chance. Think of Significance as a claim on the likelihood that repetition will produce the same results, and replication as a test of this contention.

Margin of Error Margin of Error: this is a measurement of variability in the sample. A standard margin of error for well-conducted surveys and polls is +/- 2 to 3%. This will give us the range of the study. (Example: if a study shows that 51% of IVCC students prefer Coke to Pepsi, with a margin of error of 3%, this means that between % of IVCC students prefer Coke to Pepsi.) Margin of Error: this is a measurement of variability in the sample. A standard margin of error for well-conducted surveys and polls is +/- 2 to 3%. This will give us the range of the study. (Example: if a study shows that 51% of IVCC students prefer Coke to Pepsi, with a margin of error of 3%, this means that between % of IVCC students prefer Coke to Pepsi.)

Base-Rate Data Base-Rate Data is information that tells you how prevalent some trait is within the general population, or how likely the occurrence of some event is independently of what we do. Base-Rate Data is information that tells you how prevalent some trait is within the general population, or how likely the occurrence of some event is independently of what we do. This is crucial when you are checking for causal factors for ruling out spurious causes. This is crucial when you are checking for causal factors for ruling out spurious causes. Example #1: Freud’s “It Works!” Argument Example #1: Freud’s “It Works!” Argument Example #2: John Hinckley’s brain Example #2: John Hinckley’s brain Example #3: Post-9/11 airport security Example #3: Post-9/11 airport security

Other Guidelines for Evaluating Statistical and Demographic Data Date of Study: While older studies can still have cogent results, in many cases new research (and new methodologies) may have invalidated the previous results. Date of Study: While older studies can still have cogent results, in many cases new research (and new methodologies) may have invalidated the previous results. Author and Sponsor of Study: Is the study being produced by (or funded by) someone with a stake in how the results turn out? This can increase the likelihood that biased research methods were used. Author and Sponsor of Study: Is the study being produced by (or funded by) someone with a stake in how the results turn out? This can increase the likelihood that biased research methods were used. Publication Conditions: Studies published in peer reviewed journals have their findings analyzed by other experts in the field, some of whom disagree with the author. Beware of studies that are neither peer reviewed or reviewed only within an organization. Publication Conditions: Studies published in peer reviewed journals have their findings analyzed by other experts in the field, some of whom disagree with the author. Beware of studies that are neither peer reviewed or reviewed only within an organization.

Analogies Analogies are prevalent in literature, philosophy, religion and law Analogies are prevalent in literature, philosophy, religion and law In literature and religion, they are often present as comparisons, metaphors and parables. In literature and religion, they are often present as comparisons, metaphors and parables. In law, they are typically present as precedents and hypothetical cases In law, they are typically present as precedents and hypothetical cases In philosophy, they are typically present as thought experiments (“intuition pumps”) In philosophy, they are typically present as thought experiments (“intuition pumps”) Analogies are even present in science—esp. in scientific discovery and in science education Analogies are even present in science—esp. in scientific discovery and in science education

Steps for Analyzing an Analogy (Simplified) Clarify the terms of comparison Clarify the terms of comparison Identify the principle or characteristic that is being applied Identify the principle or characteristic that is being applied Identify relevant similarities (False analogies rely on trivial similarities.) Identify relevant similarities (False analogies rely on trivial similarities.) Identify relevant differences Identify relevant differences Weigh up relative strength of similarities and differences to reach a final assessment of strength Weigh up relative strength of similarities and differences to reach a final assessment of strength

Example Iraq is the new Vietnam. In both cases, our enemy is some nebulous, indefinable entity (communism, terrorism). In both cases we lost many American lives from insurgency for which we were unprepared. Both wars seem like futile endeavors with no hope for success. In each case, we lacked support for the war, both at home and abroad. Presidents Johnson and Nixon both escalated the war in Vietnam in response to popular dissent; President Bush has responded to popular dissent by sending more troops. Mission creep in Vietnam led us to invade Cambodia; the Bush administration has been talking about expanding the Iraq war into Iran or Jordan. History’s verdict on the Vietnam War is clear: it was an unjustifiable act of aggression. Shouldn’t we view the Iraq war in the same way? Iraq is the new Vietnam. In both cases, our enemy is some nebulous, indefinable entity (communism, terrorism). In both cases we lost many American lives from insurgency for which we were unprepared. Both wars seem like futile endeavors with no hope for success. In each case, we lacked support for the war, both at home and abroad. Presidents Johnson and Nixon both escalated the war in Vietnam in response to popular dissent; President Bush has responded to popular dissent by sending more troops. Mission creep in Vietnam led us to invade Cambodia; the Bush administration has been talking about expanding the Iraq war into Iran or Jordan. History’s verdict on the Vietnam War is clear: it was an unjustifiable act of aggression. Shouldn’t we view the Iraq war in the same way?