On the causal interpretation of statistical models in social research Alessio Moneta & Federica Russo.

Slides:



Advertisements
Similar presentations
Levels of causation and the interpretation of probability Seminar 2 Federica Russo Philosophy, Louvain & Kent.
Advertisements

Evidence for Probabilistic Hypotheses: With Applications to Causal Modeling Malcolm R. Forster Department of Philosophy University of Wisconsin-Madison.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Correlation and regression Dr. Ghada Abo-Zaid
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 12 Measures of Association.
FUNDAMENTAL RESEARCH ISSUES © 2012 The McGraw-Hill Companies, Inc.
PHSSR IG CyberSeminar Introductory Remarks Bryan Dowd Division of Health Policy and Management School of Public Health University of Minnesota.
Causality, Mechanisms and Modularity: Structural Models in Econometrics Damien Fennell Centre for the Philosophy of Natural and Social Science London School.
A non-manipulationist account of inviariance Federica Russo Philosophy, Kent.
Building and Testing a Theory Steps Decide on what it is you want to explain or predict. 2. Identify the variables that you believe are important.
Empirical Analysis Doing and interpreting empirical work.
Mechanistic evidence for causal inference Phyllis Illari University of Kent Disambiguating the RWT.
Experimental Design, Statistical Analysis CSCI 4800/6800 University of Georgia Spring 2007 Eileen Kraemer.
Mediating Between Causes and Probabilities: the Use of Graphical Models in Econometrics Alessio Moneta Max Planck Institute of Economics, Jena, and Sant’Anna.
Chapter Two SCIENTIFIC METHODS IN BUSINESS
Kent Where causal dualism comes from Monika Koeppl Causality, Cognition and the Constitution of Scientific Phenomena Department of Philosophy University.
Business 205. Review of Previous Class Milestone #1 Groups Math Review Symbolic Manipulation Excel Review.
TOOLS OF POSITIVE ANALYSIS
Reliability and Validity. Criteria of Measurement Quality How do we judge the relative success (or failure) in measuring various concepts? How do we judge.
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
Measuring variations Causality and causal modelling in the social sciences Federica Russo Philosophy, Louvain & Kent.
Research Methods AP Psych – Chapter 2 Psychology’s Scientific Method
© 2011 The McGraw-Hill Companies, Inc. Chapter 2 Psychology’s Scientific Method.
Econometrics: The empirical branch of economics which utilizes math and statistics tools to test hypotheses. Special courses are taught in econometrics,
“I often say that when you can measure what you are speaking about, and express it in numbers, you know something about it” Lord William Thomson, 1st.
Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition, or past practice. The importance.
1 Basic Definitions Greg C Elvers, Ph.D.. 2 Statistics Statistics are a set of tools that help us to summarize large sets of data data -- set of systematic.
I/O Psychology Research Methods. What is Science? Science: Approach that involves the understanding, prediction, and control of some phenomenon of interest.
The Research Process Fun and Excitement for Economics Majors!!!
1.
Role of Statistics in Geography
© 2011 The McGraw-Hill Companies, Inc. with snazzy editions by Mrs. Short Chapter 2 Psychology’s Scientific Method.
Between groups designs (2) – outline 1.Block randomization 2.Natural groups designs 3.Subject loss 4.Some unsatisfactory alternatives to true experiments.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Developing and Evaluating Theories of Behavior.
Basic Concepts of Correlation. Definition A correlation exists between two variables when the values of one are somehow associated with the values of.
Ch. 2 Tools of Positive Economics. Theoretical Tools of Public Finance theoretical tools The set of tools designed to understand the mechanics behind.
STUDYING BEHAVIOR © 2009 The McGraw-Hill Companies, Inc.
May 2004 Prof. Himayatullah 1 Basic Econometrics Chapter 7 MULTIPLE REGRESSION ANALYSIS: The Problem of Estimation.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
Reasoning in Psychology Using Statistics Psychology
Evidence-Based Practice Evidence-Based Practice Current knowledge and practice must be based on evidence of efficacy rather than intuition, tradition,
CORRELATIONS: PART II. Overview  Interpreting Correlations: p-values  Challenges in Observational Research  Correlations reduced by poor psychometrics.
S-005 Types of research in education. Types of research A wide variety of approaches: –Theoretical studies –Summaries of studies Reviews of the literature.
Graduate School for Social Research Autumn 2015 Research Methodology and Methods of Social Inquiry socialinquiry.wordpress.com Causality.
EPSE 592 Experimental Designs and Analysis in Educational Research
Jump to first page Inferring Sample Findings to the Population and Testing for Differences.
Chapter 1 Introduction to Research in Psychology.
How Psychologists Do Research Chapter 2. How Psychologists Do Research What makes psychological research scientific? Research Methods Descriptive studies.
Causality and Identification in Structural Econometrics Causality and Probability in the Sciences University of Kent, Canterbury September Damien.
Regression Line  R 2 represents the fraction of variation in the data (regression line)
Data Analysis. Qualitative vs. Quantitative Data collection methods can be roughly divided into two groups. It is essential to understand the difference.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
Causal truthmakers vs Causal interpretations Federica Russo Philosophy, Kent.
Reliability and Validity
Chapter 2: TWO-VARIABLE REGRESSION ANALYSIS: Some basic Ideas
BASIC ECONOMETRICS.
Quantitative methods Lecture 1.
Statistics for Psychology
© 2011 The McGraw-Hill Companies, Inc.
Jez Echevarría 6th September 2013
Reasoning in Psychology Using Statistics
How Psychologists Do Research
Chapter 10 Correlation and Regression
Developing and Evaluating Theories of Behavior
Positive analysis in public finance
Chapter 15 Multiple Regression.
Presentation transcript:

On the causal interpretation of statistical models in social research Alessio Moneta & Federica Russo

The dawn of history of causal modelling Staunch causalists Quetelet, Durkheim, Wright …, Blalock, Duncan, … Moderate skeptics Pearl, Heckman, Hoover, … … and the evergreen question: When and how can we draw causal conclusions from statistics? 2

This presentation Alessio Statistical vs Causal Information Associational vs Causal Models Federica Interpreting statistical models causally: – Truthmakers vs Validity – Epistemic way out 3

Important distinction (1) Associational models Causal models

5

Example Associational model: Engel curves: measure of the dependence of expenditure (Y) on income (X) Regression functions: Y = f (X) + e Cannot be used to sustain counterfactual Causal model: Demand system: system of equations in which consumer behaviour is modeled as based on theory of utility maximization. Estimated and tested ex post. Used to sustain counterfactuals

Important distinction (2) Statistical Information A summary of data Inferential statistics (sample to population) Adequate and parsimonious description of the phenomenon Statistical dependence Causal Information Opening the ‘black box’ From association to causation Statistical information to provide the formalised empirical evidence Background ‘constraints’ Tests 7

Statistical dependence Statistical independence: X ind. Y iff f(X,Y) = f(X) f(Y) Conditional ind.: X ind. Y given Z iff f(X,Y|Z) = f(X|Z) f(Y|Z) Measures of dependence: correlation Pearson’s correlation coefficient: Corr(X,Y) = Cov (X,Y) / [Var(X) Var (Y)] 1/2

From association to causation Background constraints: theoretical knowledge (e.g. about exogeneity) institutional mechanisms (e.g. central banks) temporal priority rules of inference (Markov and Faithfulness)

All nice but … A vicious circle introduced? Not quite … How much background knowledge? Just the right amount … Cfr. “inductivist” and “deductivist” approaches in econometrics 10

interpreting What’s interpreting a statistical model causally?

truthmakers The philosophers’ hunt for truthmakers … that is … that is, what makes a causal claim true Difference-makers Probabilistic, counterfactual, manipulation Mechanisms 12

Anything wrong with the hunt? Conceptual analysis in philosophy of causality What explicates the concept of ‘causality’ What makes causal claims true What is causality, metaphysically Conceptual analysts failed to distinguish between evidence and concept lost on the way epistemic practices 13

interpreting What’s interpreting a statistical model causally? An epistemic activity …

In the footprints of epistemic theorists Evidence and concept Evidential pluralism: difference-making and mechanistic considerations Conceptual monism: causation is an inferential map Causality: an epistemic category to interpret the world rather than a physical relation in our ontology 15

Interpreting Interpreting in causal terms … … is deciding whether a model is valid or not Making successful inferences Not merely dependent on the physical existence of mechanisms Mechanisms have explanatory import Mechanistic and difference-making evidential components are tangled 16

The causal interpretation is model-dependent Causal conclusions depend on the statistical information and machinery from which they are inferred Not a bad thing after all Causation is not a ‘all or nothing’ affair Nor a ‘once and for all’ affair 17

18