Multivariate Statistics

Slides:



Advertisements
Similar presentations
MANOVA (and DISCRIMINANT ANALYSIS) Alan Garnham, Spring 2005
Advertisements

Multivariate Statistics An Introduction & Multidimensional Contingency Tables.
Analysis by SAS Interaction Plot by Excel
MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Canonical Correlation
Multivariate Statistics Least Squares ANOVA & ANCOV Repeated Measures ANOVA Cluster Analysis.
Effects of Physical Attractiveness on Evaluations of a Male Employee’s Allegation of Sexual Harassment by His Female Employer By Karl L. Wuensch & Charles.
T RIAL PROCEDURES Chapter 2.2. C RIMINAL TRIAL PROCEDURES Step 1 – arrest of the defendant An arrest occurs when a person is deprived of his or her freedom.
Principal Components Analysis with SAS Karl L. Wuensch Dept of Psychology East Carolina University.
Chapter 17 Overview of Multivariate Analysis Methods
Writing an APA-Style Research Report Results and Discussion.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 14 Using Multivariate Design and Analysis.
Linear Discriminant Function LDF & MANOVA LDF & Multiple Regression Geometric example of LDF & multivariate power Evaluating & reporting LDF results 3.
Discrim Continued Psy 524 Andrew Ainsworth. Types of Discriminant Function Analysis They are the same as the types of multiple regression Direct Discrim.
ANCOVA Psy 420 Andrew Ainsworth. What is ANCOVA?
19-1 Chapter Nineteen MULTIVARIATE ANALYSIS: An Overview.
Lecture 9: One Way ANOVA Between Subjects
CSE 300: Software Reliability Engineering Topics covered: Software metrics and software reliability Software complexity and software quality.
MANOVA LDF & MANOVA Geometric example of MANVOA & multivariate power MANOVA dimensionality Follow-up analyses if k > 2 Factorial MANOVA.
What Is Multivariate Analysis of Variance (MANOVA)?
1 1 Slide © 2015 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Discriminant Analysis Testing latent variables as predictors of groups.
Two-Way Balanced Independent Samples ANOVA Overview of Computations.
Business Research Methods William G. Zikmund Chapter 24 Multivariate Analysis.
Multivariate Statistics Principal Components/Factor Analysis Structural Equation Modeling.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
Multivariate Data Analysis Chapter 8 - Canonical Correlation Analysis.
Discriminant Function Analysis Basics Psy524 Andrew Ainsworth.
بسم الله الرحمن الرحیم.. Multivariate Analysis of Variance.
Chapter Eighteen Discriminant Analysis Chapter Outline 1) Overview 2) Basic Concept 3) Relation to Regression and ANOVA 4) Discriminant Analysis.
Business Research Methods William G. Zikmund Chapter 24 Multivariate Analysis.
Tests and Measurements Intersession 2006.
Two-Way Balanced Independent Samples ANOVA Computations.
MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Street Law Criminal Law Mr. Bach Government. Criminal Law Prosecution v. Defendant Prosecution v. Defendant – Crime against the general public Prosecutor.
Multiple Regression. Multiple Regression  Usually several variables influence the dependent variable  Example: income is influenced by years of education.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
Canonical Correlation/Regression. AKA multiple, multiple regression AKA multivariate multiple regression Have two sets of variables (Xs and Ys) Create.
Complex Analytic Designs. Outcomes (DVs) Predictors (IVs)1 ContinuousMany Continuous1 CategoricalMany Categorical None(histogram)Factor Analysis: PCA,
Available at Chapter 13 Multivariate Analysis BCB 702: Biostatistics
17-1 COMPLETE BUSINESS STATISTICS by AMIR D. ACZEL & JAYAVEL SOUNDERPANDIAN 6 th edition (SIE)
Department of Cognitive Science Michael J. Kalsher Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 Regression 1 PSYC 4310/6310 Advanced Experimental.
Which of the five types of crimes are shown in the pie chart? Bell Ringer.
Adjusted from slides attributed to Andrew Ainsworth
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
Multivariate Data Analysis Chapter 1 - Introduction.
Review for Final Examination COMM 550X, May 12, 11 am- 1pm Final Examination.
ANCOVA. What is Analysis of Covariance? When you think of Ancova, you should think of sequential regression, because really that’s all it is Covariate(s)
Multivariate Analysis: Analysis of Variance
MANOVA One-Way. MANOVA This is just a DFA in reverse. You predict a set of continuous variables from one or more grouping variables. Often used in an.
MANOVA Factorial. The Beautiful Criminal Wuensch, Chia, Castellow, Chuang, & Cheng (1993) Data collected in Taiwan Grouping variables –Defendant physically.
Two-Group Discriminant Function Analysis. Overview You wish to predict group membership. There are only two groups. Your predictor variables are continuous.
 Seeks to determine group membership from predictor variables ◦ Given group membership, how many people can we correctly classify?
Discriminant Function Analysis Mechanics. Equations To get our results we’ll have to use those same SSCP matrices as we did with Manova.
ANCOVA.
Unit 7 Statistics: Multivariate Analysis of Variance (MANOVA) & Discriminant Functional Analysis (DFA) Chat until class starts.
Chapter 8 Relationships Among Variables. Outline What correlational research investigates Understanding the nature of correlation What the coefficient.
D/RS 1013 Discriminant Analysis. Discriminant Analysis Overview n multivariate extension of the one-way ANOVA n looks at differences between 2 or more.
MANOVA Lecture 12 Nuance stuff Psy 524 Andrew Ainsworth.
Michael J. Kalsher PSYCHOMETRICS MGMT 6971 Regression 1 PSYC 4310 Advanced Experimental Methods and Statistics © 2014, Michael Kalsher.
Most research on race in the courtroom now centers around modern racism. Today, racism is loaded with social stigma. It is no longer socially acceptable.
Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.
Multiple Regression.
Multiple Regression.
Multivariate Statistics
Multivariate Statistics
Chapter 13 Group Differences
Chapter_19 Factor Analysis
Multivariate Analysis: Analysis of Variance
Presentation transcript:

Multivariate Statistics Discriminant Function Analysis MANOVA

Discriminant Function Analysis You wish to predict group membership from a set of two or more continuous variables. Example: The IRS wants to classify tax returns as OK or fraudulent. The have data on many predictor variables from audits conducted in past years.

The Discriminant Function Is a weighted linear combination of the predictors The weights are selected so that the two groups differ as much as possible on the discriminant function.

Eigenvalue and Canonical r Compute a discriminant score, Di, for each case. Use ANOVA to compare the groups on Di SSBetween Groups / SSWithin Groups = eigenvalue

Classification The analysis includes a classification function. This allows one to predict group membership for any case on which you have data on the predictors. Those who are predicted to have submitted fraudulent returns are audited.

Two or More Discriminant Functions You may be able to obtain more than one discriminant function. The maximum number you can obtain is the smaller of The number of predictor variables One less than the number of groups Each function is orthogonal to the others. The first will have the greatest eigenvalue, the second the next greatest, etc.

Labeling Discriminant Functions You may wish to name these things you have created or discovered. As when naming factors from a factor analysis, look at the loadings (correlations between Di and the predictor variables) Look at the standardized discriminant function coefficients (weights).

Predicting Jurors’ Verdict Selections Poulson, Braithwaite, Brondino, and Wuensch (1997). Subjects watch a simulated trial. Defendant accused of murder. There is no doubt that he did the crime. He is pleading insanity. What verdict does the juror recommend?

The Verdict Choices Guilty GBMI (Guilty But Mentally Ill) NGRI (Not Guilty By Reason of Insanity) The jurors are not allowed to know the consequences of these different verdicts.

Eight Predictor Variables Attitude about crime control Attitude about the insanity defense Attitude about the death penalty Attitude about the prosecuting attorneys Attitude about the defense attorneys Assessment of the expert testimony Assessment of mental status of defendant. Can the defendant be rehabilitated?

Multicollinearity This is a problem that arises when one predictor can be nearly perfectly predicted by a weighted combination of the others. It creates problems with the analysis. One solution is to drop one or more of the predictors. If two predictors are so highly correlated, what is to be lost by dropping one of them?

But I Do Not Want To Drop Any The lead researcher did not want to drop any of the predictors. He considered them all theoretically important. So we did a little magic to evade the multicollinearity problem.

Principal Components We used principal components analysis to repackage the variance in the predictors into eight orthogonal components. We used those components as predictors in a discriminant function analysis. And then transformed the results back into the metric of the original predictor variables.

The First Discriminant Function Separated those selecting NGRI from those selecting Guilty. Those selecting NGRI: Believed the defendant mentally ill Believed the defense expert testimony more than the prosecution expert testimony Were receptive to the insanity defense Opposed the death penalty Thought the defendant could be rehabilitated Favored lenient treatment over strict crime control.

The Second Discriminant Function Separated those selecting GBMI from those selecting NGRI or Guilty. Those selecting GBMI: Distrust attorneys (especially prosecution) Think rehabilitation likely Oppose lenient treatment Are not receptive to the insanity defense Do not oppose the death penalty.

MANOVA This is just a DFA in reverse. You predict a set of continuous variables from one or more grouping variables. Often used in an attempt to control familywise error when there are multiple outcome variables. This approach is questionable, but popular.

MANOVA First, ANOVA Second Suppose you have an A x B factorial design. You have five dependent variables. You worry that the Type I boogeyman will get you if you just do five A x B ANOVAs. You do an A x B factorial MANOVA first. For any effect that is significant (A, B, A x B) in MANOVA, you do five ANOVAs.

The Beautiful Criminal Wuensch, Chia, Castellow, Chuang, & Cheng (1993) Data collected in Taiwan Grouping variables Defendant physically attractive or not Sex of defendant Type of crime: Swindle or burglary Defendant American or Chinese Sex of juror

Dependent Variables One set of two variables Length of recommended sentence Rated seriousness of the crime A second set of 12 variables, ratings of the defendant on attributes such as Physical attractiveness Intelligence Sociability

Type I Boogeyman If we did a five-way ANOVA on one DV We would do 27 F tests And that is just for the omnibus analysis If we do that for each of the 14 DVs That is 378 F tests And the Boogeyman is licking his chops

Results, Sentencing Female jurors gave longer sentences, but only with American defendants Attractiveness lowered the sentence for American burglars But increased the sentence for American swindlers Female jurors gave shorter sentences to female defendants

Results, Ratings The following were rated more favorably Physically attractive defendants American defendants Swindlers

Canonical Variates For each effect (actually each treatment df) there is a different set of weights applied to the outcome variables. The weights are those that make the effect as large as possible. The resulting linear combination is called a canonical variate. Again, one canonical variate per treatment degree of freedom.

Labeling the Canonical Variates Look at the loadings Look at the standardized weights (standardized discriminant function coefficients)

Sexual Harassment Trial: Manipulation Check Moore, Wuensch, Hedges, and Castellow (1994) Physical attractiveness (PA) of defendant, manipulated. Social desirability (SD) of defendant, manipulated. Sex/gender of mock juror. Ratings of the litigants on 19 attributes. Experiment 2: manipulated PA and SD of plaintiff.

Experiment 1: Ratings of Defendant Social Desirabililty and Physical Attractiveness manipulations significant. CVSocial Desirability loaded most heavily on sociability, intelligence, warmth, sensitivity, and kindness. CVPhysical Attractiveness loaded well on only the physical attractiveness ratings.

Experiment 2: Ratings of Plaintiff Social Desirabililty and Physical Attractiveness manipulations significant. CVSocial Desirability loaded most heavily on intelligence, poise, sensitivity, kindness, genuineness, warmth, and sociability. CVPhysical Attractiveness loaded well on only the physical attractiveness ratings.