B&A 448-452; and http://www.youtube.com/watch?v=1b18fO9Vt50 REGRESSION - ANCOVA B&A 448-452; and http://www.youtube.com/watch?v=1b18fO9Vt50.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Lesson 10: Linear Regression and Correlation
Kin 304 Regression Linear Regression Least Sum of Squares
BA 275 Quantitative Business Methods
13- 1 Chapter Thirteen McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Linear regression models
Simple Linear Regression
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Chapter 10 Simple Regression.
Bivariate Regression CJ 526 Statistical Analysis in Criminal Justice.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
1 Review of Correlation A correlation coefficient measures the strength of a linear relation between two measurement variables. The measure is based on.
Topics: Regression Simple Linear Regression: one dependent variable and one independent variable Multiple Regression: one dependent variable and two or.
Quantitative Business Analysis for Decision Making Simple Linear Regression.
Analysis of Individual Variables Descriptive – –Measures of Central Tendency Mean – Average score of distribution (1 st moment) Median – Middle score (50.
Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.
Multiple Regression Research Methods and Statistics.
Summary of Quantitative Analysis Neuman and Robson Ch. 11
Simple Linear Regression Analysis
Review for Final Exam Some important themes from Chapters 9-11 Final exam covers these chapters, but implicitly tests the entire course, because we use.
T-tests and ANOVA Statistical analysis of group differences.
Correlation & Regression
Quantitative Business Analysis for Decision Making Multiple Linear RegressionAnalysis.
Leedy and Ormrod Ch. 11 Gray Ch. 14
General Linear Model. Instructional Materials MultReg.htmhttp://core.ecu.edu/psyc/wuenschk/PP/PP- MultReg.htm.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Chapter 11 Simple Regression
Hypothesis Testing in Linear Regression Analysis
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
Simple Linear Regression Models
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Chapter 12 Examining Relationships in Quantitative Research Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Regression. Population Covariance and Correlation.
Examining Relationships in Quantitative Research
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Education 793 Class Notes Multiple Regression 19 November 2003.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 16 Data Analysis: Testing for Associations.
Examining Relationships in Quantitative Research
Soc 3306a Lecture 7: Inference and Hypothesis Testing T-tests and ANOVA.
Lesson 14 - R Chapter 14 Review. Objectives Summarize the chapter Define the vocabulary used Complete all objectives Successfully answer any of the review.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
The “Big Picture” (from Heath 1995). Simple Linear Regression.
Statistics and probability Dr. Khaled Ismael Almghari Phone No:
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Stats Methods at IC Lecture 3: Regression.
Regression Analysis AGEC 784.
REGRESSION G&W p
REGRESSION (R2).
Kin 304 Regression Linear Regression Least Sum of Squares
Linear Mixed Models in JMP Pro
Regression Assumptions of OLS.
BIVARIATE REGRESSION AND CORRELATION
Correlation and Regression
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Soc 3306a: ANOVA and Regression Models
LESSON 24: INFERENCES USING REGRESSION
Soc 3306a Lecture 11: Multivariate 4
Simple Linear Regression
Simple Linear Regression
Ch 4.1 & 4.2 Two dimensions concept
Chapter Thirteen McGraw-Hill/Irwin
Regression Part II.
Presentation transcript:

B&A 448-452; and http://www.youtube.com/watch?v=1b18fO9Vt50 REGRESSION - ANCOVA B&A 448-452; and http://www.youtube.com/watch?v=1b18fO9Vt50

Technique: Statistics of the straight line We have multiple data points (not just two) We need to find a line that best fits them Define “best fit” – Minimum squared deviations slope intercept Independent variable Error Dependent variable Regression coefficients

Technique: Statistics of the straight line The line that “best fits” has the following slope: Standard deviation of y Standard deviation of x Regression coefficient of y on x. Correlation coefficient of x and y The line that “best fits” has the following intercept:

Standard error of prediction Regression does not provide an exact prediction At each value of x, we expect that the value of y will be between two values, most of the time We can estimate a confidence interval for predicted values of y, if we assume that at each value of x, the values of y will be distributed normally with a given standard deviation. Standard deviation of all possible predicted y values obtained from all possible samples. Confidence interval of prediction:

Components of the total variance Standard deviation of all possible predicted y values obtained from all possible samples. Variance that cannot be accounted for by regression Variance that can be accounted for by regression Total variance

Things to know A significant regression coefficient does not “prove” causality A regression can provide “predicted” values Predicted values are “point” estimates Confidence intervals around the point estimates provide very important information

THIS IS A TABLE YOU SHOULD KNOW BEFORE ANALYZING YOUR DATA AND THE FINAL Dependent Variable Independent Variable(s) Method Nominal/Ordinal Chi-Square test Interval/Ratio T-test (2 groups) or ANOVA (3+ groups) Multifactorial ANOVA (2+ IVs) Regression Interval/Ratio AND ANCOVA/GLM

Example Analyses Using all Information

Regression exercise with 2008 SOCI 301 data Attitudes towards marriage will be influenced by gender role attitudes. Gender role attitudes will be influenced by sex and maternal education. Sex Negative attitudes towards marriage Non egalitarian gender role attitudes Maternal education

Are gender role attitudes correlated with the attitudes towards marriage

Sex differences in gender role attitudes

Maternal education differences in gender role attitudes

Sex and maternal education differences in gender role attitudes

Differential effects of maternal education depending on sex?

Profile plot

Do gender role attitudes influence the attitudes towards marriage?

Can I do this in GLM UNIANOVA? Attention: You must ask for parameter estimates from GLM You must specify interval/ratio IV s as “covariates”

Can we do the same in GLM (UNIANOVA)?

Can we include the nominal/ordinal variables too? Attention: You must include nominal/ordinal variables as “fixed factors” You must specify interval/ratio IV s as “covariates”

ANCOVA Model

Assumptions The interval/ratio level independent variable has a LINEAR association with the DV. Error term has FIXED variance (same as regression).

Is the covariate desirable? What if the factor is a predictor of the covariate? Current example What is the factor is independent of the covariate? Covariate adds information to the model