STA302: Regression Analysis. Statistics Objective: To draw reasonable conclusions from noisy numerical data Entry point: Study relationships between variables.

Slides:



Advertisements
Similar presentations
Scatterplots and Correlation
Advertisements

Regression and correlation methods
Lesson 10: Linear Regression and Correlation
Chapter 10 Curve Fitting and Regression Analysis
Regression Part II One-factor ANOVA Another dummy variable coding scheme Contrasts Multiple comparisons Interactions.
Logistic Regression STA302 F 2014 See last slide for copyright information 1.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Correlation and Regression Analysis
RESEARCH STATISTICS Jobayer Hossain Larry Holmes, Jr November 6, 2008 Examining Relationship of Variables.
1 Simple Linear Regression Linear regression model Prediction Limitation Correlation.
Multiple Regression Research Methods and Statistics.
SPSS Statistical Package for Social Sciences Multiple Regression Department of Psychology California State University Northridge
1 Chapter 10 Correlation and Regression We deal with two variables, x and y. Main goal: Investigate how x and y are related, or correlated; how much they.
Correlation & Regression
Correlation and Linear Regression
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 13 Linear Regression and Correlation.
Linear Regression and Correlation
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Linear Regression and Correlation
Double Measurement Regression STA431: Spring 2013.
Maximum Likelihood See Davison Ch. 4 for background and a more thorough discussion. Sometimes.
Anthony Greene1 Correlation The Association Between Variables.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Introduction to Regression with Measurement Error STA302: Fall/Winter 2013.
Chapter 6 & 7 Linear Regression & Correlation
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Chapter 3 concepts/objectives Define and describe density curves Measure position using percentiles Measure position using z-scores Describe Normal distributions.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Soc 3306a Multiple Regression Testing a Model and Interpreting Coefficients.
Statistical Analysis Topic – Math skills requirements.
Run the colour experiment where kids write red, green, yellow …first.
Soc 3306a Lecture 9: Multivariate 2 More on Multiple Regression: Building a Model and Interpreting Coefficients.
Factorial ANOVA More than one categorical explanatory variable STA305 Spring 2014.
Logistic Regression STA2101/442 F 2014 See last slide for copyright information.
Chapter 10 Correlation and Regression
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Basic Concepts of Correlation. Definition A correlation exists between two variables when the values of one are somehow associated with the values of.
Regression Part II One-factor ANOVA Another dummy variable coding scheme Contrasts Multiple comparisons Interactions.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Political Science 30: Political Inquiry. Linear Regression II: Making Sense of Regression Results Interpreting SPSS regression output Coefficients for.
Chapter 6 Simple Regression Introduction Fundamental questions – Is there a relationship between two random variables and how strong is it? – Can.
Examining Bivariate Data Unit 3 – Statistics. Some Vocabulary Response aka Dependent Variable –Measures an outcome of a study Explanatory aka Independent.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
Chapter 4 Summary Scatter diagrams of data pairs (x, y) are useful in helping us determine visually if there is any relation between x and y values and,
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
Chapter 9: Correlation and Regression Analysis. Correlation Correlation is a numerical way to measure the strength and direction of a linear association.
Categorical Independent Variables STA302 Fall 2013.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
CHAPTER 5 CORRELATION & LINEAR REGRESSION. GOAL : Understand and interpret the terms dependent variable and independent variable. Draw a scatter diagram.
STA302: Regression Analysis. Statistics Objective: To draw reasonable conclusions from noisy numerical data Entry point: Study relationships between variables.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Chapter 10 Correlation and Regression 10-2 Correlation 10-3 Regression.
Categorical Independent Variables STA302 Fall 2015.
Simple Linear Regression The Coefficients of Correlation and Determination Two Quantitative Variables x variable – independent variable or explanatory.
BPA CSUB Prof. Yong Choi. Midwest Distribution 1. Create scatter plot Find out whether there is a linear relationship pattern or not Easy and simple using.
The Sample Variation Method A way to select sample size This slide show is a free open source document. See the last slide for copyright information.
Logistic Regression For a binary response variable: 1=Yes, 0=No This slide show is a free open source document. See the last slide for copyright information.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Topics, Summer 2008 Day 1. Introduction Day 2. Samples and populations Day 3. Evaluating relationships Scatterplots and correlation Day 4. Regression and.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
Week 2 Normal Distributions, Scatter Plots, Regression and Random.
Poisson Regression STA 2101/442 Fall 2017
SCATTERPLOTS, ASSOCIATION AND RELATIONSHIPS
Interactions and Factorial ANOVA
Logistic Regression Part One
STA302: Regression Analysis
Quantitative Methods Simple Regression.
The Weather Turbulence
Presentation transcript:

STA302: Regression Analysis

Statistics Objective: To draw reasonable conclusions from noisy numerical data Entry point: Study relationships between variables

Data File Rows are cases Columns are variables

Variables can be Independent: Predictor or cause (contributing factor) Dependent: Predicted or effect

Simple regression and correlation Simple means one IV DV quantitative IV usually quantitative too

Simple regression and correlation High School GPAUniversity GPA ……

Scatterplot

Least squares line

Correlation coefficient r -1 ≤ r ≤ 1 r = +1 indicates a perfect positive linear relationship. All the points are exactly on a line with a positive slope. r = -1 indicates a perfect negative linear relationship. All the points are exactly on a line with a negative slope. r = 0 means no linear relationship (curve possible). Slope of least squares line = 0 r 2 = proportion of variation explained

r = 0.004

r = 0.112

r = 0.368

r = 0.547

r = 0.733

r =

r = 0.025

r =

Why -1 ≤ r ≤ 1 ?

A Statistical Model

One Independent Variable at a Time Can Produce Misleading Results The standard elementary tests all have a single independent variable, so they should be used with caution in practice. Example: Artificial and extreme, to make a point Suppose the correlation between Age and Strength is r = -0.96

Need multiple regression

Multiple regression in scalar form

Multiple regression in matrix form

So we need Matrix algebra Random vectors, especially multivariate normal Software to do the computation

Copyright Information This slide show was prepared by Jerry Brunner, Department of Statistical Sciences, University of Toronto. It is licensed under a Creative Commons Attribution - ShareAlike 3.0 Unported License. Use any part of it as you like and share the result freely. These Powerpoint slides are available from the course website: