General linear model and regression analysis. The general linear model: Y = μ + σ 2 (Age) + σ 2 (Sex) + σ 2 (Genotype) + σ 2 (Measurement) + σ 2 (Condition)

Slides:

Advertisements

Similar presentations

3.3 Hypothesis Testing in Multiple Linear Regression

Advertisements

Lesson 10: Linear Regression and Correlation

1 1 Chapter 5: Multiple Regression 5.1 Fitting a Multiple Regression Model 5.2 Fitting a Multiple Regression Model with Interactions 5.3 Generating and.

Chapter 12 Simple Linear Regression

The General Linear Model Or, What the Hell’s Going on During Estimation?

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.

Linear Regression. PSYC 6130, PROF. J. ELDER 2 Correlation vs Regression: What’s the Difference? Correlation measures how strongly related 2 variables.

Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11

Chapter 10 Curve Fitting and Regression Analysis

Ch11 Curve Fitting Dr. Deshi Ye

1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.

Statistics for Managers Using Microsoft® Excel 5th Edition

GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.

Statistics for Managers Using Microsoft® Excel 5th Edition

Multivariate Data Analysis Chapter 4 – Multiple Regression.

Variability and statistical tests. Where the variability comes from? Instrumental measurements Biology –Genotype –Environment –Ootype –Experimental factors.

Chapter Topics Types of Regression Models

Simple Linear Regression Statistics 700 Week of November 27.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 11 th Edition.

Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.

Multiple Regression Research Methods and Statistics.

Simple Linear Regression Analysis

Copyright ©2011 Pearson Education 15-1 Chapter 15 Multiple Regression Model Building Statistics for Managers using Microsoft Excel 6 th Global Edition.

Quantitative Business Analysis for Decision Making Multiple Linear RegressionAnalysis.

Example of Simple and Multiple Regression

Objectives of Multiple Regression

MODELS OF QUALITATIVE CHOICE by Bambang Juanda.  Models in which the dependent variable involves two ore more qualitative choices.  Valuable for the.

McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.

Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 15-1 Chapter 15 Multiple Regression Model Building Statistics for Managers using Microsoft.

Chapter 14 – Correlation and Simple Regression Math 22 Introductory Statistics.

1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.

Linear Regression James H. Steiger. Regression – The General Setup You have a set of data on two variables, X and Y, represented in a scatter plot. You.

Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.

Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.

Applications of Regression to Water Quality Analysis Unite 5: Module 18, Lecture 1.

Education 793 Class Notes Multiple Regression 19 November 2003.

Chapter 16 Data Analysis: Testing for Associations.

Chapter 13 Multiple Regression

Simple Linear Regression (SLR)

Simple Linear Regression (OLS). Types of Correlation Positive correlationNegative correlationNo correlation.

–The shortest distance is the one that crosses at 90° the vector u Statistical Inference on correlation and regression.

Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 14-1 Chapter 14 Multiple Regression Model Building Statistics for Managers.

Chapter 8: Simple Linear Regression Yang Zhenlin.

Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.

Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 10 th Edition.

…. a linear regression coefficient indicates the impact of each independent variable on the outcome in the context of (or “adjusting for”) all other variables.

Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 14-1 Chapter 14 Multiple Regression Model Building Statistics for Managers.

1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 

Multiple Regression David A. Kenny January 12, 2014.

Multiple Regression (continued)& Polynomial Regression.

26134 Business Statistics Week 4 Tutorial Simple Linear Regression Key concepts in this tutorial are listed below 1. Detecting.

SOCW 671 #11 Correlation and Regression. Uses of Correlation To study the strength of a relationship To study the direction of a relationship Scattergrams.

Week of March 23 Partial correlations Semipartial correlations

Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.

2011 Data Mining Industrial & Information Systems Engineering Pilsung Kang Industrial & Information Systems Engineering Seoul National University of Science.

INTRODUCTION TO MULTIPLE REGRESSION MULTIPLE REGRESSION MODEL 11.2 MULTIPLE COEFFICIENT OF DETERMINATION 11.3 MODEL ASSUMPTIONS 11.4 TEST OF SIGNIFICANCE.

Chapter 11: Linear Regression E370, Spring From Simple Regression to Multiple Regression.

Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.

Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.

Chapter 15 Multiple Regression Model Building

Part 5 - Chapter

Correlation, Bivariate Regression, and Multiple Regression

Quantitative Methods Simple Regression.

BIVARIATE REGRESSION AND CORRELATION

Simple Linear Regression

6-1 Introduction To Empirical Models

Simple Linear Regression

Correlation and Regression

Chapter 13 Additional Topics in Regression Analysis

Adequacy of Linear Regression Models

Presentation transcript:

General linear model and regression analysis

The general linear model: Y = μ + σ 2 (Age) + σ 2 (Sex) + σ 2 (Genotype) + σ 2 (Measurement) + σ 2 (Condition) + ε Y: response of the system μ: grand mean σ 2 : variance from the factor ε: error

Dependent vs. independent variables Independent varables ARE MANIPULATED in the experiment Dependent ones ARE NOT MANIPULATED Independent variables shape the experiment Dependent variables measure its result

Description of the established relations: –Strong? 1.Absolutely 2.Related to other relations –Confident? By different tests –Robust? What happens if: we change the method? the distribution changes the shape?

The purpose of the general linear model The theory seeks to identify those quantities in systems of equations which remain unchanged under linear transformations of the variables in the system. I.e.: an eternal and unchanging amongst the chaos of the transitory and the illusory.

The purpose of the regression analysis, more specifically: Quantify the relationship between several independent or predictor variables and a dependent or criterion variable.

Simple regression

Multiple regression The regression coefficients represent the independent contributions of each independent variable to the prediction of the dependent variable. independent variabledependent variable In other words, variable X1 is correlated with the Y variable, after controlling for all other independent variables (=partial correlations).

The general linear model can be expressed as YM = Xb + e Here Y, X, b, and e are as described for the multivariate regression model and M is an m x s matrix of coefficients defining s linear transformation of the dependent variable. The normal equations aredependent variable X'Xb =X' YM and a solution for the normal equations is given by b = (X'X)`X' YM Here the inverse of X'X is a generalized inverse if X'X contains redundant columns.

Matrix ill conditioning numerical round-off in designs with very different variances of values in different columns of the design matrix Rescale it!

In the general linear model x = μ + σ 2 (Age) + σ2(Sex) + σ2(Genotype) + σ2(Measurement) + σ2(Condition) + ε Each of the terms σ2 can be questioned. Moreover, their particular combinations can be studied. x = μ + … σ2(Age X Sex) + … + σ2(Sex X Genotype) + σ2(Age X Genotype X Condition) + … + ε Examples: “Does the disease prognosis deteriorate with age equally for men and women?” H0: σ2(Age X Sex) = 0 “Is not genotype AbC reaction particularly difficult to detect by measuring with tool Z?” H0: σ2(Genotype X Measurement) = 0

Statistical significance p-level: the probability of the relation to NOT EXIST