Advantages of Multivariate Analysis Close resemblance to how the researcher thinks. Close resemblance to how the researcher thinks. Easy visualisation.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Forecasting Using the Simple Linear Regression Model and Correlation
Chapter 10 Curve Fitting and Regression Analysis
Linear regression models
Correlation and regression
Chapter 10 Regression. Defining Regression Simple linear regression features one independent variable and one dependent variable, as in correlation the.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
The Simple Linear Regression Model: Specification and Estimation
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Lecture 19: Tues., Nov. 11th R-squared (8.6.1) Review
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Examining Relationship of Variables  Response (dependent) variable - measures the outcome of a study.  Explanatory (Independent) variable - explains.
SIMPLE LINEAR REGRESSION
Chapter Topics Types of Regression Models
Correlation and Regression. Correlation What type of relationship exists between the two variables and is the correlation significant? x y Cigarettes.
RESEARCH STATISTICS Jobayer Hossain Larry Holmes, Jr November 6, 2008 Examining Relationship of Variables.
SIMPLE LINEAR REGRESSION
Ch. 14: The Multiple Regression Model building
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Linear Regression and Linear Prediction Predicting the score on one variable.
Correlation and Regression Analysis
Relationships Among Variables
Correlation & Regression
Quantitative Business Analysis for Decision Making Multiple Linear RegressionAnalysis.
Regression and Correlation Methods Judy Zhong Ph.D.
SIMPLE LINEAR REGRESSION
Introduction to Linear Regression and Correlation Analysis
Linear Regression. Simple Linear Regression Using one variable to … 1) explain the variability of another variable 2) predict the value of another variable.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
© 2014 by Pearson Higher Education, Inc Upper Saddle River, New Jersey All Rights Reserved HLTH 300 Biostatistics for Public Health Practice, Raul.
Introduction to Linear Regression
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
MBP1010H – Lecture 4: March 26, Multiple regression 2.Survival analysis Reading: Introduction to the Practice of Statistics: Chapters 2, 10 and 11.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Y X 0 X and Y are not perfectly correlated. However, there is on average a positive relationship between Y and X X1X1 X2X2.
Regression Lesson 11. The General Linear Model n Relationship b/n predictor & outcome variables form straight line l Correlation, regression, t-tests,
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
CHAPTER 5 Regression BPS - 5TH ED.CHAPTER 5 1. PREDICTION VIA REGRESSION LINE NUMBER OF NEW BIRDS AND PERCENT RETURNING BPS - 5TH ED.CHAPTER 5 2.
^ y = a + bx Stats Chapter 5 - Least Squares Regression
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Simple Linear Regression The Coefficients of Correlation and Determination Two Quantitative Variables x variable – independent variable or explanatory.
Chapters 8 Linear Regression. Correlation and Regression Correlation = linear relationship between two variables. Summarize relationship with line. Called.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Part II Exploring Relationships Between Variables.
The simple linear regression model and parameter estimation
Chapter 4: Basic Estimation Techniques
Chapter 20 Linear and Multiple Regression
Modeling in R Sanna Härkönen.
CHAPTER 3 Describing Relationships
Inference for Regression (Chapter 14) A.P. Stats Review Topic #3
CHAPTER 3 Describing Relationships
Correlation and Simple Linear Regression
Stats Club Marnie Brennan
Linear Regression/Correlation
No notecard for this quiz!!
Simple Linear Regression
Unit 3 – Linear regression
^ y = a + bx Stats Chapter 5 - Least Squares Regression
Correlation and Simple Linear Regression
Regression is the Most Used and Most Abused Technique in Statistics
M248: Analyzing data Block D UNIT D2 Regression.
Correlation and Regression
Simple Linear Regression and Correlation
Simple Linear Regression
Ch 4.1 & 4.2 Two dimensions concept
Algebra Review The equation of a straight line y = mx + b
A medical researcher wishes to determine how the dosage (in mg) of a drug affects the heart rate of the patient. Find the correlation coefficient & interpret.
Introduction to Regression
Presentation transcript:

Advantages of Multivariate Analysis Close resemblance to how the researcher thinks. Close resemblance to how the researcher thinks. Easy visualisation and interpretation of data. Easy visualisation and interpretation of data. More information is analysed simultaneously, giving greater power. More information is analysed simultaneously, giving greater power. Relationship between variables is understood better. Relationship between variables is understood better. Focus shifts from individual factors taken singly to relationship among variables. Focus shifts from individual factors taken singly to relationship among variables.

Definitions - I Independent (or Explanatory or Predictor) variable always on the X axis. Independent (or Explanatory or Predictor) variable always on the X axis. Dependent (or Outcome or Response) variable always on the Y axis. Dependent (or Outcome or Response) variable always on the Y axis. In OBSERVATIONAL studies researcher observes the effects of explanatory variables on outcome. In OBSERVATIONAL studies researcher observes the effects of explanatory variables on outcome. In INTERVENTION studies researcher manipulates explanatory variable (e.g. dose of drug) to influence outcome In INTERVENTION studies researcher manipulates explanatory variable (e.g. dose of drug) to influence outcome

Definitions - II Scatter plot helps to visualise the relationship between two variables. Scatter plot helps to visualise the relationship between two variables. The figure shows a scatter plot with a regression line. For a given value of X there is a spread of Y values. The regression line represents the mean values of Y. The figure shows a scatter plot with a regression line. For a given value of X there is a spread of Y values. The regression line represents the mean values of Y.

Definitions - III INTERCEPT is the value of Y for X = 0. It denotes the point where the regression line meets the Y axis INTERCEPT is the value of Y for X = 0. It denotes the point where the regression line meets the Y axis SLOPE is a measure of the change in the value of Y for a unit change in X. SLOPE is a measure of the change in the value of Y for a unit change in X. Intercept Slope X axis Y axis

Basic Assumptions Y increases or decreases linearly with increase or decrease in X. Y increases or decreases linearly with increase or decrease in X. For any given value of X the values of Y are distributed Normally. For any given value of X the values of Y are distributed Normally. Variance of Y at any given value of X is the same for all value of X. Variance of Y at any given value of X is the same for all value of X. The deviations in any one value of Y has no effect on other values of Y for any given X The deviations in any one value of Y has no effect on other values of Y for any given X

The Residuals The difference between the observed value of Y and the value on the regression line (Fitted value) is the residual. The difference between the observed value of Y and the value on the regression line (Fitted value) is the residual. The statistical programme minimizes the sum of the squares of the residuals. In a Good Fit the data points are all crowded around the regression line. The statistical programme minimizes the sum of the squares of the residuals. In a Good Fit the data points are all crowded around the regression line. Residual

Analysis of Variance - I The variation of Y values around the regression line is a measure of how X and Y relate to each other. The variation of Y values around the regression line is a measure of how X and Y relate to each other. Method of quantifying the variation is by Analysis of variance presented as Analysis of Variance table Method of quantifying the variation is by Analysis of variance presented as Analysis of Variance table Total sum of squares represents total variation of Y values around their mean - S yy Total sum of squares represents total variation of Y values around their mean - S yy

Analysis of Variance - II Total Sum of Squares ( S yy ) is made up of two parts: (i). Explained by the regression (ii). Residual Sum of Squares Sum of Squares ÷ its degree of freedom = Mean Sum of Squares (MSS) The ratio MSS due to regression ÷ MSS Residual = F ratio

Reading the output Regression Equation Regression Equation Residual Sum of Squares (RSS) Residual Sum of Squares (RSS) Values of α and β. Values of α and β. R 2 R 2 S (standard deviation) S (standard deviation) Testing for β ≠ 0 Testing for β ≠ 0 Analysis of Variance Table Analysis of Variance Table F test F test Outliers Outliers Remote from the rest Remote from the rest