Principal Components Analysis and Factor Analysis by Dr. Winai Bodhisuwan.

Slides:



Advertisements
Similar presentations
Krishna Rajan Data Dimensionality Reduction: Introduction to Principal Component Analysis Case Study: Multivariate Analysis of Chemistry-Property data.
Advertisements

Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides
Canonical Correlation
Principal Component Analysis
PCA for analysis of complex multivariate data. Interpretation of large data tables by PCA In industry, research and finance the amount of data is often.
Chapter 3 – Data Exploration and Dimension Reduction © Galit Shmueli and Peter Bruce 2008 Data Mining for Business Intelligence Shmueli, Patel & Bruce.
Factor Analysis Continued
1er. Escuela Red ProTIC - Tandil, de Abril, 2006 Principal component analysis (PCA) is a technique that is useful for the compression and classification.
Lecture 7: Principal component analysis (PCA)
1 Multivariate Statistics ESM 206, 5/17/05. 2 WHAT IS MULTIVARIATE STATISTICS? A collection of techniques to help us understand patterns in and make predictions.
Psychology 202b Advanced Psychological Statistics, II April 7, 2011.
Overview of Factor Analysis Construct combinations of quantitative variablesConstruct combinations of quantitative variables Reduce a large set of variables.
Principal Component Analysis
Factor Analysis Purpose of Factor Analysis Maximum likelihood Factor Analysis Least-squares Factor rotation techniques R commands for factor analysis References.
Factor Analysis Purpose of Factor Analysis
Principal component analysis (PCA)
Canonical Correlation: Equations Psy 524 Andrew Ainsworth.
Data mining and statistical learning, lecture 4 Outline Regression on a large number of correlated inputs  A few comments about shrinkage methods, such.
Exploring Microarray data Javier Cabrera. Outline 1.Exploratory Analysis Steps. 2.Microarray Data as Multivariate Data. 3.Dimension Reduction 4.Correlation.
Principal component analysis (PCA)
1 Pertemuan 21 Matakuliah: I0214 / Statistika Multivariat Tahun: 2005 Versi: V1 / R1 Analisis Struktur Peubah Ganda (I): Analisis Komponen Utama.
Principal component analysis (PCA) Purpose of PCA Covariance and correlation matrices PCA using eigenvalues PCA using singular value decompositions Selection.
Principal Component Analysis. Philosophy of PCA Introduced by Pearson (1901) and Hotelling (1933) to describe the variation in a set of multivariate data.
Homework #2: Calculating a correlation yearGDP/capitaODA (millions)
Multivariate Methods EPSY 5245 Michael C. Rodriguez.
Chapter 2 Dimensionality Reduction. Linear Methods
Marginal and Conditional distributions. Theorem: (Marginal distributions for the Multivariate Normal distribution) have p-variate Normal distribution.
Canonical Correlation Analysis and Related Techniques Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia.
N– variate Gaussian. Some important characteristics: 1)The pdf of n jointly Gaussian R.V.’s is completely described by means, variances and covariances.
Principal Component vs. Common Factor. Varimax Rotation Principal Component vs. Maximum Likelihood.
Available at Chapter 13 Multivariate Analysis BCB 702: Biostatistics
Descriptive Statistics vs. Factor Analysis Descriptive statistics will inform on the prevalence of a phenomenon, among a given population, captured by.
Math 5364/66 Notes Principal Components and Factor Analysis in SAS Jesse Crawford Department of Mathematics Tarleton State University.
Chapter 7 Multivariate techniques with text Parallel embedded system design lab 이청용.
Principal Components Analysis. Principal Components Analysis (PCA) A multivariate technique with the central aim of reducing the dimensionality of a multivariate.
Principle Component Analysis and its use in MA clustering Lecture 12.
Principal Component Analysis (PCA)
Principal Component Analysis Zelin Jia Shengbin Lin 10/20/2015.
Feature Extraction 主講人:虞台文. Content Principal Component Analysis (PCA) PCA Calculation — for Fewer-Sample Case Factor Analysis Fisher’s Linear Discriminant.
Tom.h.wilson Department of Geology and Geography West Virginia University Morgantown, WV.
Applied Quantitative Analysis and Practices LECTURE#17 By Dr. Osman Sadiq Paracha.
Principal Component Analysis
1 Canonical Correlation Analysis Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
Université d’Ottawa / University of Ottawa 2001 Bio 8100s Applied Multivariate Biostatistics L11.1 Lecture 11: Canonical correlation analysis (CANCOR)
Feature Extraction 主講人:虞台文.
Principal Components Analysis ( PCA)
Multivariate statistical methods. Multivariate methods multivariate dataset – group of n objects, m variables (as a rule n>m, if possible). confirmation.
Chapter 14 EXPLORATORY FACTOR ANALYSIS. Exploratory Factor Analysis  Statistical technique for dealing with multiple variables  Many variables are reduced.
Basic statistical concepts Variance Covariance Correlation and covariance Standardisation.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
Principal component analysis (PCA)
Factor and Principle Component Analysis
Mini-Revision Since week 5 we have learned about hypothesis testing:
COMP 1942 PCA TA: Harry Chan COMP1942.
Factor analysis Advanced Quantitative Research Methods
Principal Component Analysis (PCA)
Dimension Reduction via PCA (Principal Component Analysis)
Principal Component Analysis (PCA)
Descriptive Statistics vs. Factor Analysis
EPSY 5245 EPSY 5245 Michael C. Rodriguez
Principal Components Analysis
Multivariate Statistical Methods
Principal Component Analysis
Chapter_19 Factor Analysis
Factor Analysis (Principal Components) Output
Principal Component Analysis
Performance Tests in Guide Dogs
Principal Component Analysis
Presentation transcript:

Principal Components Analysis and Factor Analysis by Dr. Winai Bodhisuwan

Principal Component Analysis Principal components analysis transforms the original set of variables into a smaller set of linear combinations that account for most of the variance in the original set. The purpose of PCA is to determine factors (i.e., principal components) in order to explain as much of the total variation in the data as possible.

Principal Component Analysis The are 2 bases of analysis. Based on Covariance Matrices Based on Correlation Matrices

Radiotherapy Data Study The data consist of average ratings over the course of treatment for patients undergoing radiotherapy. Variables measured include x 1 (number of symptoms, such as sore throat or nausea); x 2 (amount of activity, on a 1-5 scale); x 3 (amount of sleep, on a 1-5 scale); x 4 (amount of food consumed, on a 1-5 scale); x 5 (appetite, on a 1-5 scale); and x 6 (skin reaction, on a 0-3 scale) *Refer to the data set file, radiotherapy.MTW

Mineral Contents in Bones At the start of a study to determine whether exercise or dietary supplements would slow bone loss in older women, an investigator measured the mineral content of bones by photon absorptiometry. Measurements were recorded for three bones on the dominant and nondominant sides. *Refer to the data set file, mineralcontents.MTW

Air Pollutions The data set file are 42 measurements on air-pollution variables recorded at 12:00 noon in the Los Angeles area on different days. *Refer to the data set file, airpollution.MTW

Principal Component Analysis Minitab Command: Using the menu: Stat >> Multivariate >> Principal Components

Principal Component Analysis Minitab Command: Click Graphs and Storage to produce score plot and store the resulted score.

Factor Analysis Factor analysis is a multivariate tool that is very similar to PCA. Factor analysis is also used to condense a set of observed variables into smaller of transformed variables called factors.

Rotated Factor Matrix Correlation Matrix or Covariance Matrix Data Collection MLE Factor Model PCA Unrotated Factor Matrix

Factor Analysis Minitab Command: Using the menu: Stat >> Multivariate >> Factor Analysis

Factor Analysis Minitab Command: Using the menu: Stat >> Multivariate >> Factor Analysis

Factor Analysis Minitab Command: Using the menu: Stat >> Multivariate >> Factor Analysis