Download presentation

Presentation is loading. Please wait.

Published byIrvin May Modified about 1 year ago

1
Lecture 18 Varimax Factors and Empircal Orthogonal Functions

2
Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture 03Probability and Measurement Error, Part 2 Lecture 04The L 2 Norm and Simple Least Squares Lecture 05A Priori Information and Weighted Least Squared Lecture 06Resolution and Generalized Inverses Lecture 07Backus-Gilbert Inverse and the Trade Off of Resolution and Variance Lecture 08The Principle of Maximum Likelihood Lecture 09Inexact Theories Lecture 10Nonuniqueness and Localized Averages Lecture 11Vector Spaces and Singular Value Decomposition Lecture 12Equality and Inequality Constraints Lecture 13L 1, L ∞ Norm Problems and Linear Programming Lecture 14Nonlinear Problems: Grid and Monte Carlo Searches Lecture 15Nonlinear Problems: Newton’s Method Lecture 16Nonlinear Problems: Simulated Annealing and Bootstrap Confidence Intervals Lecture 17Factor Analysis Lecture 18Varimax Factors, Empircal Orthogonal Functions Lecture 19Backus-Gilbert Theory for Continuous Problems; Radon’s Problem Lecture 20Linear Operators and Their Adjoints Lecture 21Fréchet Derivatives Lecture 22 Exemplary Inverse Problems, incl. Filter Design Lecture 23 Exemplary Inverse Problems, incl. Earthquake Location Lecture 24 Exemplary Inverse Problems, incl. Vibrational Problems

3
Purpose of the Lecture Choose Factors Satisfying A Priori Information of Spikiness (varimax factors) Use Factor Analysis to Detect Patterns in data (EOF’s)

4
Part 1: Creating Spiky Factors

5
can we find “better” factors that those returned by svd() ?

6
mathematically S = CF = C’ F’ with F’ = M F and C’ = M -1 C where M is any P×P matrix with an inverse must rely on prior information to choose M

7
one possible type of prior information factors should contain mainly just a few elements

8
example of rock and minerals rocks contain minerals minerals contain elements MineralComposition QuartzSiO 2 RutileTiO 2 AnorthiteCaAl 2 Si 2 O 8 FosteriteMg 2 SiO 4

9
example of rock and minerals rocks contain minerals minerals contain elements MineralComposition QuartzSiO 2 RutileTiO 2 AnorthiteCaAl 2 Si 2 O 8 FosteriteMg 2 SiO 4 factors most of these minerals are “simple” in the sense that each contains just a few elements

10
spiky factors factors containing mostly just a few elements

11
How to quantify spikiness?

12
variance as a measure of spikiness

13
modification for factor analysis

14
depends on the square, so positive and negative values are treated the same

15
f (1) = [1, 0, 1, 0, 1, 0] T is much spikier than f (2) = [1, 1, 1, 1, 1, 1] T

16
f (2) =[1, 1, 1, 1, 1, 1] T is just as spiky as f (3) = [1, -1, 1, -1, -1, 1] T

17
“varimax” procedure find spiky factors without changing P start with P svd() factors rotate pairs of them in their plane by angle θ to maximize the overall spikiness

18
fBfB fAfA f’ B f’ A

19
determine θ by maximizing

20
after tedious trig the solution can be shown to be

21
and the new factors are in this example A=3 and B=5

22
now one repeats for every pair of factors and then iterates the whole process several times until the whole set of factors is as spiky as possible

23
OldNew f5f5 f2f2 f3f3 f4f4 f’5f’5 f’2f’2 f’3f’3 f’4f’4 SiO 2 TiO 2 Al 2 O 3 FeO total MgO CaO Na 2 O K2OK2O example: Atlantic Rock dataset

24
OldNew f5f5 f2f2 f3f3 f4f4 f’5f’5 f’2f’2 f’3f’3 f’4f’4 SiO 2 TiO 2 Al 2 O 3 FeO total MgO CaO Na 2 O K2OK2O example: Atlantic Rock dataset not so spiky

25
OldNew f5f5 f2f2 f3f3 f4f4 f’5f’5 f’2f’2 f’3f’3 f’4f’4 SiO 2 TiO 2 Al 2 O 3 FeO total MgO CaO Na 2 O K2OK2O example: Atlantic Rock dataset spiky

26
Part 2: Empirical Orthogonal Functions

27
row number in the sample matrix could be meaningful example: samples collected at a succession of times time

28
column number in the sample matrix could be meaningful example: concentration of the same chemical element at a sequence of positions distance

29
S = CF becomes

30
distance dependence time dependence

31
S = CF becomes each loading: a temporal pattern of variability of the corresponding factor each factor: a spatial pattern of variability of the element

32
S = CF becomes there are P patterns and they are sorted into order of importance

33
S = CF becomes factors now called EOF’s (empirical orthogonal functions)

34
example 1 hypothetical mountain profiles what are the most important spatial patterns that characterize mountain profiles

35
this problem has space but not time s( x j, i ) = Σ k=1 p c ki f (k) (x j )

36
this problem has space but not time s( x j, i ) = Σ k=1 p c ki f (k) (x j ) factors are spatial patterns that add together to make mountain profiles

37

38
elements: elevations ordered by distance along profile

39
EOF 3EOF 2EOF 1 index, i f i (1) f i (2) f i (3) λ 1 = 38 λ 2 = 13 λ 3 = 7

40
factor loading, C i2 factor loading, C i3

41
example 2 spatial-temporal patterns (synthetic data)

42
the data

43
spatial pattern at a single time x y t=1

44
the data time

45
the data

46
461 912 136 4 6 1 9 1 2 1 3 6 s need to unfold each 2D image into vector

47
index, i λiλi p=3

48
EOF 1 EOF 2 EOF 3 loadng 1 loadng 2 loadng 3 (A) (B) time, t

49
example 3 spatial-temporal patterns (actual data) sea surface temperature in the Pacific Ocean

50
29 S 29 N 124 E290 E latitude longitude equatorial Pacific Ocean sea surface temperature (black = warm) CAC Sea Surface Temperature

51

52
the image is 30 by 84 pixels in size, or 2520 pixels total to use svd(), the image must be unwrapped into a vector of length 2520

53
2520 positions in the equatorial Pacific ocean 399 times“element” means temperature

54
singular values, ii index, i singular values

55
singular values, ii index, i singular values no clear cutoff for P, but the first 12 singular values are considerably larger than the rest

56

57

58

59

60

61

62
using SVD to approximate data

63 S=C M F M S=C P F P S≈C P’ F P’ With M EOF’s, the data is fit exactly With P chosen to exclude only zero singular values, the data is fit exactly With P’

{ "@context": "http://schema.org", "@type": "ImageObject", "contentUrl": "http://images.slideplayer.com/4182091/14/slides/slide_62.jpg", "name": "S=C M F M S=C P F P S≈C P’ F P’ With M EOF’s, the data is fit exactly With P chosen to exclude only zero singular values, the data is fit exactly With P’

64
A) OriginalB) Based on first 5 EOF’s

Similar presentations

© 2017 SlidePlayer.com Inc.

All rights reserved.

Ads by Google