1. Eigen-analysis and the Power Method

2. Module Goals Power Method Shift technique (optional) Inverse Method
Accelerated Power Method

3. Power method
The special advantage of the power method is that the eigenvector corresponds to the dominant eigenvalue and is generated at the same time. The inverse power method solves for the minimal eigenvalue/vector pair.
The disadvantage is that the method only supplies obtains one eigenvalue

4. Power Method Readers Digest Version
Eigenvalues can be ordered in magnitude and the largest is called the dominant eigenvalue or spectral radius.
Think about how eigenvalues are a reflection of the nature of a matrix. Now if we multiply by that matrix over and over again..eventually the biggest eigenvalue will make everyone else have eigen-envy.
One λ to rule them all, One λ to find them, One λ to bring them all and in the darkness bind them.

5. Power Method
In general continue the multiplication:
where,

6. Power Method Factor the large l value term
As you continue to multiply the vector by [A]

7. Power Method
The basic computation of the power method is summarized as

8. Power Method
The basic computation of the power method is summarized as
The equation can be written as:

9. The Power Method Algorithm (algorithm 3.3.1 pg 107)
y=nonzero random vector
Initialize x = A*y vector
for k =1,2,…n
y=x/||x||
x =Ay (x is the approximate eigenvector)
approximate eigenvalue μ= (yT*x)/(yT*y)
r=μy-x
k++

10. Example of Power Method
Consider the follow matrix A
Assume an arbitrary vector x0 = { 1 1 1}T

11. Example of Power Method
Multiply the matrix by the matrix [A] by {x}
Normalize the result of the product

12. Example of Power Method

13. Example of Power Method
As you continue to multiple each successive vector l = 4 and the vector uk={1 0 0}T

14. Shift method (optional)
It is possible to obtain another eigenvalue from the set equations by using a technique known as shifting the matrix.
Subtract the a vector from each side, thereby changing the maximum eigenvalue

15. Shift method
The eigenvalue, s, is the maximum value of the matrix A. The matrix is rewritten in a form.
Use the Power method to obtain the largest eigenvalue of [B].

16. Example of Power Method
Consider the follow matrix A
Assume an arbitrary vector x0 = { 1 1 1}T

17. Example of Power Method
Multiply the matrix by the matrix [A] by {x}
Normalize the result of the product

18. Example of Power Method
Continue with the iteration and the final value is l = -5. However, to get the true you need to shift back by:

19. Inverse Power Method
The inverse method is similar to the power method, except that it finds the smallest eigenvalue. Using the following technique.

20. Inverse Power Method
The algorithm is the same as the Power method and the “eigenvector” is not the eigenvector for the smallest eigenvalue. To obtain the smallest eigenvalue from the power method.

21. Inverse Power Method
The inverse method is similar to the power method, except that it finds the smallest eigenvalue. Using the following technique.

22. Inverse Power Method
The algorithm is the same as the Power method and the “eigenvector” is not the eigenvector for the smallest eigenvalue. To obtain the smallest eigenvalue from the power method.

23. Inverse Power Method
The inverse algorithm use the technique avoids calculating the inverse matrix and uses a LU decomposition to find the {x} vector.

24. Example
The matrix is defined as:

25. Accelerated Power Method
The Power method can be accelerated by using the Rayleigh Quotient instead of the largest wk value.
The Rayeigh Quotient is defined as:

26. Accelerated Power Method
The values of the next z term is defined as:
The Power method is adapted to use the new value.

27. Example of Accelerated Power Method
Consider the follow matrix A
Assume an arbitrary vector x0 = { 1 1 1}T

28. Example of Power Method
Multiply the matrix by the matrix [A] by {x}

29. Example of Accelerated Power Method
Multiply the matrix by the matrix [A] by {x}

30. Example of Accelerated Power Method

31. Example of Accelerated Power Method
And so on ...