Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors
Suppose that A is a square (n × n) matrix. We say that a nonzero vector v is an eigenvector and a number
λ is its eigenvalue if
Av = λv. (14.1)
Geometrically this means that Av is in the same direction as v, since multiplying a vector by a number
changes its length, but not its direction.
The results are a matrix v that contains eigenvectors as columns and a diagonal matrix e that contains
eigenvalues on the diagonal. We can check this by
v1 = v (: ,1)
A * v1
e (1 ,1)* v1
If A is 2 × 2 or 3 × 3 then we can find its eigenvalues and eigenvectors by hand. Notice that Equation (14.1)
can be rewritten as
Av − λv = 0.
It would be nice to factor out the v from the right-hand side of this equation, but we can’t because A is a
matrix and λ is a number. However, since Iv = v, we can do the following:
Av − λv = Av − λIv
= (A − λI)v
=0
If v is nonzero, then by Theorem 3 in Lecture 10 the matrix (A−λI) must be singular. By the same theorem,
we must have
det(A − λI) = 0.
This is called the characteristic equation.
57
58 LECTURE 14. EIGENVALUES AND EIGENVECTORS
For a 3 × 3 matrix we could complete the same process. The det(A − λI) = 0 would be a cubic polynomial
and we would expect to usually get 3 roots, which are the eigenvalues.
59
Larger Matrices
For a n × n matrix with n ≥ 4 this process is too long and cumbersome to complete by hand. Further, this
process is not well suited even to implementation on a computer program since it involves determinants and
solving a n-degree polynomial. For n ≥ 4 we need more ingenious methods. These methods rely on the
geometric meaning of eigenvectors and eigenvalues rather than solving algebraic equations. We will overview
these methods in Lecture 16.
Complex Eigenvalues
It turns out that the eigenvalues of some matrices are complex numbers, even when the matrix only contains
real numbers. When this happens the complex eigenvalues must occur in conjugate pairs, i.e.
λ1,2 = α ± iβ.
w = u ± iv.
In applications, the imaginary part of the eigenvalue, β, often is related to the frequency of an oscillation.
This is because of Euler’s formula
eα+iβ = eα (cos β + i sin β).
Certain kinds of matrices that arise in applications can only have real eigenvalues and eigenvectors. The
most common such type of matrix is the symmetric matrix. A matrix is symmetric if it is equal to its own
transpose, i.e. it is symmetric across the diagonal. For example,
1 3
3 −5
is symmetric and so we know beforehand that its eigenvalues will be real, not complex.
Exercises
14.1 Find the eigenvalues and eigenvectors of the following matrix by hand:
2 1
A= .
1 2
14.2 Find the eigenvalues and eigenvectors of the following matrix by hand:
1 −2
B= .
2 1