Finite-Dimensional Vector Spaces: F Denotes R or C
Finite-Dimensional Vector Spaces: F Denotes R or C
Finite-Dimensional
Vector Spaces
✽✽ 21
22 Chapter 2. Finite-Dimensional Vector Spaces
2.1 a1 v1 + · · · + am vm ,
2.2 p(z) = a0 + a1 z + · · · + am zm
Span and Linear Independence 23
v = a1 v1 + · · · + am vm .
v = â1 v1 + · · · + âm vm .
(1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0)
a1 v1 + · · · + am vm = 0.
a1 aj−1
2.5 vj = − v1 − · · · − vj−1 ,
aj aj
proving (a).
To prove (b), suppose that u ∈ span(v1 , . . . , vm ). Then there exist
c1 , . . . , cm ∈ F such that
u = c1 v1 + · · · + cm vm .
In the equation above, we can replace vj with the right side of 2.5,
which shows that u is in the span of the list obtained by removing the
j th term from (v1 , . . . , vm ). Thus (b) holds.
2.6 Theorem: In a finite-dimensional vector space, the length of Suppose that for each
every linearly independent list of vectors is less than or equal to the positive integer m,
length of every spanning list of vectors. there exists a linearly
independent list of m
Proof: Suppose that (u1 , . . . , um ) is linearly independent in V and vectors in V . Then this
that (w1 , . . . , wn ) spans V . We need to prove that m ≤ n. We do so theorem implies that V
through the multistep process described below; note that in each step is infinite dimensional.
we add one of the u’s and remove one of the w’s.
26 Chapter 2. Finite-Dimensional Vector Spaces
Step 1
The list (w1 , . . . , wn ) spans V , and thus adjoining any vector to it
produces a linearly dependent list. In particular, the list
(u1 , w1 , . . . , wn )
Step j
The list B (of length n) from step j −1 spans V , and thus adjoining
any vector to it produces a linearly dependent list. In particular,
the list of length (n + 1) obtained by adjoining uj to B, placing it
just after u1 , . . . , uj−1 , is linearly dependent. By the linear depen-
dence lemma (2.4), one of the vectors in this list is in the span of
the previous ones, and because (u1 , . . . , uj ) is linearly indepen-
dent, this vector must be one of the w’s, not one of the u’s. We
can remove that w from B so that the new list B (of length n)
consisting of u1 , . . . , uj and the remaining w’s spans V .
After step m, we have added all the u’s and the process stops. If at
any step we added a u and had no more w’s to remove, then we would
have a contradiction. Thus there must be at least as many w’s as u’s.
Step 1
If U = {0}, then U is finite dimensional and we are done. If U =
{0}, then choose a nonzero vector v1 ∈ U .
Step j
If U = span(v1 , . . . , vj−1 ), then U is finite dimensional and we are
Bases 27
Bases
A basis of V is a list of vectors in V that is linearly independent and
spans V . For example,
(1, 0, . . . , 0), (0, 1, 0, . . . , 0), . . . , (0, . . . , 0, 1)
2.9 v = a1 v1 + · · · + an vn ,
where a1 , . . . , an ∈ F.
0 = a 1 v 1 + · · · + an vn .
Step 1
If v1 = 0, delete v1 from B. If v1 = 0, leave B unchanged.
Step j
If vj is in span(v1 , . . . , vj−1 ), delete vj from B. If vj is not in
span(v1 , . . . , vj−1 ), leave B unchanged.
Stop the process after step n, getting a list B. This list B spans V
because our original list spanned B and we have discarded only vectors
that were already in the span of the previous vectors. The process
Bases 29
which spans F2 . To make sure that you understand the last proof, you
should verify that the process in the proof produces (1, 2), (4, 7) , a
basis of F2 , when applied to the list above.
Our next result, an easy corollary of the last theorem, tells us that
every finite-dimensional vector space has a basis.
2.12 Theorem: Every linearly independent list of vectors in a finite- This theorem can be
dimensional vector space can be extended to a basis of the vector space. used to give another
proof of the previous
Proof: Suppose V is finite dimensional and (v1 , . . . , vm ) is linearly corollary. Specifically,
independent in V . We want to extend (v1 , . . . , vm ) to a basis of V . We suppose V is finite
do this through the multistep process described below. First we let dimensional. This
(w1 , . . . , wn ) be any list of vectors in V that spans V . theorem implies that
the empty list () can be
Step 1 extended to a basis
If w1 is in the span of (v1 , . . . , vm ), let B = (v1 , . . . , vm ). If w1 is of V . In particular, V
not in the span of (v1 , . . . , vm ), let B = (v1 , . . . , vm , w1 ). has a basis.
30 Chapter 2. Finite-Dimensional Vector Spaces
Step j
If wj is in the span of B, leave B unchanged. If wj is not in the
span of B, extend B by adjoining wj to it.
Using the same basic 2.13 Proposition: Suppose V is finite dimensional and U is a sub-
ideas but considerably space of V . Then there is a subspace W of V such that V = U ⊕ W .
more advanced tools,
this proposition can be Proof: Because V is finite dimensional, so is U (see 2.7). Thus
proved without the there is a basis (u1 , . . . , um ) of U (see 2.11). Of course (u1 , . . . , um )
hypothesis that V is is a linearly independent list of vectors in V , and thus it can be ex-
finite dimensional. tended to a basis (u1 , . . . , um , w1 , . . . , wn ) of V (see 2.12). Let W =
span(w1 , . . . , wn ).
To prove that V = U ⊕ W , we need to show that
V =U +W and U ∩ W = {0};
v = a1 u1 + · · · + am um + b1 w1 + · · · + bn wn .
u w
v = a1 u1 + · · · + am um = b1 w1 + · · · + bn wn .
Thus
Dimension 31
a1 u1 + · · · + am um − b1 w1 − · · · − bn wn = 0.
Dimension
Though we have been discussing finite-dimensional vector spaces,
we have not yet defined the dimension of such an object. How should
dimension be defined? A reasonable definition should force the dimen-
sion of Fn to equal n. Notice that the basis
(1, 0, . . . , 0), (0, 1, 0, . . . , 0), . . . , (0, . . . , 0, 1)
The real vector space To check that a list of vectors in V is a basis of V , we must, according
R has dimension 2;
2
to the definition, show that the list in question satisfies two properties:
the complex vector it must be linearly independent and it must span V . The next two
space C has results show that if the list in question has the right length, then we
dimension 1. As sets, need only check that it satisfies one of the required two properties.
R2 can be identified We begin by proving that every spanning list with the right length is a
with C (and addition is basis.
the same on both
spaces, as is scalar 2.16 Proposition: If V is finite dimensional, then every spanning
multiplication by real list of vectors in V with length dim V is a basis of V .
numbers). Thus when
we talk about the Proof: Suppose dim V = n and (v1 , . . . , vn ) spans V . The list
dimension of a vector (v1 , . . . , vn ) can be reduced to a basis of V (by 2.10). However, every
space, the role played basis of V has length n, so in this case the reduction must be the trivial
by the choice of F one, meaning that no elements are deleted from (v1 , . . . , vn ). In other
cannot be neglected. words, (v1 , . . . , vn ) is a basis of V , as desired.
Because F2 has dimension 2, the last proposition implies that this lin-
early independent list of length 2 is a basis of F2 (we do not need to
bother checking that it spans F2 ).
The next theorem gives a formula for the dimension of the sum of
two subspaces of a finite-dimensional vector space.
2.18 Theorem: If U1 and U2 are subspaces of a finite-dimensional This formula for the
vector space, then dimension of the sum
of two subspaces is
dim(U1 + U2 ) = dim U1 + dim U2 − dim(U1 ∩ U2 ). analogous to a familiar
counting formula: the
Proof: Let (u1 , . . . , um ) be a basis of U1 ∩ U2 ; thus dim(U1 ∩ U2 ) = number of elements in
m. Because (u1 , . . . , um ) is a basis of U1 ∩ U2 , it is linearly independent the union of two finite
in U1 and hence can be extended to a basis (u1 , . . . , um , v1 , . . . , vj ) of U1 sets equals the number
(by 2.12). Thus dim U1 = m + j. Also extend (u1 , . . . , um ) to a basis of elements in the first
(u1 , . . . , um , w1 , . . . , wk ) of U2 ; thus dim U2 = m + k. set, plus the number of
We will show that (u1 , . . . , um , v1 , . . . , vj , w1 , . . . , wk ) is a basis of elements in the second
U1 + U2 . This will complete the proof because then we will have set, minus the number
of elements in the
dim(U1 + U2 ) = m + j + k intersection of the two
= (m + j) + (m + k) − m sets.
a1 u1 + · · · + am um + b1 v1 + · · · + bj vj + c1 w1 + · · · + ck wk = 0,
where all the a’s, b’s, and c’s are scalars. We need to prove that all the
a’s, b’s, and c’s equal 0. The equation above can be rewritten as
c1 w1 + · · · + ck wk = −a1 u1 − · · · − am um − b1 v1 − · · · − bj vj ,
c1 w1 + · · · + ck wk = d1 u1 + · · · + dm um
34 Chapter 2. Finite-Dimensional Vector Spaces
a1 u1 + · · · + am um + b1 v1 + · · · + bj vj = 0.
This equation implies that all the a’s and b’s are 0 because the list
(u1 , . . . , um , v1 , . . . , vj ) is linearly independent. We now know that all
the a’s, b’s, and c’s equal 0, as desired.
The next proposition shows that dimension meshes well with direct
sums. This result will be useful in later chapters.
Recall that direct sum 2.19 Proposition: Suppose V is finite dimensional and U1 , . . . , Um
is analogous to disjoint are subspaces of V such that
union. Thus 2.19 is
analogous to the 2.20 V = U1 + · · · + U m
statement that if a
and
finite set B is written as
A1 ∪ · · · ∪ Am and the
2.21 dim V = dim U1 + · · · + dim Um .
sum of the number of
elements in the A’s Then V = U1 ⊕ · · · ⊕ Um .
equals the number of
elements in B, then the Proof: Choose a basis for each Uj . Put these bases together in
union is a disjoint one list, forming a list that spans V (by 2.20) and has length dim V
union. (by 2.21). Thus this list is a basis of V (by 2.16), and in particular it is
linearly independent.
Now suppose that u1 ∈ U1 , . . . , um ∈ Um are such that
0 = u 1 + · · · + um .
Exercises
1. Prove that if (v1 , . . . , vn ) spans V , then so does the list
(v1 − v2 , v2 − v3 , . . . , vn−1 − vn , vn )
6. Prove that the real vector space consisting of all continuous real-
valued functions on the interval [0, 1] is infinite dimensional.
Find a basis of U.
V = U1 ⊕ · · · ⊕ Un .
36 Chapter 2. Finite-Dimensional Vector Spaces
15. You might guess, by analogy with the formula for the number
of elements in the union of three subsets of a finite set, that
if U1 , U2 , U3 are subspaces of a finite-dimensional vector space,
then
dim(U1 + U2 + U3 )
= dim U1 + dim U2 + dim U3
− dim(U1 ∩ U2 ) − dim(U1 ∩ U3 ) − dim(U2 ∩ U3 )
+ dim(U1 ∩ U2 ∩ U3 ).