Section 4.1 Vectors in ℝ n

ℝ n Vectors Vector addition Scalar multiplication.

Def. Let v 1, v 2,... v n be vectors in ℝ n. A linear combination of these vectors is an expression c 1 v 1 + c 2 v c n v n where c 1, c 2,...., c n are some scalars.

Ex. (a) If possible, write as a linear combination of and.

Ex. (b) If possible, write as a linear combination of and.

Ex. (c) If possible, write as a linear combination of and.

Ex. Verify your answers geometrically for the last example. (a) written as a linear combination of and.

Ex. Verify your answers geometrically for the last example. (b) written as a linear combination of and.

Ex. Verify your answers geometrically for the last example. (c) written as a linear combination of and.

Properties of vectors in ℝ n Let u, v, and w be vectors in ℝ n and let c and d be scalars. 1. u + v is in ℝ n 2. u + v = v + u 3. ( u + v ) + w = u + ( v + w ) 4. There is a vector 0 such that u + 0 = u for all u in ℝ n 5. For all u in ℝ n there is a vector – u such that u + (– u ) = 0 6. c u is in ℝ n 7. c( u + v ) = c u + c v 8. (c + d) u = c u + d u 9. c(d u ) = (cd) u 10. 1( u ) = u

Section 4.2 Vector Spaces

Def. Let V be a set on which two operations (called vector addition and scalar multiplication) are defined. V is called a vector space if V satisfies the following properties. For any u, v, and w be vectors in V and any scalars c and d: 1. u + v is in V 2. u + v = v + u 3. ( u + v ) + w = u + ( v + w ) 4. There is a vector 0 such that u + 0 = u for all u in V 5. For all u in V there is a vector – u such that u + (– u ) = 0 6. c u is in V 7. c( u + v ) = c u + c v 8. (c + d) u = c u + d u 9. c(d u ) = (cd) u 10. 1( u ) = u

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 1. ℝ n – the set of all n–tuples.

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 2. C(–∞,∞) – the set of all continuous functions defined on the real line.

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 3. C[a, b] – the set of all continuous functions defined on a closed interval [a, b].

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 4. P – the set of all polynomials.

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 5. P n – the set of all polynomials of degree ≤ n.

Examples of various vector spaces (each with the standard operations of addition and scalar multiplication): 6. M m,n – the set of all m x n matrices.

Ex. Show that the following are not examples of vector spaces. (a) The set of all integers (with the standard operations).

Ex. Show that the following are not examples of vector spaces. (b) The set of all polynomials with degree 2 (with the standard operations).

Ex. Show that the following are not examples of vector spaces. (c) The set of all invertible 2x2 matrices (with the standard operations).

Ex. Show that the following are not examples of vector spaces. (d) The set of all matrices (with the standard operations).

Ex. Let V = ℝ 2 with the standard operation of addition and the following nonstandard definition of scalar multiplication: c (x, y) = (cx, 0). Determine whether or not V is a vector space.

Section 4.3 Subspaces of Vector Spaces

Def. Let V be a vector space and let W be a subset of V. If W is itself a vector space then W is said to be a subspace of V. Note: Every vector space contains at least two subspaces, the vector space itself and the set consisting only of the zero element. These are called the trivial subspaces.

Ex. Determine whether or not the following are subspaces. (a) Let V = ℝ 3 with the standard operations. Define W to be { (x,y,0) : x and y are real numbers}.

Ex. Determine whether or not the following are subspaces. (b) Let V = ℝ 3 with the standard operations. Define W to be { (x,y,1) : x and y are real numbers}.

Theorem: Test for a Subspace Let V be a vector space and suppose W is a subset of V. W is a subspace of V if and only if the following hold: 1. If u and v are in W then u + v is in W. 2. If u is in W then c u is in W.

Ex. Let a, b, and c be constants. Show that the set of all solutions to the differential equation ay″ + by′ + cy = 0 is a subspace (a subspace of the vector space of all functions).

Note: W cannot be a subspace of V unless W contains the zero element.

Ex. Which of the following are subspaces? (a) V = ℝ 2. W = the solution set of 2x + 3y = 5.

Ex. Which of the following are subspaces? (b) V = ℝ 2. W = the solution set of -5x + y = 0.

Ex. Which of the following are subspaces? (c) V = ℝ 3. W = the solution set of 3x + 8y – 4z = 7.

Ex. Which of the following are subspaces? (d) V = ℝ 3. W = the solution set of -2x + 12y – z = 0.

All nontrivial subspaces of ℝ 2 are lines which pass through the origin. All nontrivial subspaces of ℝ 3 are planes which pass through the origin or lines which pass through the origin.

Ex. Is W = {(x, x+ z, z) : x and z are real numbers} a subspace of ℝ 3 ?

Ex. Show that the solution set to x 2 + y 2 = 1 is not a subspace of ℝ 2.

Ex. (a) Let V = ℝ 3 with the standard operations. Define W to be {(x,y,0) : x and y are real numbers}. What can W be identified with?

Ex. (b) Let V = ℝ 3 with the standard operations. Define W to be {(t, t, 3t) : t is a real number}. What can W be identified with?

Notation: P 0, P 1, P 2, P 3,...., P

Section 4.4 Spanning Sets and Linear Independence

Recall: Let v 1, v 2,... v n be vectors in ℝ n. A linear combination of these vectors is an expression c 1 v 1 + c 2 v c n v n where c 1, c 2,...., c n are some scalars.

Ex. (a) If possible, write f (x) = x 2 + x + 1 as a linear combination of g 1 (x) = x 2 + 2x + 3, g 2 (x) = x + 2, and g 3 (x) = –x

Ex. (b) If possible, write as a linear combination of,, and

Def. Let S = { v 1, v 2,... v n } be a subset of a vector space V. The span of S is the set of all linear combinations of elements of S. span(S) = {c 1 v 1 + c 2 v c n v n : c 1, c 2,.... c n are scalars}

Def. Let S = { v 1, v 2,... v n } be a subset of a vector space V. If every vector of V can be written as a linear combination of elements of S then we say S spans V. Put another way, S spans V if span(S) = V.

Ex. Show that {(1, 0, 0), (0, 1, 0), (0, 0, 1)} spans ℝ 3.

Ex. Does {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 1)} span ℝ 3 ?

Ex. Does {(1, 0, 0), (0, 1, 0)} span ℝ 3 ?

Ex. Determine whether or not {(1, 2, 3), (4, 5, 6), (7, 8, 9)} spans ℝ 3. If it does, then write a general vector (x, y, z) as a linear combination of these vectors. If it does not, then find a vector in ℝ 3 which it does not span.

Ex.Determine whether or not {(1, 2, 3), (4, 5, 6), (–1, 1, 3)} spans ℝ 3. If it does, then write a general vector (x, y, z) as a linear combination of these vectors. If it does not, then find a vector in ℝ 3 which it does not span.

Ex.Give a set which spans... (a) ℝ 2 (b) M 23 (c) P 2

We shall be interested in spanning a vector space with as few vectors as possible.

Def. Suppose v 1, v 2,... v n are vectors in a vector space V. v 1, v 2,... v n are said to be linearly independent if the only linear combination of these vectors which produces the zero element is the trivial one. (i.e. if the only solution to the equation c 1 v 1 + c 2 v c n v n = 0 happens to be the trivial solution c 1 = c 2 =... = c n = 0)

Ex. Use the definition of linear independence to determine whether the following are linearly independent or linearly dependent. (a) (1,0), (0,1)

Ex. Use the definition of linear independence to determine whether the following are linearly independent or linearly dependent. (b) (1,2,3), (4,5,6), (7,8,9)

Ex. Use the definition of linear independence to determine whether the following are linearly independent or linearly dependent. (c) (1,0), (0,1), (2,3)

Ex. Use the definition of linear independence to determine whether the following are linearly independent or linearly dependent. (d) (1,2), (3,6)

Ex. Use the definition of linear independence to determine whether the following are linearly independent or linearly dependent. (e) (1,2,3), (4,5,6), (-1,1,3)

Theorem: v 1, v 2,... v n are linearly dependent if and only if one of the vectors can be written as a linear combination of the others.

Theorem: Let v 1, v 2,... v n be vectors in a vector space V. Then span({ v 1, v 2,... v n }) is a subspace of V.

Section 4.5 Basis and Dimension

We seek a set of vectors in a vector space which will span the entire vector space, but has as few vectors as possible to do so.

Def.{ v 1, v 2,... v n } is a basis for a vector space V if: 1. { v 1, v 2,... v n } spans V. 2. { v 1, v 2,... v n } is a linearly independent set.

Standard bases: ℝ 2

Standard bases: ℝ 3

Standard bases: ℝ n

Standard bases: M 22

Standard bases: P 2

Nonstandard bases.

Ex. Show that {(1,2,3), (0,1,2), (-2,0,1)} is a basis for ℝ 3.

Compare the following three sets to see why we impose these two restrictions in our definition of a basis: 1. span( {(1, 0, 0), (0, 1, 0), (0, 0, 1)} )

Compare the following three sets to see why we impose these two restrictions in our definition of a basis: 1. span( {(1, 0, 0), (0, 1, 0), (0, 0, 1)} ) 2. span( {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 1)} )

Compare the following three sets to see why we impose these two restrictions in our definition of a basis: 1. span( {(1, 0, 0), (0, 1, 0), (0, 0, 1)} ) 2. span( {(1, 0, 0), (0, 1, 0), (0, 0, 1), (1, 1, 1)} ) 3. span( {(1, 0, 0), (0, 1, 0)} )

Theorem: S = { v 1, v 2,..., v n } is a basis for V if and only if every element of V can be written as a linear combination of v 1, v 2,..., and v n in one and only one way.

Theorem: If a vector space V has a basis with n vectors, then every basis for V has n vectors. Def. The dimension of a vector space V, denoted dim(V), is the number of vectors in a basis for V.

ℝ n has dimension __________ P n has dimension __________ M mn has dimension _________

Ex. Quickly show that {(1, 2, 6), (-4, 1, 4), (24, 0, 1), (1, 6, 1)} is not a basis for ℝ 3.

Note: If you know V has dimension n then to ascertain whether or not S = { v 1, v 2,..., v n } is a basis, you only need to check one of the two defining properties of a basis (i.e. check whether S is linearly independent or check whether S spans V, but you do not need to check both.)

Recall: The solution set to the differential equation ay″ + by′ + cy = 0 is a vector space. Notice what an impact these last theorems have on us trying to find a way to describe the solutions to a differential equation like this.

Ex. Find all the solutions to y″ – 3y′ + 2y = 0.

Ex.Find the dimension of the following vector spaces: (a) V = {(d, c-d, d) : c and d are real numbers}

Ex.Find the dimension of the following vector spaces: (b) V = {(2b, b, 0) : b is a real number}

Ex.Find the dimension of the following vector spaces: (c) V =

Section 4.6 Rank of a Matrix and Systems of Linear Equations

Def.Given a matrix A,.... (a) the row space of A is the span of the row vectors of A. (b) the column space of A is the span of the column vectors of A.

Ex.Let (a) List a few vectors in the row space of A. (b) List a few vectors in the column space of A.

Ex.Let (c) Find a basis for the row space of A. Then write a general vector in the row space, (x, y, z) as a linear combination of these

Ex.Let (d) Find a basis for the column space of A. Then write a general vector in the column space, (x, y) as a linear combination of these

Ex.Let (e) Solve AX = B using B = [11 29] T by using your answer from part (d).

Ex.Let (f) The dimension of the row space of A is _______. The dimension of the column space of A is ______.

Theorem: Let A be a matrix. The dimension of the row space of A equals the dimension of the column space of A. Def. The rank of a matrix A, denoted rank(A), is the dimension of the row space of A (which is also the dimension of the column space of A).

Ex. Give the rank of

Theorem: Let A be a given matrix and A * be a matrix produced after applying elementary row operations on A. Then the row space of A is equal to the row space of A *. (Note: This does not say that the column space of A is equal to the column space of A *.)

Ex. Give the rank of

Def. Given a matrix A, the nullspace of A is defined to be all of the column matrices X so that AX = O. The dimension of the nullspace of A is called the nullity of A.

Ex. Verify that the nullspace of a matrix A is indeed a subspace.

Ex. Let A = (a) Verify that is in the nullspace of A.

Ex. Let A = (b) Find the nullspace of A. (Give your answer as a span of basis vectors.)

Ex. Let A = (c) Determine the linear combination of basis vectors that generates

Given a matrix A, we know that the solutions to AX = O form a vector space. The solutions to AX = B do not form a solution space (if B ≠ O), but we can use the solutions to AX = O to help us give a general solution to AX = B.

Theorem: Suppose we are given an m x n matrix A and an nx1 column matrix B. Further suppose that X h is the general solution to AX = O, and X p is one particular solution to AX = B. The general solution to AX = B is then given by X p + X h.

Ex. Use this theorem to describe all the solutions to the following system: x 1 – 2x 3 + x 4 = 5 3x 1 + x 2 – 5x 3 = 8 x 1 + 2x 2 – 5x 4 = –9

Recall that the solutions to the differential equation ay″ + by′ + cy = 0 form a vector space. The solutions to the differential equation ay″ + by′ + cy = f (x) do not form a vector space (if f (x) ≠ 0). Compare this with the info in the paragraph at the top of this page. We can use the previous theorem to describe the solution set to ay″ + by′ + cy = f (x).

Ex. Find all the solutions to y″ – 3y′ + 2y = 14e –x.