Section SD Similarity and Diagonalization

From A First Course in Linear Algebra
Version 1.30
© 2004.
Licensed under the GNU Free Documentation License.
http://linear.ups.edu/

This section’s topic will perhaps seem out of place at first, but we will make the connection soon with eigenvalues and eigenvectors. This is also our first look at one of the central ideas of Chapter R.

Subsection SM: Similar Matrices

The notion of matrices being “similar” is a lot like saying two matrices are row-equivalent. Two similar matrices are not equal, but they share many important properties. This section, and later sections in Chapter R will be devoted in part to discovering just what these common properties are.

First, the main definition for this section.

Definition SIM
Similar Matrices
Suppose $A$ and $B$ are two square matrices of size $n$ . Then $A$ and $B$ are similar if there exists a nonsingular matrix of size $n$ , $S$ , such that $A = S^{- 1} B S$ . $△$

We will say “ $A$ is similar to $B$ via $S$ ” when we want to emphasize the role of $S$ in the relationship between $A$ and $B$ . Also, it doesn’t matter if we say $A$ is similar to $B$ , or $B$ is similar to $A$ . If one statement is true then so is the other, as can be seen by using $S^{- 1}$ in place of $S$ (see Theorem SER for the careful proof). Finally, we will refer to $S^{- 1} B S$ as a similarity transformation when we want to emphasize the way $S$ changes $B$ . OK, enough about language, let’s build a few examples.

Example SMS5
Similar matrices of size 5
If you wondered if there are examples of similar matrices, then it won’t be hard to convince you they exist. Define

\begin{array}{l} B = [\begin{matrix} - 4 & 1 & - 3 & - 2 & 2 \\ 1 & 2 & - 1 & 3 & - 2 \\ - 4 & 1 & 3 & 2 & 2 \\ - 3 & 4 & - 2 & - 1 & - 3 \\ 3 & 1 & - 1 & 1 & - 4 \end{matrix}] & S = [\begin{matrix} 1 & 2 & - 1 & 1 & 1 \\ 0 & 1 & - 1 & - 2 & - 1 \\ 1 & 3 & - 1 & 1 & 1 \\ - 2 & - 3 & 3 & 1 & - 2 \\ 1 & 3 & - 1 & 2 & 1 \end{matrix}] \end{array}

Check that $S$ is nonsingular and then compute

\begin{array}{l} A & = S^{- 1} B S \\ = [\begin{matrix} 10 & 1 & 0 & 2 & - 5 \\ - 1 & 0 & 1 & 0 & 0 \\ 3 & 0 & 2 & 1 & - 3 \\ 0 & 0 & - 1 & 0 & 1 \\ - 4 & - 1 & 1 & - 1 & 1 \end{matrix}] [\begin{matrix} - 4 & 1 & - 3 & - 2 & 2 \\ 1 & 2 & - 1 & 3 & - 2 \\ - 4 & 1 & 3 & 2 & 2 \\ - 3 & 4 & - 2 & - 1 & - 3 \\ 3 & 1 & - 1 & 1 & - 4 \end{matrix}] [\begin{matrix} 1 & 2 & - 1 & 1 & 1 \\ 0 & 1 & - 1 & - 2 & - 1 \\ 1 & 3 & - 1 & 1 & 1 \\ - 2 & - 3 & 3 & 1 & - 2 \\ 1 & 3 & - 1 & 2 & 1 \end{matrix}] \\ = [\begin{matrix} - 10 & - 27 & - 29 & - 80 & - 25 \\ - 2 & 6 & 6 & 10 & - 2 \\ - 3 & 11 & - 9 & - 14 & - 9 \\ - 1 & - 13 & 0 & - 10 & - 1 \\ 11 & 35 & 6 & 49 & 19 \end{matrix}] \end{array}

So by this construction, we know that $A$ and $B$ are similar. $⊠$

Let’s do that again.

Example SMS3
Similar matrices of size 3
Define

\begin{array}{l} B = [\begin{matrix} - 13 & - 8 & - 4 \\ 12 & 7 & 4 \\ 24 & 16 & 7 \end{matrix}] & S = [\begin{matrix} 1 & 1 & 2 \\ - 2 & - 1 & - 3 \\ 1 & - 2 & 0 \end{matrix}] \end{array}

Check that $S$ is nonsingular and then compute

\begin{array}{l} A & = S^{- 1} B S \\ = [\begin{matrix} - 6 & - 4 & - 1 \\ - 3 & - 2 & - 1 \\ 5 & 3 & 1 \end{matrix}] [\begin{matrix} - 13 & - 8 & - 4 \\ 12 & 7 & 4 \\ 24 & 16 & 7 \end{matrix}] [\begin{matrix} 1 & 1 & 2 \\ - 2 & - 1 & - 3 \\ 1 & - 2 & 0 \end{matrix}] \\ = [\begin{matrix} - 1 & 0 & 0 \\ 0 & 3 & 0 \\ 0 & 0 & - 1 \end{matrix}] \end{array}

So by this construction, we know that $A$ and $B$ are similar. But before we move on, look at how pleasing the form of $A$ is. Not convinced? Then consider that several computations related to $A$ are especially easy. For example, in the spirit of Example DUTM, $det (A) = (- 1) (3) (- 1) = 3$ . Similarly, the characteristic polynomial is straightforward to compute by hand, $p_{A} (x) = (- 1 - x) (3 - x) (- 1 - x) = - (x - 3) {(x + 1)}^{2}$ and since the result is already factored, the eigenvalues are transparently $λ = 3, - 1$ . Finally, the eigenvectors of $A$ are just the standard unit vectors (Definition SUV). $⊠$

Subsection PSM: Properties of Similar Matrices

Similar matrices share many properties and it is these theorems that justify the choice of the word “similar.” First we will show that similarity is an equivalence relation. Equivalence relations are important in the study of various algebras and can always be regarded as a kind of weak version of equality. Sort of alike, but not quite equal. The notion of two matrices being row-equivalent is an example of an equivalence relation we have been working with since the beginning of the course (see Exercise RREF.T11). Row-equivalent matrices are not equal, but they are a lot alike. For example, row-equivalent matrices have the same rank. Formally, an equivalence relation requires three conditions hold: reflexive, symmetric and transitive. We will illustrate these as we prove that similarity is an equivalence relation.

Theorem SER
Similarity is an Equivalence Relation
Suppose $A$ , $B$ and $C$ are square matrices of size $n$ . Then

$A$ is similar to $A$ . (Reflexive)
If $A$ is similar to $B$ , then $B$ is similar to $A$ . (Symmetric)
If $A$ is similar to $B$ and $B$ is similar to $C$ , then $A$ is similar to $C$ . (Transitive)

□

Proof To see that $A$ is similar to $A$ , we need only demonstrate a nonsingular matrix that effects a similarity transformation of $A$ to $A$ . $I_{n}$ is nonsingular (since it row-reduces to the identity matrix, Theorem NMRRI), and

I_{n}^{- 1} A I_{n} = I_{n} A I_{n} = A

If we assume that $A$ is similar to $B$ , then we know there is a nonsingular matrix $S$ so that $A = S^{- 1} B S$ by Definition SIM. By Theorem MIMI, $S^{- 1}$ is invertible, and by Theorem NI is therefore nonsingular. So

\begin{array}{l} {(S^{- 1})}^{- 1} A (S^{- 1}) & = S A S^{- 1} & Theorem MIMI \\ = S S^{- 1} B S S^{- 1} & Definition SIM \\ = (S S^{- 1}) B (S S^{- 1}) & Theorem MMA \\ = I_{n} B I_{n} & Definition MI \\ = B & Theorem MMIM \end{array}

and we see that $B$ is similar to $A$ .

Assume that $A$ is similar to $B$ , and $B$ is similar to $C$ . This gives us the existence of two nonsingular matrices, $S$ and $R$ , such that $A = S^{- 1} B S$ and $B = R^{- 1} C R$ , by Definition SIM. (Notice how we have to assume $S \neq R$ , as will usually be the case.) Since $S$ and $R$ are invertible, so too $R S$ is invertible by Theorem SS and then nonsingular by Theorem NI. Now

\begin{array}{l} {(R S)}^{- 1} C (R S) & = S^{- 1} R^{- 1} C R S & Theorem SS \\ = S^{- 1} (R^{- 1} C R) S & Theorem MMA \\ = S^{- 1} B S & Definition SIM \\ = A \end{array}

so $A$ is similar to $C$ via the nonsingular matrix $R S$ . $■$

Here’s another theorem that tells us exactly what sorts of properties similar matrices share.

Theorem SMEE
Similar Matrices have Equal Eigenvalues
Suppose $A$ and $B$ are similar matrices. Then the characteristic polynomials of $A$ and $B$ are equal, that is, $p_{A} (x) = p_{B} (x)$ . $□$

Proof Let $n$ denote the size of $A$ and $B$ . Since $A$ and $B$ are similar, there exists a nonsingular matrix $S$ , such that $A = S^{- 1} B S$ (Definition SIM). Then

\begin{array}{l} p_{A} (x) & = det (A - x I_{n}) & Definition CP \\ = det (S^{- 1} B S - x I_{n}) & Definition SIM \\ = det (S^{- 1} B S - x S^{- 1} I_{n} S) & Theorem MMIM \\ = det (S^{- 1} B S - S^{- 1} x I_{n} S) & Theorem MMSMM \\ = det (S^{- 1} (B - x I_{n}) S) & Theorem MMDAA \\ = det (S^{- 1}) det (B - x I_{n}) det (S) & Theorem DRMM \\ = det (S^{- 1}) det (S) det (B - x I_{n}) & Property CMCN \\ = det (S^{- 1} S) det (B - x I_{n}) & Theorem DRMM \\ = det (I_{n}) det (B - x I_{n}) & Definition MI \\ = 1 det (B - x I_{n}) & Definition DM \\ = p_{B} (x) & Definition CP \end{array}

■

So similar matrices not only have the same set of eigenvalues, the algebraic multiplicities of these eigenvalues will also be the same. However, be careful with this theorem. It is tempting to think the converse is true, and argue that if two matrices have the same eigenvalues, then they are similar. Not so, as the following example illustrates.

Example EENS
Equal eigenvalues, not similar
Define

\begin{array}{l} A & = [\begin{matrix} 1 & 1 \\ 0 & 1 \end{matrix}] & B & = [\begin{matrix} 1 & 0 \\ 0 & 1 \end{matrix}] \end{array}

and check that

p_{A} (x) = p_{B} (x) = 1 - 2 x + x^{2} = {(x - 1)}^{2}

and so $A$ and $B$ have equal characteristic polynomials. If the converse of Theorem SMEE were true, then $A$ and $B$ would be similar. Suppose this is the case. More precisely, suppose there is a nonsingular matrix $S$ so that $A = S^{- 1} B S$ . Then

A = S^{- 1} B S = S^{- 1} I_{2} S = S^{- 1} S = I_{2}

Clearly $A \neq I_{2}$ and this contradiction tells us that the converse of Theorem SMEE is false. $⊠$

Subsection D: Diagonalization

Good things happen when a matrix is similar to a diagonal matrix. For example, the eigenvalues of the matrix are the entries on the diagonal of the diagonal matrix. And it can be a much simpler matter to compute high powers of the matrix. Diagonalizable matrices are also of interest in more abstract settings. Here are the relevant definitions, then our main theorem for this section.

Definition DIM
Diagonal Matrix
Suppose that $A$ is a square matrix. Then $A$ is a diagonal matrix if ${[A]}_{i j} = 0$ whenever $i \neq j$ . $△$

Definition DZM
Diagonalizable Matrix
Suppose $A$ is a square matrix. Then $A$ is diagonalizable if $A$ is similar to a diagonal matrix. $△$

Example DAB
Diagonalization of Archetype B
Archetype B has a $3 \times 3$ coefficient matrix

B = [\begin{matrix} - 7 & - 6 & - 12 \\ 5 & 5 & 7 \\ 1 & 0 & 4 \end{matrix}]

and is similar to a diagonal matrix, as can be seen by the following computation with the nonsingular matrix $S$ ,

\begin{array}{l} S^{- 1} B S & = {[\begin{matrix} - 5 & - 3 & - 2 \\ 3 & 2 & 1 \\ 1 & 1 & 1 \end{matrix}]}^{- 1} [\begin{matrix} - 7 & - 6 & - 12 \\ 5 & 5 & 7 \\ 1 & 0 & 4 \end{matrix}] [\begin{matrix} - 5 & - 3 & - 2 \\ 3 & 2 & 1 \\ 1 & 1 & 1 \end{matrix}] \\ = [\begin{matrix} - 1 & - 1 & - 1 \\ 2 & 3 & 1 \\ - 1 & - 2 & 1 \end{matrix}] [\begin{matrix} - 7 & - 6 & - 12 \\ 5 & 5 & 7 \\ 1 & 0 & 4 \end{matrix}] [\begin{matrix} - 5 & - 3 & - 2 \\ 3 & 2 & 1 \\ 1 & 1 & 1 \end{matrix}] \\ = [\begin{matrix} - 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & 0 & 2 \end{matrix}] \end{array}

⊠

Example SMS3 provides yet another example of a matrix that is subjected to a similarity transformation and the result is a diagonal matrix. Alright, just how would we find the magic matrix $S$ that can be used in a similarity transformation to produce a diagonal matrix? Before you read the statement of the next theorem, you might study the eigenvalues and eigenvectors of Archetype B and compute the eigenvalues and eigenvectors of the matrix in Example SMS3.

Theorem DC
Diagonalization Characterization
Suppose $A$ is a square matrix of size $n$ . Then $A$ is diagonalizable if and only if there exists a linearly independent set $S$ that contains $n$ eigenvectors of $A$ . $□$

Proof ( $\Leftarrow$ ) Let $S = \{x_{1}, x_{2}, x_{3}, \dots, x_{n}\}$ be a linearly independent set of eigenvectors of $A$ for the eigenvalues $λ_{1}, λ_{2}, λ_{3}, \dots, λ_{n}$ . Recall Definition SUV and define

\begin{array}{l} R & = [x_{1} | x_{2} | x_{3} | \dots | x_{n}] \\ D & = [\begin{matrix} λ_{1} & 0 & 0 & \dots & 0 \\ 0 & λ_{2} & 0 & \dots & 0 \\ 0 & 0 & λ_{3} & \dots & 0 \\ ⋮ & ⋮ & ⋮ & ⋮ \\ 0 & 0 & 0 & \dots & λ_{n} \end{matrix}] = [λ_{1} e_{1} | λ_{2} e_{2} | λ_{3} e_{3} | \dots | λ_{n} e_{n}] \end{array}

The columns of $R$ are the vectors of the linearly independent set $S$ and so by Theorem NMLIC the matrix $R$ is nonsingular. By Theorem NI we know $R^{- 1}$ exists.

\begin{array}{l} R^{- 1} A R & = R^{- 1} A [x_{1} | x_{2} | x_{3} | \dots | x_{n}] \\ = R^{- 1} [A x_{1} | A x_{2} | A x_{3} | \dots | A x_{n}] & Definition MM \\ = R^{- 1} [λ_{1} x_{1} | λ_{2} x_{2} | λ_{3} x_{3} | \dots | λ_{n} x_{n}] & x_{i} eigenvector of A for λ_{i} \\ = R^{- 1} [λ_{1} R e_{1} | λ_{2} R e_{2} | λ_{3} R e_{3} | \dots | λ_{n} R e_{n}] & Definition MVP \\ = R^{- 1} [R (λ_{1} e_{1}) | R (λ_{2} e_{2}) | R (λ_{3} e_{3}) | \dots | R (λ_{n} e_{n})] & Theorem MMSMM \\ = R^{- 1} R [λ_{1} e_{1} | λ_{2} e_{2} | λ_{3} e_{3} | \dots | λ_{n} e_{n}] & Definition MM \\ = I_{n} D & Definition MI \\ = D & Theorem MMIM \end{array}

This says that $A$ is similar to the diagonal matrix $D$ via the nonsingular matrix $R$ . Thus $A$ is diagonalizable (Definition DZM).

( $\Rightarrow$ ) Suppose that $A$ is diagonalizable, so there is a nonsingular matrix of size $n$

\begin{array}{l} T & = [y_{1} | y_{2} | y_{3} | \dots | y_{n}] \\ and a diagonal matrix (recall Definition SUV) \\ E & = [\begin{matrix} d_{1} & 0 & 0 & \dots & 0 \\ 0 & d_{2} & 0 & \dots & 0 \\ 0 & 0 & d_{3} & \dots & 0 \\ ⋮ & ⋮ & ⋮ & ⋮ \\ 0 & 0 & 0 & \dots & d_{n} \end{matrix}] = [d_{1} e_{1} | d_{2} e_{2} | d_{3} e_{3} | \dots | d_{n} e_{n}] \end{array}

such that $T^{- 1} A T = E$ . Then consider,

\begin{array}{l} [A y_{1} | A y_{2} | A y_{3} | \dots | A y_{n}] & = A [y_{1} | y_{2} | y_{3} | \dots | y_{n}] & Definition MM \\ = A T \\ = I_{n} A T & Theorem MMIM \\ = T T^{- 1} A T & Definition MI \\ = T E & Substitution \\ = T [d_{1} e_{1} | d_{2} e_{2} | d_{3} e_{3} | \dots | d_{n} e_{n}] \\ = [T (d_{1} e_{1}) | T (d_{2} e_{2}) | T (d_{3} e_{3}) | \dots | T (d_{n} e_{n})] & Definition MM \\ = [d_{1} T e_{1} | d_{2} T e_{2} | d_{3} T e_{3} | \dots | d_{n} T e_{n}] & Definition MM \\ = [d_{1} y_{1} | d_{2} y_{2} | d_{3} y_{3} | \dots | d_{n} y_{n}] & Definition MVP \end{array}

This equality of matrices (Definition ME) allows us to conclude that the individual columns are equal vectors (Definition CVE). That is,

A y_{i} = d_{i} y_{i}

for

1 \leq i \leq n

. In other words,

y_{i}

is an eigenvector of

A

for the eigenvalue

d_{i}

1 \leq i \leq n

. (Why can’t

y_{i} = 0

?). Because

T

is nonsingular, the set containing

T

’s columns,

S = \{y_{1}, y_{2}, y_{3}, \dots, y_{n}\}

, is a linearly independent set (Theorem NMLIC). So the set

S

has all the required properties.

■

Notice that the proof of Theorem DC is constructive. To diagonalize a matrix, we need only locate $n$ linearly independent eigenvectors. Then we can construct a nonsingular matrix using the eigenvectors as columns ( $R$ ) so that $R^{- 1} A R$ is a diagonal matrix ( $D$ ). The entries on the diagonal of $D$ will be the eigenvalues of the eigenvectors used to create $R$ , in the same order as the eigenvectors appear in $R$ . We illustrate this by diagonalizing some matrices.

Example DMS3
Diagonalizing a matrix of size 3
Consider the matrix

F = [\begin{matrix} - 13 & - 8 & - 4 \\ 12 & 7 & 4 \\ 24 & 16 & 7 \end{matrix}]

of Example CPMS3, Example EMS3 and Example ESMS3. $F$ ’s eigenvalues and eigenspaces are

\begin{array}{l} λ & = 3 & ℰ_{F} (3) & = 〈\{[\begin{matrix} - \frac{1}{2} \\ \frac{1}{2} \\ 1 \end{matrix}]\}〉 \\ λ & = - 1 & ℰ_{F} (- 1) & = 〈\{[\begin{matrix} - \frac{2}{3} \\ 1 \\ 0 \end{matrix}], [\begin{matrix} - \frac{1}{3} \\ 0 \\ 1 \end{matrix}]\}〉 \end{array}

Define the matrix $S$ to be the $3 \times 3$ matrix whose columns are the three basis vectors in the eigenspaces for $F$ ,

S = [\begin{matrix} - \frac{1}{2} & - \frac{2}{3} & - \frac{1}{3} \\ \frac{1}{2} & 1 & 0 \\ 1 & 0 & 1 \end{matrix}]

Check that $S$ is nonsingular (row-reduces to the identity matrix, Theorem NMRRI or has a nonzero determinant, Theorem SMZD). Then the three columns of $S$ are a linearly independent set (Theorem NMLIC). By Theorem DC we now know that $F$ is diagonalizable. Furthermore, the construction in the proof of Theorem DC tells us that if we apply the matrix $S$ to $F$ in a similarity transformation, the result will be a diagonal matrix with the eigenvalues of $F$ on the diagonal. The eigenvalues appear on the diagonal of the matrix in the same order as the eigenvectors appear in $S$ . So,

\begin{array}{l} S^{- 1} F S & = {[\begin{matrix} - \frac{1}{2} & - \frac{2}{3} & - \frac{1}{3} \\ \frac{1}{2} & 1 & 0 \\ 1 & 0 & 1 \end{matrix}]}^{- 1} [\begin{matrix} - 13 & - 8 & - 4 \\ 12 & 7 & 4 \\ 24 & 16 & 7 \end{matrix}] [\begin{matrix} - \frac{1}{2} & - \frac{2}{3} & - \frac{1}{3} \\ \frac{1}{2} & 1 & 0 \\ 1 & 0 & 1 \end{matrix}] \\ = [\begin{matrix} 6 & 4 & 2 \\ - 3 & - 1 & - 1 \\ - 6 & - 4 & - 1 \end{matrix}] [\begin{matrix} - 13 & - 8 & - 4 \\ 12 & 7 & 4 \\ 24 & 16 & 7 \end{matrix}] [\begin{matrix} - \frac{1}{2} & - \frac{2}{3} & - \frac{1}{3} \\ \frac{1}{2} & 1 & 0 \\ 1 & 0 & 1 \end{matrix}] \\ = [\begin{matrix} 3 & 0 & 0 \\ 0 & - 1 & 0 \\ 0 & 0 & - 1 \end{matrix}] \end{array}

Note that the above computations can be viewed two ways. The proof of Theorem DC tells us that the four matrices ( $F$ , $S$ , $F^{- 1}$ and the diagonal matrix) will interact the way we have written the equation. Or as an example, we can actually perform the computations to verify what the theorem predicts. $⊠$

The dimension of an eigenspace can be no larger than the algebraic multiplicity of the eigenvalue by Theorem ME. When every eigenvalue’s eigenspace is this large, then we can diagonalize the matrix, and only then. Three examples we have seen so far in this section, Example SMS5, Example DAB and Example DMS3, illustrate the diagonalization of a matrix, with varying degrees of detail about just how the diagonalization is achieved. However, in each case, you can verify that the geometric and algebraic multiplicities are equal for every eigenvalue. This is the substance of the next theorem.

Theorem DMFE
Diagonalizable Matrices have Full Eigenspaces
Suppose $A$ is a square matrix. Then $A$ is diagonalizable if and only if $γ_{A} (λ) = α_{A} (λ)$ for every eigenvalue $λ$ of $A$ . $□$

Proof Suppose $A$ has size $n$ and $k$ distinct eigenvalues, $λ_{1}, λ_{2}, λ_{3}, \dots, λ_{k}$ . Let $S_{i} = \{x_{i 1}, x_{i 2}, x_{i 3}, \dots, x_{i γ_{A} (λ_{i})}\}$ , denote a basis for the eigenspace of $λ_{i}$ , $ℰ_{A} (λ_{i})$ , for $1 \leq i \leq k$ . Then

S = S_{1} \cup S_{2} \cup S_{3} \cup \dots \cup S_{k}

is a set of eigenvectors for $A$ . A vector cannot be an eigenvector for two different eigenvalues (see Exercise EE.T20) so $S_{i} \cap S_{j} = \emptyset$ whenever $i \neq j$ . In other words, $S$ is a disjoint union of $S_{i}$ , $1 \leq i \leq k$ .

( $\Leftarrow$ ) The size of $S$ is

\begin{array}{l} |S| & = \sum_{i = 1}^{k} γ_{A} (λ_{i}) & S disjoint union of S_{i} \\ = \sum_{i = 1}^{k} α_{A} (λ_{i}) & Hypothesis \\ = n & Theorem NEM \end{array}

We next show that $S$ is a linearly independent set. So we will begin with a relation of linear dependence on $S$ , using doubly-subscripted scalars and eigenvectors,

\begin{array}{l} 0 & = (a_{11} x_{11} + a_{12} x_{12} + \dots + a_{1 γ_{A} (λ_{1})} x_{1 γ_{A} (λ_{1})}) + (a_{21} x_{21} + a_{22} x_{22} + \dots + a_{2 γ_{A} (λ_{2})} x_{2 γ_{A} (λ_{2})}) \\ + \dots + (a_{k 1} x_{k 1} + a_{k 2} x_{k 2} + \dots + a_{k γ_{A} (λ_{k})} x_{k γ_{A} (λ_{k})}) \end{array}

Define the vectors $y_{i}$ , $1 \leq i \leq k$ by

\begin{array}{l} y_{1} & = (a_{11} x_{11} + a_{12} x_{12} + a_{13} x_{13} + \dots + a_{γ_{A} (1 λ_{1})} x_{1 γ_{A} (λ_{1})}) \\ y_{2} & = (a_{21} x_{21} + a_{22} x_{22} + a_{23} x_{23} + \dots + a_{γ_{A} (2 λ_{2})} x_{2 γ_{A} (λ_{2})}) \\ y_{3} & = (a_{31} x_{31} + a_{32} x_{32} + a_{33} x_{33} + \dots + a_{γ_{A} (3 λ_{3})} x_{3 γ_{A} (λ_{3})}) \\ ⋮ \\ y_{k} & = (a_{k 1} x_{k 1} + a_{k 2} x_{k 2} + a_{k 3} x_{k 3} + \dots + a_{γ_{A} (k λ_{k})} x_{k γ_{A} (λ_{k})}) \end{array}

Then the relation of linear dependence becomes

\begin{array}{l} 0 & = y_{1} + y_{2} + y_{3} + \dots + y_{k} \end{array}

Since the eigenspace $ℰ_{A} (λ_{i})$ is closed under vector addition and scalar multiplication, $y_{i} \in ℰ_{A} (λ_{i})$ , $1 \leq i \leq k$ . Thus, for each $i$ , the vector $y_{i}$ is an eigenvector of $A$ for $λ_{i}$ , or is the zero vector. Recall that sets of eigenvectors whose eigenvalues are distinct form a linearly independent set by Theorem EDELI. Should any (or some) $y_{i}$ be nonzero, the previous equation would provide a nontrivial relation of linear dependence on a set of eigenvectors with distinct eigenvalues, contradicting Theorem EDELI. Thus $y_{i} = 0$ , $1 \leq i \leq k$ .

Each of the $k$ equations, $y_{i} = 0$ is a relation of linear dependence on the corresponding set $S_{i}$ , a set of basis vectors for the eigenspace $ℰ_{A} (λ_{i})$ , which is therefore linearly independent. From these relations of linear dependence on linearly independent sets we conclude that the scalars are all zero, more precisely, $a_{i j} = 0$ , $1 \leq j \leq γ_{A} (λ_{i})$ for $1 \leq i \leq k$ . This establishes that our original relation of linear dependence on $S$ has only the trivial relation of linear dependence, and hence $S$ is a linearly independent set.

We have determined that $S$ is a set of $n$ linearly independent eigenvectors for $A$ , and so by Theorem DC is diagonalizable.

( $\Rightarrow$ ) Now we assume that $A$ is diagonalizable. Aiming for a contradiction (Technique CD), suppose that there is at least one eigenvalue, say $λ_{t}$ , such that $γ_{A} (λ_{t}) \neq α_{A} (λ_{t})$ . By Theorem ME we must have $γ_{A} (λ_{t}) < α_{A} (λ_{t})$ , and $γ_{A} (λ_{i}) \leq α_{A} (λ_{i})$ for $1 \leq i \leq k$ , $i \neq t$ .

Since $A$ is diagonalizable, Theorem DC guarantees a set of $n$ linearly independent vectors, all of which are eigenvectors of $A$ . Let $n_{i}$ denote the number of eigenvectors in $S$ that are eigenvectors for $λ_{i}$ , and recall that a vector cannot be an eigenvector for two different eigenvalues (Exercise EE.T20). $S$ is a linearly independent set, so the the subset $S_{i}$ containing the $n_{i}$ eigenvectors for $λ_{i}$ must also be linearly independent. Because the eigenspace $ℰ_{A} (λ_{i})$ has dimension $γ_{A} (λ_{i})$ and $S_{i}$ is a linearly independent subset in $ℰ_{A} (λ_{i})$ , Theorem G tells us that $n_{i} \leq γ_{A} (λ_{i})$ , for $1 \leq i \leq k$ . Putting all these facts together gives,

\begin{array}{l} n & = n_{1} + n_{2} + n_{3} + \dots + n_{t} + \dots + n_{k} & Definition SU \\ \leq γ_{A} (λ_{1}) + γ_{A} (λ_{2}) + γ_{A} (λ_{3}) + \dots + γ_{A} (λ_{t}) + \dots + γ_{A} (λ_{k}) & Theorem G \\ < α_{A} (λ_{1}) + α_{A} (λ_{2}) + α_{A} (λ_{3}) + \dots + α_{A} (λ_{t}) + \dots + α_{A} (λ_{k}) & Theorem ME \\ = n & Theorem NEM \end{array}

This is a contradiction (we can’t have $n < n$ !) and so our assumption that some eigenspace had less than full dimension was false. $■$

Example SEE, Example CAEHW, Example ESMS3, Example ESMS4, Example DEMS5, Archetype B, Archetype F, Archetype K and Archetype L are all examples of matrices that are diagonalizable and that illustrate Theorem DMFE. While we have provided many examples of matrices that are diagonalizable, especially among the archetypes, there are many matrices that are not diagonalizable. Here’s one now.

Example NDMS4
A non-diagonalizable matrix of size 4
In Example EMMS4 the matrix

B = [\begin{matrix} - 2 & 1 & - 2 & - 4 \\ 12 & 1 & 4 & 9 \\ 6 & 5 & - 2 & - 4 \\ 3 & - 4 & 5 & 10 \end{matrix}]

was determined to have characteristic polynomial

p_{B} (x) = (x - 1) {(x - 2)}^{3}

and an eigenspace for $λ = 2$ of

ℰ_{B} (2) = 〈\{[\begin{matrix} - \frac{1}{2} \\ 1 \\ - \frac{1}{2} \\ 1 \end{matrix}]\}〉

So the geometric multiplicity of $λ = 2$ is $γ_{B} (2) = 1$ , while the algebraic multiplicity is $α_{B} (2) = 3$ . By Theorem DMFE, the matrix $B$ is not diagonalizable. $⊠$

Archetype A is the lone archetype with a square matrix that is not diagonalizable, as the algebraic and geometric multiplicities of the eigenvalue $λ = 0$ differ. Example HMEM5 is another example of a matrix that cannot be diagonalized due to the difference between the geometric and algebraic multiplicities of $λ = 2$ , as is Example CEMS6 which has two complex eigenvalues, each with differing multiplicities. Likewise, Example EMMS4 has an eigenvalue with different algebraic and geometric multiplicities and so cannot be diagonalized.

Theorem DED
Distinct Eigenvalues implies Diagonalizable
Suppose $A$ is a square matrix of size $n$ with $n$ distinct eigenvalues. Then $A$ is diagonalizable. $□$

Proof Let $λ_{1}, λ_{2}, λ_{3}, \dots, λ_{n}$ denote the $n$ distinct eigenvalues of $A$ . Then by Theorem NEM we have $n = \sum_{i = 1}^{n} α_{A} (λ_{i})$ , which implies that $α_{A} (λ_{i}) = 1$ , $1 \leq i \leq n$ . From Theorem ME it follows that $γ_{A} (λ_{i}) = 1$ , $1 \leq i \leq n$ . So $γ_{A} (λ_{i}) = α_{A} (λ_{i})$ , $1 \leq i \leq n$ and Theorem DMFE says $A$ is diagonalizable. $■$

Example DEHD
Distinct eigenvalues, hence diagonalizable
In Example DEMS5 the matrix

H = [\begin{matrix} 15 & 18 & - 8 & 6 & - 5 \\ 5 & 3 & 1 & - 1 & - 3 \\ 0 & - 4 & 5 & - 4 & - 2 \\ - 43 & - 46 & 17 & - 14 & 15 \\ 26 & 30 & - 12 & 8 & - 10 \end{matrix}]

has characteristic polynomial

p_{H} (x) = x (x - 2) (x - 1) (x + 1) (x + 3)

and so is a $5 \times 5$ matrix with 5 distinct eigenvalues. By Theorem DED we know $H$ must be diagonalizable. But just for practice, we exhibit the diagonalization itself. The matrix $S$ contains eigenvectors of $H$ as columns, one from each eigenspace, guaranteeing linear independent columns and thus the nonsingularity of $S$ . The diagonal matrix has the eigenvalues of $H$ in the same order that their respective eigenvectors appear as the columns of $S$ . Notice that we are using the versions of the eigenvectors from Example DEMS5 that have integer entries.

\begin{array}{l} S^{- 1} H S \\ = {[\begin{matrix} 2 & 1 & - 1 & 1 & 1 \\ - 1 & 0 & 2 & 0 & - 1 \\ - 2 & 0 & 2 & - 1 & - 2 \\ - 4 & - 1 & 0 & - 2 & - 1 \\ 2 & 2 & 1 & 2 & 1 \end{matrix}]}^{- 1} [\begin{matrix} 15 & 18 & - 8 & 6 & - 5 \\ 5 & 3 & 1 & - 1 & - 3 \\ 0 & - 4 & 5 & - 4 & - 2 \\ - 43 & - 46 & 17 & - 14 & 15 \\ 26 & 30 & - 12 & 8 & - 10 \end{matrix}] [\begin{matrix} 2 & 1 & - 1 & 1 & 1 \\ - 1 & 0 & 2 & 0 & - 1 \\ - 2 & 0 & 2 & - 1 & - 2 \\ - 4 & - 1 & 0 & - 2 & - 1 \\ 2 & 2 & 1 & 2 & 1 \end{matrix}] \\ = [\begin{matrix} - 3 & - 3 & 1 & - 1 & 1 \\ - 1 & - 2 & 1 & 0 & 1 \\ - 5 & - 4 & 1 & - 1 & 2 \\ 10 & 10 & - 3 & 2 & - 4 \\ - 7 & - 6 & 1 & - 1 & 3 \end{matrix}] [\begin{matrix} 15 & 18 & - 8 & 6 & - 5 \\ 5 & 3 & 1 & - 1 & - 3 \\ 0 & - 4 & 5 & - 4 & - 2 \\ - 43 & - 46 & 17 & - 14 & 15 \\ 26 & 30 & - 12 & 8 & - 10 \end{matrix}] [\begin{matrix} 2 & 1 & - 1 & 1 & 1 \\ - 1 & 0 & 2 & 0 & - 1 \\ - 2 & 0 & 2 & - 1 & - 2 \\ - 4 & - 1 & 0 & - 2 & - 1 \\ 2 & 2 & 1 & 2 & 1 \end{matrix}] \\ = [\begin{matrix} - 3 & 0 & 0 & 0 & 0 \\ 0 & - 1 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 1 & 0 \\ 0 & 0 & 0 & 0 & 2 \end{matrix}] \end{array}

⊠

Archetype B is another example of a matrix that has as many distinct eigenvalues as its size, and is hence diagonalizable by Theorem DED.

Powers of a diagonal matrix are easy to compute, and when a matrix is diagonalizable, it is almost as easy. We could state a theorem here perhaps, but we will settle instead for an example that makes the point just as well.

Example HPDM
High power of a diagonalizable matrix
Suppose that

A = [\begin{matrix} 19 & 0 & 6 & 13 \\ - 33 & - 1 & - 9 & - 21 \\ 21 & - 4 & 12 & 21 \\ - 36 & 2 & - 14 & - 28 \end{matrix}]

and we wish to compute $A^{20}$ . Normally this would require 19 matrix multiplications, but since $A$ is diagonalizable, we can simplify the computations substantially. First, we diagonalize $A$ . With

S = [\begin{matrix} 1 & - 1 & 2 & - 1 \\ - 2 & 3 & - 3 & 3 \\ 1 & 1 & 3 & 3 \\ - 2 & 1 & - 4 & 0 \end{matrix}]

we find

\begin{array}{l} D = S^{- 1} A S & = [\begin{matrix} - 6 & 1 & - 3 & - 6 \\ 0 & 2 & - 2 & - 3 \\ 3 & 0 & 1 & 2 \\ - 1 & - 1 & 1 & 1 \end{matrix}] [\begin{matrix} 19 & 0 & 6 & 13 \\ - 33 & - 1 & - 9 & - 21 \\ 21 & - 4 & 12 & 21 \\ - 36 & 2 & - 14 & - 28 \end{matrix}] [\begin{matrix} 1 & - 1 & 2 & - 1 \\ - 2 & 3 & - 3 & 3 \\ 1 & 1 & 3 & 3 \\ - 2 & 1 & - 4 & 0 \end{matrix}] \\ = [\begin{matrix} - 1 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 2 & 0 \\ 0 & 0 & 0 & 1 \end{matrix}] \end{array}

Now we find an alternate expression for $A^{20}$ ,

\begin{array}{l} A^{20} & = A A A \dots A \\ = I_{n} A I_{n} A I_{n} A I_{n} \dots I_{n} A I_{n} \\ = (S S^{- 1}) A (S S^{- 1}) A (S S^{- 1}) A (S S^{- 1}) \dots (S S^{- 1}) A (S S^{- 1}) \\ = S (S^{- 1} A S) (S^{- 1} A S) (S^{- 1} A S) \dots (S^{- 1} A S) S^{- 1} \\ = S D D D \dots D S^{- 1} \\ = S D^{20} S^{- 1} \\ and since D is a diagonal matrix, powers are much easier to compute, \\ = S {[\begin{matrix} - 1 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 2 & 0 \\ 0 & 0 & 0 & 1 \end{matrix}]}^{20} S^{- 1} \\ = S [\begin{matrix} {(- 1)}^{20} & 0 & 0 & 0 \\ 0 & {(0)}^{20} & 0 & 0 \\ 0 & 0 & {(2)}^{20} & 0 \\ 0 & 0 & 0 & {(1)}^{20} \end{matrix}] S^{- 1} \\ = [\begin{matrix} 1 & - 1 & 2 & - 1 \\ - 2 & 3 & - 3 & 3 \\ 1 & 1 & 3 & 3 \\ - 2 & 1 & - 4 & 0 \end{matrix}] [\begin{matrix} 1 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 1048576 & 0 \\ 0 & 0 & 0 & 1 \end{matrix}] [\begin{matrix} - 6 & 1 & - 3 & - 6 \\ 0 & 2 & - 2 & - 3 \\ 3 & 0 & 1 & 2 \\ - 1 & - 1 & 1 & 1 \end{matrix}] \\ = [\begin{matrix} 6291451 & 2 & 2097148 & 4194297 \\ - 9437175 & - 5 & - 3145719 & - 6291441 \\ 9437175 & - 2 & 3145728 & 6291453 \\ - 12582900 & - 2 & - 4194298 & - 8388596 \end{matrix}] \end{array}

Notice how we effectively replaced the twentieth power of $A$ by the twentieth power of $D$ , and how a high power of a diagonal matrix is just a collection of powers of scalars on the diagonal. The price we pay for this simplification is the need to diagonalize the matrix (by computing eigenvalues and eigenvectors) and finding the inverse of the matrix of eigenvectors. And we still need to do two matrix products. But the higher the power, the greater the savings. $⊠$

We close this section with a comment about an important upcoming theorem that we prove in Chapter R. A consequence of Theorem OD is that every Hermitian matrix (Definition HM) is diagonalizable (Definition DZM), and the similarity transformation that accomplishes the diagonalization uses a unitary matrix (Definition UM). This means that for every Hermitian matrix of size $n$ there is a basis of $ℂ^{n}$ that is composed entirely of eigenvectors for the matrix and also forms an orthonormal set (Definition ONS). Notice that for matrices with only real entries, we only need the hypothesis that the matrix is symmetric (Definition SYM) to reach this conclusion (Example ESMS4). Can you imagine a prettier basis for use with a matrix? I can’t.

These results in Section OD explain much of our recurring interest in orthogonality, and make the section a high point in your study of linear algebra. A precise statement of this diagonalization result applies to a slightly broader class of matrices, known as “normal” matrices (Definition NRML), which are matrices that commute with their adjoints. With this expanded category of matrices, the result becomes an equivalence (Technique E). See Theorem OD and Theorem OBNM in Section OD for all the details.

Subsection READ: Reading Questions

What is an equivalence relation?
State a condition that is equivalent to a matrix being diagonalizable, but is not the definition.
Find a diagonal matrix similar to
$A = [\begin{matrix} - 5 & 8 \\ - 4 & 7 \end{matrix}]$

Subsection EXC: Exercises

C20 Consider the matrix $A$ below. First, show that $A$ is diagonalizable by computing the geometric multiplicities of the eigenvalues and quoting the relevant theorem. Second, find a diagonal matrix $D$ and a nonsingular matrix $S$ so that $S^{- 1} A S = D$ . (See Exercise EE.C20 for some of the necessary computations.)

A = [\begin{matrix} 18 & - 15 & 33 & - 15 \\ - 4 & 8 & - 6 & 6 \\ - 9 & 9 & - 16 & 9 \\ 5 & - 6 & 9 & - 4 \end{matrix}]

Contributed by Robert Beezer Solution [1254]

C21 Determine if the matrix $A$ below is diagonalizable. If the matrix is diagonalizable, then find a diagonal matrix $D$ that is similar to $A$ , and provide the invertible matrix $S$ that perfoms the similarity transformation. You should use your calculator to find the eigenvalues of the matrix, but try only using the row-reducing function of your calculator to assist with finding eigenvectors.

A = [\begin{matrix} 1 & 9 & 9 & 24 \\ - 3 & - 27 & - 29 & - 68 \\ 1 & 11 & 13 & 26 \\ 1 & 7 & 7 & 18 \end{matrix}]

Contributed by Robert Beezer Solution [1255]

C22 Consider the matrix $A$ below. Find the eigenvalues of $A$ using a calculator and use these to construct the characteristic polynomial of $A$ , $p_{A} (x)$ . State the algebraic multiplicity of each eigenvalue. Find all of the eigenspaces for $A$ by computing expressions for null spaces, only using your calculator to row-reduce matrices. State the geometric multiplicity of each eigenvalue. Is $A$ diagonalizable? If not, explain why. If so, find a diagonal matrix $D$ that is similar to $A$ .

A = [\begin{matrix} 19 & 25 & 30 & 5 \\ - 23 & - 30 & - 35 & - 5 \\ 7 & 9 & 10 & 1 \\ - 3 & - 4 & - 5 & - 1 \end{matrix}]

Contributed by Robert Beezer Solution [1259]

T15 Suppose that $A$ and $B$ are similar matrices. Prove that $A^{3}$ and $B^{3}$ are similar matrices. Generalize.
Contributed by Robert Beezer Solution [1261]

T16 Suppose that $A$ and $B$ are similar matrices, with $A$ nonsingular. Prove that $B$ is nonsingular, and that $A^{- 1}$ is similar to $B^{- 1}$ .
Contributed by Robert Beezer

T17 Suppose that $B$ is a nonsingular matrix. Prove that $A B$ is similar to $B A$ .
Contributed by Robert Beezer Solution [1262]

Subsection SOL: Solutions

C20 Contributed by Robert Beezer Statement [1251]
Using a calculator, we find that $A$ has three distinct eigenvalues, $λ = 3, 2, - 1$ , with $λ = 2$ having algebraic multiplicity two, $α_{A} (2) = 2$ . The eigenvalues $λ = 3, - 1$ have algebraic multiplicity one, and so by Theorem ME we can conclude that their geometric multiplicities are one as well. Together with the computation of the geometric multiplicity of $λ = 2$ from Exercise EE.C20, we know

\begin{array}{l} γ_{A} (3) & = α_{A} (3) = 1 & γ_{A} (2) & = α_{A} (2) = 2 & γ_{A} (- 1) & = α_{A} (- 1) = 1 \end{array}

This satisfies the hypotheses of Theorem DMFE, and so we can conclude that $A$ is diagonalizable.

A calculator will give us four eigenvectors of $A$ , the two for $λ = 2$ being linearly independent presumably. Or, by hand, we could find basis vectors for the three eigenspaces. For $λ = 3, - 1$ the eigenspaces have dimension one, and so any eigenvector for these eigenvalues will be multiples of the ones we use below. For $λ = 2$ there are many different bases for the eigenspace, so your answer could vary. Our eigenvectors are the basis vectors we would have obtained if we had actually constructed a basis in Exercise EE.C20 rather than just computing the dimension.

By the construction in the proof of Theorem DC, the required matrix $S$ has columns that are four linearly independent eigenvectors of $A$ and the diagonal matrix has the eigenvalues on the diagonal (in the same order as the eigenvectors in $S$ ). Here are the pieces, “doing” the diagonalization,

{[\begin{matrix} - 1 & 0 & - 3 & 6 \\ - 2 & - 1 & - 1 & 0 \\ 0 & 0 & 1 & - 3 \\ 1 & 1 & 0 & 1 \end{matrix}]}^{- 1} [\begin{matrix} 18 & - 15 & 33 & - 15 \\ - 4 & 8 & - 6 & 6 \\ - 9 & 9 & - 16 & 9 \\ 5 & - 6 & 9 & - 4 \end{matrix}] [\begin{matrix} - 1 & 0 & - 3 & 6 \\ - 2 & - 1 & - 1 & 0 \\ 0 & 0 & 1 & - 3 \\ 1 & 1 & 0 & 1 \end{matrix}] = [\begin{matrix} 3 & 0 & 0 & 0 \\ 0 & 2 & 0 & 0 \\ 0 & 0 & 2 & 0 \\ 0 & 0 & 0 & - 1 \end{matrix}]

C21 Contributed by Robert Beezer Statement [1251]
A calculator will provide the eigenvalues $λ = 2, 2, 1, 0$ , so we can reconstruct the characteristic polynomial as

p_{A} (x) = {(x - 2)}^{2} (x - 1) x

so the algebraic multiplicities of the eigenvalues are

\begin{array}{l} α_{A} (2) & = 2 & α_{A} (1) & = 1 & α_{A} (0) & = 1 \end{array}

Now compute eigenspaces by hand, obtaining null spaces for each of the three eigenvalues by constructing the correct singular matrix (Theorem EMNS),

\begin{array}{l} A - 2 I_{4} & = [\begin{matrix} - 1 & 9 & 9 & 24 \\ - 3 & - 29 & - 29 & - 68 \\ 1 & 11 & 11 & 26 \\ 1 & 7 & 7 & 16 \end{matrix}] \to_{}^{RREF} [\begin{matrix} 1 & 0 & 0 & - \frac{3}{2} \\ 0 & 1 & 1 & \frac{5}{2} \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \end{matrix}] \\ ℰ_{A} (2) & = N (A - 2 I_{4}) = 〈\{[\begin{matrix} \frac{3}{2} \\ - \frac{5}{2} \\ 0 \\ 1 \end{matrix}], [\begin{matrix} 0 \\ - 1 \\ 1 \\ 0 \end{matrix}]\}〉 = 〈\{[\begin{matrix} 3 \\ - 5 \\ 0 \\ 2 \end{matrix}], [\begin{matrix} 0 \\ - 1 \\ 1 \\ 0 \end{matrix}]\}〉 \\ A - 1 I_{4} & = [\begin{matrix} 0 & 9 & 9 & 24 \\ - 3 & - 28 & - 29 & - 68 \\ 1 & 11 & 12 & 26 \\ 1 & 7 & 7 & 17 \end{matrix}] \to_{}^{RREF} [\begin{matrix} 1 & 0 & 0 & - \frac{5}{3} \\ 0 & 1 & 0 & \frac{13}{3} \\ 0 & 0 & 1 & - \frac{5}{3} \\ 0 & 0 & 0 & 0 \end{matrix}] \\ ℰ_{A} (1) & = N (A - I_{4}) = 〈\{[\begin{matrix} \frac{5}{3} \\ - \frac{13}{3} \\ \frac{5}{3} \\ 1 \end{matrix}]\}〉 = 〈\{[\begin{matrix} 5 \\ - 13 \\ 5 \\ 3 \end{matrix}]\}〉 \\ A - 0 I_{4} & = [\begin{matrix} 1 & 9 & 9 & 24 \\ - 3 & - 27 & - 29 & - 68 \\ 1 & 11 & 13 & 26 \\ 1 & 7 & 7 & 18 \end{matrix}] \to_{}^{RREF} [\begin{matrix} 1 & 0 & 0 & - 3 \\ 0 & 1 & 0 & 5 \\ 0 & 0 & 1 & - 2 \\ 0 & 0 & 0 & 0 \end{matrix}] \\ ℰ_{A} (0) & = N (A - I_{4}) = 〈\{[\begin{matrix} 3 \\ - 5 \\ 2 \\ 1 \end{matrix}]\}〉 \end{array}

From this we can compute the dimensions of the eigenspaces to obtain the geometric multiplicities,

\begin{array}{l} γ_{A} (2) & = 2 & γ_{A} (1) & = 1 & γ_{A} (0) & = 1 \end{array}

For each eigenvalue, the algebraic and geometric multiplicities are equal and so by Theorem DMFE we now know that $A$ is diagonalizable. The construction in Theorem DC suggests we form a matrix whose columns are eigenvectors of $A$

S = [\begin{matrix} 3 & 0 & 5 & 3 \\ - 5 & - 1 & - 13 & - 5 \\ 0 & 1 & 5 & 2 \\ 2 & 0 & 3 & 1 \end{matrix}]

Since $det (S) = - 1 \neq 0$ , we know that $S$ is nonsingular (Theorem SMZD), so the columns of $S$ are a set of 4 linearly independent eigenvectors of $A$ . By the proof of Theorem SMZD we know

S^{- 1} A S = [\begin{matrix} 2 & 0 & 0 & 0 \\ 0 & 2 & 0 & 0 \\ 0 & 0 & 1 & 0 \\ 0 & 0 & 0 & 0 \end{matrix}]

a diagonal matrix with the eigenvalues of $A$ along the diagonal, in the same order as the associated eigenvectors appear as columns of $S$ .

C22 Contributed by Robert Beezer Statement [1252]
A calculator will report $λ = 0$ as an eigenvalue of algebraic multiplicity of 2, and $λ = - 1$ as an eigenvalue of algebraic multiplicity 2 as well. Since eigenvalues are roots of the characteristic polynomial (Theorem EMRCP) we have the factored version

p_{A} (x) = {(x - 0)}^{2} {(x - (- 1))}^{2} = x^{2} (x^{2} + 2 x + 1) = x^{4} + 2 x^{3} + x^{2}

The eigenspaces are then

\begin{array}{l} λ & = 0 \\ A - (0) I_{4} & = [\begin{matrix} 19 & 25 & 30 & 5 \\ - 23 & - 30 & - 35 & - 5 \\ 7 & 9 & 10 & 1 \\ - 3 & - 4 & - 5 & - 1 \end{matrix}] \to_{}^{RREF} [\begin{matrix} 1 & 0 & - 5 & - 5 \\ 0 & 1 & 5 & 4 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \end{matrix}] \\ ℰ_{A} (0) & = N (C - (0) I_{4}) = 〈\{[\begin{matrix} 5 \\ - 5 \\ 1 \\ 0 \end{matrix}], [\begin{matrix} 5 \\ - 4 \\ 0 \\ 1 \end{matrix}]\}〉 \end{array}

\begin{array}{l} λ & = - 1 \\ A - (- 1) I_{4} & = [\begin{matrix} 20 & 25 & 30 & 5 \\ - 23 & - 29 & - 35 & - 5 \\ 7 & 9 & 11 & 1 \\ - 3 & - 4 & - 5 & 0 \end{matrix}] \to_{}^{RREF} [\begin{matrix} 1 & 0 & - 1 & 4 \\ 0 & 1 & 2 & - 3 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \end{matrix}] \\ ℰ_{A} (- 1) & = N (C - (- 1) I_{4}) = 〈\{[\begin{matrix} 1 \\ - 2 \\ 1 \\ 0 \end{matrix}], [\begin{matrix} - 4 \\ 3 \\ 0 \\ 1 \end{matrix}]\}〉 \end{array}

Each eigenspace above is described by a spanning set obtained through an application of Theorem BNS and so is a basis for the eigenspace. In each case the dimension, and therefore the geometric multiplicity, is 2.

For each of the two eigenvalues, the algebraic and geometric multiplicities are equal. Theorem DMFE says that in this situation the matrix is diagonalizable. We know from Theorem DC that when we diagonalize $A$ the diagonal matrix will have the eigenvalues of $A$ on the diagonal (in some order). So we can claim that

D = [\begin{matrix} 0 & 0 & 0 & 0 \\ 0 & 0 & 0 & 0 \\ 0 & 0 & - 1 & 0 \\ 0 & 0 & 0 & - 1 \end{matrix}]

T15 Contributed by Robert Beezer Statement [1253]
By Definition SIM we know that there is a nonsingular matrix $S$ so that $A = S^{- 1} B S$ . Then

\begin{array}{l} A^{3} & = {(S^{- 1} B S)}^{3} \\ = (S^{- 1} B S) (S^{- 1} B S) (S^{- 1} B S) \\ = S^{- 1} B (S S^{- 1}) B (S S^{- 1}) B S & Theorem MMA \\ = S^{- 1} B (I_{3}) B (I_{3}) B S & Definition MI \\ = S^{- 1} B B B S & Theorem MMIM \\ = S^{- 1} B^{3} S \end{array}

This equation says that $A^{3}$ is similar to $B^{3}$ (via the matrix $S$ ).

More generally, if $A$ is similar to $B$ , and $m$ is a non-negative integer, then $A^{m}$ is similar to $B^{m}$ . This can be proved using induction (Technique I).

T17 Contributed by Robert Beezer Statement [1253]
The nonsingular (invertible) matrix $B$ will provide the desired similarity transformation,

\begin{array}{l} B^{- 1} (B A) B & = (B^{- 1} B) (A B) & Theorem MMA \\ = I_{n} A B & Definition MI \\ = A B & Theorem MMIM \end{array}

Annotated Acronyms E: Eigenvalues

Theorem EMRCP
Much of what we know about eigenvalues can be traced to analysis of the characteristic polynomial. When we first defined eigenvalues, you might have wondered if they were scarce, or abundant. The characteristic polynomial allows us to answer a question like this with a result like Theorem NEM which tells us there are always a few eigenvalues, but never too many.

Theorem EMNS
If Theorem EMRCP allows us to learn about eigenvalues through what we know about roots of polynomials, then Theorem EMNS allows us to learn about eigenvectors, and eigenspaces, from what we already know about null spaces. These two theorems, along with Definition EEM, provide the starting points for discerning the properties of eigenvalues and eigenvectors (to say nothing of actually computing them).

Theorem HMRE
As we have remarked before, we choose to include all of the complex numbers in our set of allowed scalars, whereas many introductory texts restrict their attention to just the real numbers. Here is one of the payoffs to this approach. Begin with a matrix, possibly containing complex entries, and require the matrix to be Hermitian (Definition HM). In the case of only real entries, this boils down to just requiring the matrix to be symmetric (Definition SYM). Generally, the roots of a characteristic polynomial, even with all real coefficients, can have complex numbers as roots. But for a Hermitian matrix, all of the eigenvalues are real numbers! When somebody tells you mathematics can be beautiful, this is an example of what they are talking about.

Theorem DC
Diagonalizing a matrix, or the question of if a matrix is diagonalizable, could be viewed as one of a handful of central questions in linear algebra. Here we have an unequivocal answer to the question of “if,” along with a proof containing a construction for the diagonalization. So this theorem is of theoretical and computational interest. This topic will be important again in Chapter R.

Theorem DMFE
Another unequivocal answer to the question of if a matrix is diagonalizable, with perhaps a simpler condition to test. The proof also tells us how to construct the necessary set of $n$ linearly independent eigenvectors — just round up bases for each eigenspace and join them together. No need to test the linear independence of the combined set.

[prev] [prev-tail] [front] [up]