Section F Fields

From A First Course in Linear Algebra
Version 1.08
© 2004.
Licensed under the GNU Free Documentation License.
http://linear.ups.edu/

Draft: This Section Complete, But Subject To Change

We have chosen to present introductory linear algebra in the Core (Part C) using scalars from the set of complex numbers, $ℂ$ . We could have instead chosen to use scalars from the set of real numbers, $ℝ^{}$ . This would have presented certain difficulties when we encountered characteristic polynomials with complex roots (Definition CP) or when we needed to be sure every matrix had at least one eigenvalue (Theorem EMHE). However, much of the basics would be unchanged. The definition of a vector space would not change, nor would the ideas of linear independence, spanning, or bases. Linear transformations would still behave the same and we would still obtain matrix representations, though our ideas about canonical forms would have to be adjusted slightly.

The real numbers and the complex numbers are both examples of what are called fields, and we can “do” linear algebra in just a bit more generality by letting our scalars take values from some unspecified field. So in this section we will describe exactly what constitutes a field, give some finite examples, and discuss another connection between fields and vector spaces. Vector spaces over finite fields are very important in certain applications, so this is partially background for other topics. As such, we will not prove every claim we make.

Subsection F: Fields

Like a vector space, a field is a set along with two binary operations. The distinction is that both operations accept two elements of the set, and then produce a new element of the set. In a vector space we have two sets — the vectors and the scalars, and scalar multiplication mixes one of each to produce a vector. Here is the careful definition of a field.

Definition F
Field
Suppose that $F$ is a set upon which we have defined two operations: (1) addition, which combines two elements of $F$ and is denoted by “+”, and (2) multiplication, which combines two elements of $F$ and is denoted by juxtaposition. Then $F$ , along with the two operations, is a field if the following properties hold.

ACF Additive Closure, Field
If $α, β \in F$ , then $α + β \in F$ .
MCF Multiplicative Closure, Field
If $α, β \in F$ , then $α β \in F$ .
ACF Additive Commutativity, Field
If $α, β \in F$ , then $α + β = β + α$ .
MCF Multiplicative Commutativity, Field
If $α, β \in F$ , then $α β = β α$ .
AAF Additive Associativity, Field
If $α, β, γ \in V$ , then $α + (β + γ) = (α + β) + γ$ .
MAF Multiplicative Associativity, Field
If $α, β, γ \in V$ , then $α (β γ) = (α β) γ$ .
DF Distributivity, Field
If $α, β, γ \in F$ , then $α (β + γ) = α β + α γ$ .
ZF Zero, Field
There is an element, $0 \in F$ , called zero, such that $α + 0 = α$ for all $α \in F$ .
OF One, Field
There is an element, $1 \in F$ , called one, such that $α (1) = α$ for all $α \in F$ .
AIF Additive Inverse, Field
If $α \in F$ , then there exists $- α \in V$ so that $α + (- α) = 0$ .
MIF Multiplicative Inverse, Field
If $α \in F$ , $α \neq 0$ , then there exists $\frac{1}{α} \in V$ so that $α (\frac{1}{α}) = 1$ .

△

Mostly this definition says that all the good things you might expect, really do happen in a field. The one technicality is that the special element, $0$ , the additive identity element, does not have a multiplicative inverse. In other words, no dividing by zero.

This definition should remind you of Theorem PCNA, and indeed, Theorem PCNA provides the justification for the statement that the complex numbers form a field. Another example of field is the set of rational numbers

\begin{array}{l} ℚ = \{\frac{p}{q}| p, q are integers, q \neq 0\} \end{array}

Of course, the real numbers, $ℝ^{}$ , also form a field. It is this field that you probably studied for many years. You began studying the integers (“counting”), then the rationals (“fractions”), then the reals (“algebra”), along with some excursions in the complex numbers (“imaginary numbers”). So you should have seen three fields already in your previous studies.

Our first observation about fields is that we can go back to our definition of a vector space (Definition VS) and replace every occurence of $ℂ$ by some general, unspecified field, $F$ , and all our subsequent definitions and theorems are still true, so long as we avoid roots of polynomials (or equivalently, factoring polynomials). So if you consult more advanced texts on linear algebra, you will see this sort of approach. You might study some of the first theorems we proved about vector spaces in Subsection VS.VSP and work through their proofs in the more general setting of an arbitrary field. This exercise should convince you that very little changes when we move from $ℂ$ to an arbitrary field $F$ . (See Exercise F.T10.)

Subsection FF: Finite Fields

It may sound odd at first, but there exist finite fields, and even finite vector spaces. We will find certain of these important in subsequent applications, so we collect some ideas and properties here.

Definition IMP
Integers Modulo a Prime
Suppose that $p$ is a prime number. Let $ℤ_{p} = \{0, 1, 2, \dots, p - 1\}$ . Add and multiply elements of $ℤ_{p}$ as integers, but whenever a result lies outside of the set $ℤ_{p}$ , find its remainder after division by $p$ and replace the result by this remainder. $△$

We have defined a set, and two binary operations. The result is a field.

Theorem FIMP
Field of Integers Modulo a Prime
The set of integers modulo a prime $p$ , $ℤ_{p}$ , is a field. $□$

Example IM11
Integers mod 11
$ℤ_{11}$ is a field by Theorem FIMP. Here we provide some sample calculations.

\begin{array}{l} 8 + 5 & = 2 & - 8 & = 3 & 5 - 9 & = 7 \\ 5 (7) & = 2 & \frac{1}{7} & = 8 & \frac{6}{5} & = 10 \\ 2^{5} & = 10 & - 1 & = 10 & \frac{1}{0} & = ? \end{array}

⊠

We can now “do” linear algebra using scalars from a finite field.

Example VSIM5
Vector space over integers mod 5
Let ${(ℤ_{5})}^{3}$ be the set of all column vectors of length $3$ with entries from $ℤ_{5}$ . Use $ℤ_{5}$ as the set of scalars. Define addition and multiplication the usual way. We exhibit a few sample calculations.

\begin{array}{l} [\begin{matrix} 2 \\ 3 \\ 4 \end{matrix}] + [\begin{matrix} 4 \\ 1 \\ 3 \end{matrix}] & = [\begin{matrix} 1 \\ 4 \\ 2 \end{matrix}] & 3 [\begin{matrix} 2 \\ 0 \\ 4 \end{matrix}] & = [\begin{matrix} 1 \\ 0 \\ 2 \end{matrix}] \end{array}

We can, of course, build linear combinations, such as

\begin{array}{l} 2 [\begin{matrix} 1 \\ 3 \\ 0 \end{matrix}] - 4 [\begin{matrix} 2 \\ 1 \\ 1 \end{matrix}] + [\begin{matrix} 1 \\ 2 \\ 4 \end{matrix}] & = [\begin{matrix} 0 \\ 4 \\ 0 \end{matrix}] \end{array}

which almost looks like a relation of linear dependence. The set

\begin{array}{l} \{[\begin{matrix} 1 \\ 3 \\ 1 \end{matrix}], [\begin{matrix} 2 \\ 2 \\ 0 \end{matrix}]\} \end{array}

is linearly independent, while the set

\begin{array}{l} \{[\begin{matrix} 1 \\ 3 \\ 1 \end{matrix}], [\begin{matrix} 2 \\ 2 \\ 0 \end{matrix}], [\begin{matrix} 4 \\ 3 \\ 2 \end{matrix}]\} \end{array}

is linearly dependent, as can be seen from the relation of linear dependence formed by the scalars $a_{1} = 2$ , $a_{2} = 1$ and $a_{3} = 4$ . To find these scalars, one would take the same approach as Example LDS, but in performing row operations to solve a homogeneous system, you would need to take care that all scalar (field) operations are performed over $ℤ_{5}$ , especially when multiplying a row by a scalar to make a leading entry equal to 1. One more observation about this example — the set

\begin{array}{l} \{[\begin{matrix} 1 \\ 0 \\ 0 \end{matrix}], [\begin{matrix} 1 \\ 1 \\ 0 \end{matrix}], [\begin{matrix} 1 \\ 1 \\ 1 \end{matrix}]\} \end{array}

is a basis for ${(ℤ_{5})}^{3}$ , since it is both linearly independent and spans ${(ℤ_{5})}^{3}$ . $⊠$

In applications to computer science or electrical engineering, $ℤ_{2}$ is the most important field, since it can be used to describe the binary nature of logic, circuitry, communications and their intertwined relationships. The vector space of column vectors with entries from $ℤ_{2}$ , ${(ℤ_{2})}^{n}$ , with scalars taken from $ℤ_{2}$ is the natural extension of this idea. Notice that $ℤ_{2}$ has the minimum number of elements to be a field, since any field must contain a zero and a one (Property ZF, Property OF).

Example SM2Z7
Symmetric matrices of size 2 over $ℤ_{7}$
We can employ the field of integers modulo a prime to build other examples of vector spaces with novel fields of scalars. Define

\begin{array}{l} S_{22} (ℤ_{7}) & = \{[\begin{matrix} a & b \\ b & c \end{matrix}]| a, b, c \in ℤ_{7}\} \end{array}

which is the set of all $2 \times 2$ symmetric matrices with entries from $ℤ_{7}$ . Use the field $ℤ_{7}$ as the set of scalars, and define vector addition and scalar multiplication in the natural way. The result will be a vector space.

Notice that the field of scalars is finite, as is the vector space, since there are $7^{3} = 343$ matrices in $S_{22} (ℤ_{7})$ . The set

\begin{array}{l} \{[\begin{matrix} 1 & 0 \\ 0 & 0 \end{matrix}], [\begin{matrix} 0 & 1 \\ 1 & 0 \end{matrix}], [\begin{matrix} 0 & 0 \\ 0 & 1 \end{matrix}]\} \end{array}

is a basis, so $dim (S_{22} (ℤ_{7})) = 3$ . $⊠$

In a more advanced algebra course it is possible to prove that the number of elements in a finite field must be of the form $p^{n}$ , where $p$ is a prime. We can’t go so far afield as to prove this here, but we can demonstrate an example.

Example FF8
Finite field of size 8
Define the set $F$ as $F = \{a + b t + c t^{2}| a, b, c \in ℤ_{2}\}$ . Add and multiply these quantities as polynomials in the variable $t$ , but replace any occurence of $t^{3}$ by $t + 1$ .

This defines a set, and the two operations on elements of that set. Do not be concerned with what $t$ “is,” because it isn’t. $t$ is just a handy device that makes the example a field. We’ll say a bit more about $t$ when we finish. But first, some examples. Remember that $1 + 1 = 0$ in $ℤ_{2}$ . Addition is quite simple, for example,

\begin{array}{l} (1 + t + t^{2}) + (1 + t^{2}) & = (1 + 1) + (1 + 0) t + (1 + 1) t^{2} = t \end{array}

Multiplication gets more involved, for example,

\begin{array}{l} (1 + t + t^{2}) (1 + t^{2}) & = 1 + t^{2} + t + t^{3} + t^{2} + t^{4} \\ = 1 + t + (1 + 1) t^{2} + t^{3} (1 + t) \\ = 1 + t + (1 + t) (1 + t) \\ = 1 + t + 1 + t + t + t^{2} \\ = (1 + 1) + (1 + 1 + 1) t + t^{2} \\ = t + t^{2} \end{array}

Every element has a multiplicative inverse (Property MIF). What is the inverse of $t + t^{2}$ ? Check that

\begin{array}{l} (t + t^{2}) (1 + t) & = t + t^{2} + t^{2} + t^{3} \\ = t + (1 + 1) t^{2} + (1 + t) \\ = t + 1 + t \\ = 1 + (1 + 1) t \\ = 1 \end{array}

So we can write $\frac{1}{t + t^{2}} = 1 + t$ . So that you may experiment, we give you the complete addition and multiplication tables for this field. Addition is simple, while multiplication is more interesting, so verify a few entries of each table. Because of the commutativity of addition and multiplication (Property ACF, Property MCF), we have just listed half of each table.

\begin{matrix} + & 0 & 1 & t & t^{2} & t + 1 & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 \\ ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ \\ 0 & 0 & 1 & t & t^{2} & t + 1 & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 \\ 1 & 0 & t + 1 & t^{2} + 1 & t & t^{2} + t + 1 & t^{2} + t & t^{2} \\ t & 0 & t^{2} + t & 1 & t^{2} & t^{2} + 1 & t^{2} + t + 1 \\ t^{2} & 0 & t^{2} + t + 1 & t & t + 1 & 1 \\ t + 1 & 0 & t^{2} + 1 & t^{2} & t^{2} + t \\ t^{2} + t & 0 & 1 & t + 1 \\ t^{2} + t + 1 & 0 & t \\ t^{2} + 1 & 0 \end{matrix}

\begin{matrix} \cdot & 0 & 1 & t & t^{2} & t + 1 & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 \\ ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ & ̲ \\ 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 & 0 \\ 1 & 1 & t & t^{2} & t + 1 & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 \\ t & t^{2} & t + 1 & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 & 1 \\ t^{2} & t^{2} + t & t^{2} + t + 1 & t^{2} + 1 & 1 & t \\ t + 1 & t^{2} + 1 & 1 & t & t^{2} \\ t^{2} + t & t & t^{2} & t + 1 \\ t^{2} + t + 1 & 1 + t & t^{2} + t \\ t^{2} + 1 & t^{2} + t + 1 \end{matrix}

Note that every element of $F$ is a linear combination (with scalars from $ℤ_{2}$ ) of the polynomials $1$ , $t$ , $t^{2}$ . So $B = \{1, t, t^{2}\}$ is a spanning set for $F$ . Further, $B$ is linearly independent since there is no nontrivial relation of linear dependence, and $B$ is a basis. So $dim (F) = 3$ . Of course, this paragraph presumes that $F$ is also a vector space over $ℤ_{2}$ (which it is). $⊠$

The defining relation for $t$ ( $t^{3} = t + 1$ ) in Example FF8 arises from the polynomial $t^{3} + t + 1$ , which has no factorization with coefficients from $ℤ_{2}$ . This is an example of an irreducible polynomial, which involves considerable theory to fully understand. In the exercises, we provide you with a few more irreducible polynomials to experiment with. See the suggested readings if you would like to learn more.

Trivially, every field (finite or otherwise) is a vector space. Suppose we begin with a field $F$ . From this we know $F$ has two binary operations defined on it. We need to somehow create a vector space from $F$ , in a general way. First we need a set of vectors. That’ll be $F$ . We also need a set of scalars. That’ll be $F$ as well. How do we define the addition of two vectors? By the same rule that we use to add them when they are in the field. How do we define scalar multiplication? Since a scalar is an element of $F$ , and a vector is an element of $F$ , we can define scalar multiplication to be the same rule that we use to multiply the two elements as members of the field. With these definitions, $F$ will be a vector space (Exercise F.T20). This is something of a trivial situation, since the set of vectors and the set of scalars are identical. In particular, do not confuse this with Example FF8 where the set of vectors has eight elements, and the set of scalars has just two elements.

Further Reading
Robert J. McEliece, Finite Fields for Scientists and Engineers. Kluwer Academic Publishers, 1987. Rudolpf Lidl, Harald Niederreiter, Introduction to Finite Fields and Their Applications, Revised Edition. Cambridge University Press, 1994.

Subsection EXC: Exercises

C60 Consider the vector space ${(ℤ_{5})}^{4}$ composed of column vectors of size 4 with entries from $ℤ_{5}$ . The matrix $A$ is a square matrix composed of four such column vectors.

\begin{array}{l} A & = [\begin{matrix} 3 & 3 & 0 & 3 \\ 1 & 2 & 3 & 0 \\ 1 & 1 & 0 & 2 \\ 4 & 2 & 2 & 1 \end{matrix}] \end{array}

Find the inverse of $A$ . Use this to find a solution to $ℒ S (A, b)$ when

\begin{array}{l} b & = [\begin{matrix} 3 \\ 3 \\ 2 \\ 0 \end{matrix}] \end{array}

Contributed by Robert Beezer Solution [2231]

M10 Suppose we relax the restriction in Definition IMP to allow $p$ to not be a prime. Will the construction given still be a field? Is $ℤ_{6}$ a field? Can you generalize?
Contributed by Robert Beezer

M40 Construct a finite field with 9 elements using the set

\begin{array}{l} F & = \{a + b t| a, b \in ℤ_{3}\} \end{array}

where $t^{2}$ is consistently replaced by $2 t + 1$ in any intermediate results obtained with polynomial multiplication. Compute the first nine powers of $t$ ( $t^{0}$ through $t^{8}$ ). Use this information to aid you in the construction of the multiplication table for this field. What is the multiplicative inverse of $2 t$ ?
Contributed by Robert Beezer

M45 Construct a finite field with 25 elements using the set

\begin{array}{l} F & = \{a + b t| a, b \in ℤ_{5}\} \end{array}

where $t^{2}$ is consistently replaced by $t + 3$ in any intermediate results obtained with polynomial multiplication. Compute the first 25 powers of $t$ ( $t^{0}$ through $t^{24}$ ). Use this information to aid you in computing in this field. What is the multiplicative inverse of $2 t$ ? What is the multiplicative inverse of $4$ ? What is the multiplicative inverse of $1 + 4 t$ ?

Find a basis for $F$ as a vector space with $ℤ_{5}$ used as the set of scalars.
Contributed by Robert Beezer

M50 Construct a finite field with 16 elements using the set

\begin{array}{l} F & = \{a + b t + c t^{2} + d t^{3}| a, b, c, d \in ℤ_{2}\} \end{array}

where $t^{4}$ is consistently replaced by $t + 1$ in any intermediate results obtained with polynomial multiplication. Compute the first 16 powers of $t$ ( $t^{0}$ through $t^{15}$ ). Consider the set $G = \{0, 1, t^{5}, t^{10}\}$ . Then $G$ will also be a finite field, a subfield of $F$ . Construct the addition and multiplication tables for $G$ . Notice that since both $G$ and $F$ are vector spaces over $ℤ_{2}$ , and $G \subseteq F$ , by Definition S, $G$ is a subspace of $F$ .
Contributed by Robert Beezer

T10 Give a new proof of Theorem ZVSM for a vector space whose scalars come from an arbitrary field $F$ .
Contributed by Robert Beezer

T20 By applying Definition VS, prove that every field is also a vector space. (See the construction at the end of this section.)
Contributed by Robert Beezer

Subsection SOL: Solutions

C60 Contributed by Robert Beezer Statement [2226]
Remember that every computation must be done with arithmetic in the field, reducing any intermediate number outside of $\{0, 1, 2, 3, 4\}$ to its remainder after division by 5.

The matrix inverse can be found with Theorem CINM (and we discover along the way that $A$ is nonsingular). The inverse is

\begin{array}{l} A^{- 1} & = [\begin{matrix} 1 & 1 & 3 & 1 \\ 3 & 4 & 1 & 4 \\ 1 & 4 & 0 & 2 \\ 3 & 0 & 1 & 0 \end{matrix}] \end{array}

Then by an application of Theorem SNCM the (unique) solution to the system will be

\begin{array}{l} A^{- 1} b & = [\begin{matrix} 1 & 1 & 3 & 1 \\ 3 & 4 & 1 & 4 \\ 1 & 4 & 0 & 2 \\ 3 & 0 & 1 & 0 \end{matrix}] [\begin{matrix} 3 \\ 3 \\ 2 \\ 0 \end{matrix}] & = [\begin{matrix} 2 \\ 3 \\ 0 \\ 1 \end{matrix}] \end{array}

[next] [front] [up]