Linear Algebra Lecture 5

Linear Algebra Lecture 5

1. Permutations $PA=LU$

2. Vector spaces and subspaces

---

Permutations

They execute row exchanges. P is the identity matrix with reordered rows.
$PA=LU$
This is the description of elimination with row exchanges.
For any invertible A we get $PA=LU$.

How many possibilities for permutations?
n factorial(阶乘)
$n！= n(n-1)(n-2)...(2)(1)$
That’s the number of counts the possible reorderings, it counts all the $n \times n$ permutations .

$P^{-1} = P^T$
$P^TP=I$

Transpose a matrix

$\begin{bmatrix}1&3\\2&3\\4&1\end{bmatrix}^T =\begin{bmatrix}1&2&4\\3&3&1\end{bmatrix}$

$(A^T)_{ij} = A_{ji}$

Symmetric matrices

Symmetric matrix(对称矩阵) means that this transposing doesn’t change the matrix.
$A^T=A$

$\begin{bmatrix}3&1&7\\1&2&9\\7&9&4\end{bmatrix}$

Why $R^TR$ is always symmetric?

$\begin{bmatrix}1&3\\2&3\\4&1\end{bmatrix}\begin{bmatrix}1&2&4\\3&3&1\end{bmatrix} = \begin{bmatrix}10&11&7\\11&13&11\\7&11&17\end{bmatrix}$

Take transpose of $R^TR$
$(R^TR)^T = R^TR^{TT} = R^TR$

---

Vector spaces

Space means get a bunch of vectors, a space of vectors. The space allow be able to add vectors and multiply by numbers, have to be able to take linear combinations.

$R^2$ = all two dimensional real vectors = the $XY$ plane
$R^n$ = all column vectors with n real components

Vector space has to be closed under multiplication and addition of vectors. In other words, closed under linear combinations.

Subspace

A subspace that is part of $R^n$ and is still safely multiplication and addition of vectors stay in the smaller vector space.

Line in $R^2$ through zero vector is a subspace of $R^2$, every subspace has got to contain zero, because must be allowed to multiply by zero.

List all subspaces of $R^2$
1) All of $R^2$
2) Any line through $\begin{bmatrix}0\\0\end{bmatrix}$
3) Zero vector only

column space

How to create some subspaces out of a matrix

One subspace is from the column
$A=\begin{bmatrix}1&3\\2&3\\4&1\end{bmatrix}$
Columns in $R^3$ and all their linear combinations form a subspace. Called the column space $C(A)$.

We have two column $\begin{bmatrix}1\\2\\4\end{bmatrix}$ and $\begin{bmatrix}3\\3\\1\end{bmatrix}$, the whole column space comes from taking all combinations of those two vectors. Then we get a plane through zero vector in $R^3$.

We may take a combinatio of five vectors in $R^{10}$, we’ll have five vectors and they’ll all have ten components, we take their combinations, we possibly have some five dimensional flat thing going through the origin. And if those five vectors were all on the line, then we would only get that line, it depends on those five vector.