Linear Algebra — Basic
Fundamentals of Vector Spaces, Eigenvalues, and Determinants (Undergraduate Level)
Overview
The basic level covers three core concepts of linear algebra: vector spaces, eigenvalues and eigenvectors, and determinants. These are fundamental tools used throughout modern mathematics.
Learning Objectives
- Understand the abstract definition of vector spaces
- Grasp the concepts of linear independence and basis
- Learn the definition and computation of eigenvalues and eigenvectors
- Master basic determinant computation methods (cofactor expansion, Cramer's rule)
Table of Contents
-
Chapter 1
Fundamentals of Vector Spaces
Axiomatic definition, beyond $\mathbb{R}^n$ — polynomials and functions as vectors
-
Chapter 2
Linear Independence and Basis
Linear combinations, linear independence, basis, dimension
-
Chapter 3
Introduction to Determinants: Cramer's Rule
Deriving the determinant from systems of equations — a historical approach
-
Chapter 4
Determinants: Cofactor Expansion
Cofactors, minors, Laplace expansion, inverse matrices
-
Chapter 5
Visual Understanding of Determinants
Shear transformations, parallelograms, changes in area and volume
-
Chapter 6
Eigenvalues and Eigenvectors
Definition, geometric meaning, characteristic polynomial, eigenspaces
-
Chapter 7
Properties and Applications of Eigenvalues
Trace and determinant, triangular matrices, linear independence, applications
-
Chapter 8
Structure of Solutions of Linear Systems
Homogeneous and non-homogeneous systems, solution space structure theorem, rank-nullity theorem
-
Chapter 9
The Identity Matrix
Definition and basic properties, eigenvalues, the identity element of matrix multiplication
-
Chapter 10
The Kronecker Delta
Definition of δ_ij, Einstein notation, foundations of tensor notation
-
Chapter 11
Matrix Rank
Definition of rank, pivot-based computation via row reduction, rank-nullity theorem, full-rank equivalences. Appendix: Strang-style proof of row rank = column rank
-
Chapter 12
Permutation Matrices
Definition, orthogonality, determinant, relation to LU decomposition, symmetric group, applications
Related Topics (Basic Special Matrices & Concepts)
-
Adjoint Matrix
Cofactor matrix adj(A), A·adj(A) = det(A)·I, inverse A^{-1} = adj(A)/det(A), distinction from Hermitian adjoint
-
Change of Basis
Change-of-basis matrix, transformation of coordinate vectors, similarity transformation A' = P^{-1}AP, relation to diagonalization
-
Cross Product
Vector product in R³. Determinant form, normal vector, parallelogram area, triple product, generalization to exterior algebra
-
Diagonal Matrix
Ease of operations on diag(d_1,...,d_n) (multiplication, inverse, powers), relation to diagonalization A=PDP^{-1}
-
Direct Sum
Internal direct sum V=W₁⊕W₂ with W₁∩W₂={0}, external direct sum, relation to projections, applications to Jordan decomposition
-
Gram-Schmidt Orthonormalization
Classical and modified GS algorithms, R³ examples, relation to QR decomposition, numerical stability
-
Orthogonal Matrix
Definition Q^TQ=I, properties, relation to rotation matrices, Gram-Schmidt orthogonalization, applications
-
Orthonormal Basis
⟨e_i, e_j⟩ = δ_{ij}, Fourier coefficients for coordinates, Parseval's identity, relation to QR decomposition
-
Rank-Nullity Theorem
Proof of dim V = rank T + nullity T, row rank = column rank, surjectivity/injectivity conditions for linear maps
-
Skew-Symmetric Matrix
A^T=-A, zero diagonal, purely imaginary eigenvalues, relation to cross product [a]×
-
Symmetric Matrix
A^T=A, spectral theorem (real symmetric matrices are diagonalizable by an orthogonal matrix), real eigenvalues, relation to quadratic forms
-
Triangular Matrix
Upper/lower triangular definitions, determinant = product of diagonal entries, eigenvalues = diagonal entries, relation to LU decomposition, forward/back substitution
-
Unitary Matrix
Complex analog of orthogonal matrices U*U=I, properties, eigenvalues with absolute value 1, applications to quantum computing
-
Vandermonde Matrix
Product formula for the determinant, polynomial interpolation, applications to Reed-Solomon codes
Prerequisites
- High school-level vectors (arrow vectors, component representation)
- Basic matrix operations (addition, multiplication, inverse)
- Fundamental concepts of sets and mappings