Pre 2.4 Vector Space and Subspace
Course subject(s)
Pre-knowledge Mathematics
Vector space and subspace
A set W is called a vector space if its elements are vectors and
- the sum of two elements of W is again an element of W, and
- the product of an element of W with a scalar is an element of W.
A subset of a vector space which itself is a vector space is called a subspace.
Span
Let ai∈W i=1,…,n, where W is a vector space. The set of all linear combinations of a1,…,an, denoted as {a1,…,an}, is a subspace of W: {a1,…,an}⊂W. If every vector of a vector space V can be written as a linear combination of a1,…,an, then a1,…,an is said to span V: V={a1,…,an}.
Basis and dimension of a vector space
A basis of a vector space W is a set of linear independent vectors which span W.
Every vector space contains a basis and every vector can be written as a unique linear combination of the vectors of a basis.
The dimension of a vector space W, denoted as dimW, is the number of vectors of a basis of W. In an n-dimensional vector space W, every linear independent set of n vectors is a basis of W.
As an example, the three-dimensional space R3 is a vector space, and one possible basis for R3 is a set of the following unit vectors:[100], [010], [001].
That is all the vectors in R3 can be written as linear combination of these three unit vectors. For example, the arbitrary three dimentional vector [435] can be written as the linear combination:
[435]=4[100]+3[010]+5[001]. We can say the three vectors [100],[010], and [001]span the vector space R3 .
Column Space (or Range Space) of a Matrix
The column space (or range space) of a matrix A of size m×n, is the subspace of Rm which is spanned by the column vectors of A. The range space of A is denoted as R(A). The dimension of R(A), equals the maximum number of linear independent column vectors of A.
For example, let A=[111213]. Then the R(A) is a subspace in R3, and its elements can be written as linear combination of the two column vectors of A:
[111], and [123]. In this example, the dimension of R(A) is 2 becouse A has two independent columns.

Observation Theory: Estimating the Unknown by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://ocw.tudelft.nl/courses/observation-theory-estimating-unknown.