One of the most important ideas in all of mathematics is the concept of a vector space.

At first, vector spaces seem to belong only to linear algebra. However, as mathematics develops, they appear everywhere:

• Differential equations
• Measure theory
• Functional analysis
• Probability
• Quantum mechanics
• Machine learning
• Data science
• Signal processing

In fact, one of the major milestones in mathematics occurs when a collection of objects is shown to form a vector space.

The moment this happens, a vast collection of powerful tools becomes available.

The Basic Idea

A vector space is a collection of objects that can be:

1. Added together
2. Multiplied by numbers (called scalars)

while remaining inside the collection.

The objects need not be arrows.

They can be:

• Points
• Functions
• Matrices
• Polynomials
• Sequences
• Signals
• Solutions of differential equations

The crucial requirement is that addition and scalar multiplication behave nicely.

Formal Definition

A vector space (V) over the real numbers is a set equipped with two operations:

Vector Addition

For any:

$$u,v\in V$$

there exists:

$$u+v\in V.$$

Scalar Multiplication

For any scalar:

$$c\in\mathbb{R}$$

and vector:

$$v\in V,$$

there exists:

$$cv\in V.$$

The resulting objects must remain inside the space.

Example 1: Ordinary Vectors

The familiar space:

$$\mathbb{R}^2$$

consists of vectors:

$$\begin{pmatrix}x\\y\end{pmatrix}.$$

Addition works:

$$\begin{pmatrix}1\\2\end{pmatrix}+\begin{pmatrix}3\\4\end{pmatrix}=\begin{pmatrix}4\\6\end{pmatrix}.$$

Scalar multiplication works:

$$2\begin{pmatrix}1\\2\end{pmatrix}=\begin{pmatrix}2\\4\end{pmatrix}.$$

Thus (\mathbb{R}^2) is a vector space.

Example 2: Polynomials

Consider all polynomials:

$$a_0+a_1x+\cdots+a_nx^n.$$

Adding two polynomials produces another polynomial.

Multiplying a polynomial by a scalar produces another polynomial.

Therefore the collection of all polynomials forms a vector space.

Example 3: Continuous Functions

Let:

$$C([0,1])$$

denote the set of continuous functions on ([0,1]).

If:

$$f(x)=x$$

and

$$g(x)=x^2,$$

then:

$$f+g=x+x^2$$

is still continuous.

Likewise:

$$3f(x)=3x$$

is still continuous.

Therefore continuous functions form a vector space.

Example 4: Integrable Functions

Measure theory introduces:

$$L^1.$$

This consists of functions satisfying:

$$\int |f|,d\mu<\infty.$$

If:

$$f,g\in L^1,$$

then:

$$f+g\in L^1$$

and

$$cf\in L^1.$$

Thus (L^1) is a vector space.

This fact is one of the starting points of functional analysis.

The Vector Space Properties

A vector space satisfies several important axioms.

Commutativity

$$u+v=v+u.$$

Associativity

$$(u+v)+w=u+(v+w).$$

Zero Vector

There exists:

$$0\in V$$

such that:

$$v+0=v.$$

Additive Inverses

For every (v),

there exists:

$$-v$$

such that:

$$v+(-v)=0.$$

Compatibility with Scalars

$$(ab)v=a(bv).$$

Distributive Laws

$$a(u+v)=au+av$$

and

$$(a+b)v=av+bv.$$

These axioms ensure that vector spaces behave predictably.

Why Is Becoming a Vector Space So Important?

This is the key question.

Suppose you discover a collection of objects forms a vector space.

Immediately, an enormous amount of mathematics becomes available.

Linear Combinations

You can form expressions like:

$$a_1v_1+a_2v_2+\cdots+a_nv_n.$$

This allows complicated objects to be built from simpler ones.

Basis

You can ask:

What is the smallest collection of vectors from which every other vector can be built?

This leads to the notion of a basis.

For example:

$$\begin{pmatrix}1\\0\end{pmatrix},
\begin{pmatrix}0\\1\end{pmatrix}$$

form a basis for $\mathbb{R}^2$.

Dimension

Once a basis exists, we can define dimension.

Examples:

$$\dim(\mathbb{R}^2)=2$$

$$\dim(\mathbb{R}^3)=3.$$

Function spaces often have infinite dimension.

This realization leads directly into functional analysis.

Linear Transformations

Once we have vector spaces, we can study maps that preserve their structure.

A map:

$$T:V\to W$$

is linear if:

$$T(u+v)=T(u)+T(v)$$

and

$$T(cv)=cT(v).$$

Examples include:

• Matrices
• Derivatives
• Integrals
• Fourier transforms

Eigenvalues and Eigenvectors

One of the most powerful ideas in mathematics is:

$$T(v)=\lambda v.$$

This leads to:

• Quantum mechanics
• Vibrations
• Principal component analysis
• Differential equations
• Machine learning

None of this exists until we have a vector space.

Inner Products and Geometry

Some vector spaces allow us to define:

$$\langle u,v\rangle.$$

This introduces:

• Length
• Angles
• Orthogonality
• Projections

For example, in (L^2),

$$\langle f,g\rangle=\int fg,d\mu.$$

Suddenly geometry appears inside spaces of functions.

The Bridge to Functional Analysis

One of the greatest discoveries in modern mathematics is that functions can be treated as vectors.

For example:

$$L^1,\quad L^2,\quad L^p$$

are all vector spaces.

This allows us to apply linear algebra to functions.

The resulting subject is called functional analysis.

In many ways, functional analysis is simply:

Linear algebra on infinite-dimensional vector spaces.

Why Measure Theory Leads Here

You are currently studying measure theory.

One of the first major discoveries is that spaces such as:

$$L^1$$

and

$$L^2$$

are vector spaces.

Once this is established, we can:

• Add functions
• Scale functions
• Define norms
• Define distances
• Define convergence
• Study linear operators
• Study Hilbert spaces

This eventually leads to:

Measure Theory
      ↓
Lᵖ Spaces
      ↓
Normed Spaces
      ↓
Banach Spaces
      ↓
Hilbert Spaces
      ↓
Functional Analysis

Why Vector Spaces Matter Everywhere

Vector spaces appear throughout mathematics because they provide a framework in which complicated objects can be manipulated using algebra.

The same ideas work for:

• Arrows in geometry
• Polynomials
• Functions
• Signals
• Random variables
• Solutions of differential equations

Once a collection becomes a vector space, powerful concepts such as bases, dimension, orthogonality, linear transformations, eigenvalues, and projections become available.

This is why proving that a collection forms a vector space is often the first major step in studying it.

The Big Insight

The most important conceptual leap is:

A vector is not an arrow.

A vector is any object that can be added and scaled while satisfying the vector space axioms.

This simple observation transformed mathematics.

It allowed functions to be treated like vectors, leading to functional analysis, quantum mechanics, modern probability theory, and much of contemporary mathematics.

Vector spaces are the language that allows structure, geometry, and algebra to coexist.

References

1. Sheldon Axler, Linear Algebra Done Right, 3rd Edition, Springer, 2015.
2. Kenneth Hoffman and Ray Kunze, Linear Algebra, 2nd Edition, Pearson.
3. Gilbert Strang, Introduction to Linear Algebra, 5th Edition, Wellesley-Cambridge Press, 2016.
4. Terence Tao, Analysis I, Hindustan Book Agency, 2006.
5. Erwin Kreyszig, Introductory Functional Analysis with Applications, Wiley, 1978.
6. John B. Conway, A Course in Functional Analysis, 2nd Edition, Springer, 1990.
7. Gerald B. Folland, Real Analysis: Modern Techniques and Their Applications, 2nd Edition, Wiley, 1999.