Stochastic differential equations · Part 2 of 10
Brownian motion
Brownian motion is the central object of stochastic calculus. It is the continuous-time limit of a random walk, the simplest continuous martingale, and the source of randomness in every stochastic differential equation in this collection.
Definition
A standard Brownian motion is a process such that
- ;
- for any times , the increments are independent;
- each increment is Gaussian, with for ;
- the path is continuous, almost surely.
Equivalently, is a continuous Gaussian process with mean zero and covariance . All of its finite-dimensional distributions follow from the transition density
because the joint density of is the product . As a function of and , the transition density solves the heat equation , a first hint of the connection between diffusions and PDEs that a later post develops.
Symmetries
Several transformations turn a Brownian motion into another Brownian motion:
- Scaling: for any , the process is a Brownian motion.
- Reflection: is a Brownian motion.
- Restarting: for a fixed time , the process is a Brownian motion, independent of the path up to time .
- Time inversion: the process , set to at , is a Brownian motion.
Scaling is the most important of these. It says that zooming in on a Brownian path by a factor in time and in space gives a statistically identical picture. That already explains why the path cannot be differentiable: over a short time , its increments have size about , which is much larger than .
Does it exist?
The definition asks for a lot, and it is not obvious that any process satisfies all four conditions. Three constructions are worth knowing.
Kolmogorov’s route. The Kolmogorov extension theorem builds a process with the right finite-dimensional distributions on the space of all functions from to . That space is too large: continuity depends on uncountably many coordinates and is not even an event there. The Kolmogorov–Chentsov criterion fixes this. Because , and similar bounds hold for higher moments, the process has a version whose paths are continuous, and in fact Hölder continuous of every order below . The resulting probability measure on the space of continuous functions is called Wiener measure.
Lévy’s midpoint construction. Build the path on the dyadic times by successive refinement. Start with and . Given the values at the two ends of an interval of length , set the value at its midpoint to the average of the end values plus an independent correction, which is exactly the conditional distribution of a Brownian bridge at its midpoint. Interpolating linearly at each stage, the approximations can be written as a sum of tent-shaped functions (Schauder functions) with independent Gaussian coefficients. The largest of independent standard Gaussians grows only like , so the corrections shrink fast enough for the approximations to converge uniformly, almost surely, to a continuous limit.
Random Fourier series. On the interval , with independent standard Gaussians ,
defines a Brownian motion. You can check the covariance directly from the Fourier series identity
This is essentially Wiener’s original construction, and it pictures Brownian motion as random noise in which each frequency is weighted by .
Infinite length, finite quadratic variation
Take a partition with mesh , and consider the sum of squared increments
Each term has mean and variance , and the terms are independent, so
So the quadratic variation of Brownian motion on is exactly : it is not random at all. This has a striking consequence. If a path had finite total variation , then , which tends to zero by continuity, contradicting . So Brownian paths have infinite length on every interval. In fact, by a theorem of Paley, Wiener and Zygmund, they are nowhere differentiable, almost surely.
Infinite variation is the reason the integral cannot be defined path by path as a Stieltjes integral, and nonzero quadratic variation is the reason Itô’s formula has an extra term. The next two posts deal with both.
Martingale and Markov properties
Let be the information generated by the path up to time . Then each of the following is a martingale:
Each claim follows from the fact that is independent of . Brownian motion is also a Markov process: given its present position, its future is independent of its past. The strong Markov property extends this from fixed times to stopping times, and it leads to the reflection principle: for ,
The reason is a symmetry argument. Each path that reaches and ends below it can be matched with the path that is reflected about after its first visit there, which ends above it, and the two are equally likely.
A brief history
Robert Brown watched pollen particles jitter in water in 1827. Louis Bachelier used the same kind of random motion to model stock prices in his 1900 thesis, five years before Albert Einstein explained the physical phenomenon as the result of molecular collisions and used it to estimate the size of molecules. Norbert Wiener gave the first rigorous mathematical construction in 1923, which is why Brownian motion is also called the Wiener process.