Download PDF

Events, the probability function and the Kolgomorov axioms

Conditional probability and Bayes' theorem

Entropy

Variables

Expected value, conditional expectation and Jensen's inequality

Variance and covariance

Higher moments

Markov's inequality and Chebyshev's inequality

Characteristic functions

Degenerate, Bernoulli and categorical distributions

Simple continuous distributions

Independent and identically distributed variables

The weak law of large numbers

Levy's continuity theorem

The central limit theorem and the gaussian/normal distribution

Statistics

Order statistics

Totals of independent draws: Binominal and Poisson distributions

Time between draws: geometric and exponential distributions

Extreme value distributions

The geometric distribution

Mixture distributions

Stochastic processes and their moments

White noise, and weak- and wide-sense stationarity

Random walks

Martingale processes

Markov processes

Multivariate time series

Bayesian networks

Survival functions

Orders of integration

Auto-Regressive processes, Moving-Average processes and Wold's theorem

Vector Autoregression (VAR)

ARMAX

Partial Adjustment Model (PAM)

Error Correction Model

Wiener processes and Brownian motion

Stochastic differential equations

Rejection sampling

Markov chain Monte Carlo sampling

Sampling from processes

Forecasting stochastic processes

Creating pseudo-random numbers

Stochastic methods for integration

Stochastic optimisation

Calculus of stochastic processes

Lossy compression

Non-cryptographic hashes

Quantisation and sample rates

Discrete Fourier Transform

Down sampling

Fast Fourier Transform

Noisy networks

Please select a chapter from the left.

This is a live document, and is full of gaps, mistakes, typos etc.