Unconstrained optimisation of non-differentiable real functions

Non-differentiable functions

Subgradient descent

Hill climbing

We initialise at some point in the parameter space.

We identifify nearby alternative points in parameter space, and move to the one with the most improvement.

Movement only occurs in one parameter at a time.