Download PDF
Multi-layer perceptrons
Multi-class neural networks
Backpropagation
Alternatives to backpropagation
Regularising neural networks
Normalising neural networks
Addressing gradient problems with the Rectified Linear Unit (ReLU)
Pre-training neural networks
Probabilistic neural networks
Convolutional layers for neural networks
Autoencoders and Variational Autoencoders (VAE)
Restricted Boltzmann Machines (RBMs)
Self-organising maps
Generative Adversarial Networks (GANs)
The output for all nodes in a layer is \(0\) unless it is the greatest.
Single node, spits out the max of all inputs.