Neural network

The bread-and-butter of machine learning.

Multi-layer perceptron (MLP)

This is the most vanilla neural network. Also called a fully-connected network. This is just a series of matrix multiplications with non-linearities between them.

You tweak the values in the matrices to make your loss go lower and you’re learning.

Transformer

A transformer is a neural network that processes a set of items.

Backlinks

• Autoencoder
• Batch normalization
• Deep learning
• Evolving neural net classifiers
• Forward-Forward algorithm
• JAX
• Kolmogorov-Arnold network
• Large Language Model (LLM)
• Learning rate scheduler
• Multispectral auto-encoder

Leave a Comment