Search Results
2 results for “activation function”
Foundations
Activation Function
A mathematical function applied to a neuron's output in a neural network that introduces non-linearity, enabling models to learn complex patterns beyond simple linear relationships.
7 min readUpdated June 2026
Foundations
Softmax Function
The softmax function converts a vector of real-valued scores into a probability distribution, and is widely used as the output layer of neural network classifiers and in attention mechanisms.
4 min readUpdated June 2026