Search Results
3 results for “gradient descent”
Foundations
Backpropagation
Backpropagation is the primary algorithm for training neural networks, computing gradients of a loss function with respect to each weight by applying the chain rule of calculus in reverse through the network layers.
6 min readUpdated May 2026
Foundations
Gradient Boosting
A machine learning ensemble technique that builds predictive models sequentially, where each new model corrects the errors of its predecessors using gradient descent optimisation.
4 min readUpdated May 2026
Foundations
Gradient Descent
Gradient descent is an iterative optimisation algorithm that minimises a loss function by repeatedly updating model parameters in the direction of the steepest descent, as defined by the negative gradient.
6 min readUpdated May 2026