Term tag: loss function

Loss Function

The number a model is trained to make smaller. Its slope, not its value, moves every weight — so the loss you pick decides what the model learns.

Optimization

In machine learning, optimization means minimizing a loss function to fit a model's parameters — the iterative, gradient-driven mechanism behind training.

Training

Training fits a model's parameters to data: forward pass, measure the loss, backward pass, nudge every weight downhill, repeat until the loss stops falling.