Özer Cem KELAHMETKELAHMET
Glossary

What is Optimization? Definition and meaning

The study of algorithms such as gradient descent that minimize objectives under constraints.

Definition

Optimization: The study of algorithms such as gradient descent that minimize objectives under constraints.

In short: Finding the parameters that minimize a loss.

When it is used

Choosing optimizers, learning-rate schedules and understanding training stability.

Learn more

The full guide to Optimization explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: OpenTelemetry · Next term: Optimizers

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open