Glossary
What is Mixed precision? Definition and meaning
Uses 16-bit or 8-bit arithmetic for most operations and keeps sensitive values in 32-bit.
Definition
Mixed precision: Uses 16-bit or 8-bit arithmetic for most operations and keeps sensitive values in 32-bit.
In short: Training with lower-precision numbers where safe.
When it is used
Faster training and lower memory with little loss in quality.
Learn more
The full guide to Mixed precision explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Mistral Large 4 · Next term: Mixture-of-Experts