Glossary
What is bitsandbytes? Definition and meaning
A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.
Definition
bitsandbytes: A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.
In short: 8-bit and 4-bit quantization library for PyTorch.
When it is used
Loading and fine-tuning large models in low precision.
Learn more
The full guide to bitsandbytes explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.