Özer Cem KELAHMETKELAHMET
Glossary

What is bitsandbytes? Definition and meaning

A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.

Definition

bitsandbytes: A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.

In short: 8-bit and 4-bit quantization library for PyTorch.

When it is used

Loading and fine-tuning large models in low precision.

Learn more

The full guide to bitsandbytes explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: BitFit · Next term: BLIP-2

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open