# What is bitsandbytes? Definition and meaning

A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.

## Definition

**bitsandbytes**: A library providing 8-bit optimizers and 4-bit and 8-bit quantized layers, used by QLoRA.

In short: 8-bit and 4-bit quantization library for PyTorch.

## When it is used

Loading and fine-tuning large models in low precision.

## Learn more

The full guide to **[bitsandbytes](/tools/bitsandbytes)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [BitFit](/glossary/bitfit) · Next term: [BLIP-2](/glossary/blip-2)
