Özer Cem KELAHMETKELAHMET
Glossary

What is GGUF? Definition and meaning

A single-file format that stores quantized weights and metadata for efficient local inference.

Definition

GGUF: A single-file format that stores quantized weights and metadata for efficient local inference.

In short: File format for quantized models in llama.cpp.

When it is used

Running models on CPUs, laptops and edge devices.

Learn more

The full guide to GGUF explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: Generative UI · Next term: GIS

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open