# What is GGUF? Definition and meaning

A single-file format that stores quantized weights and metadata for efficient local inference.

## Definition

**GGUF**: A single-file format that stores quantized weights and metadata for efficient local inference.

In short: File format for quantized models in llama.cpp.

## When it is used

Running models on CPUs, laptops and edge devices.

## Learn more

The full guide to **[GGUF](/tools/gguf)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Generative UI](/glossary/generative-ui) · Next term: [GIS](/glossary/gis)
