# GGUF

A single-file format that stores quantized weights and metadata for efficient local inference.

## What it is used for

Running models on CPUs, laptops and edge devices.