# What is PEFT? Definition and meaning

A library that implements LoRA, prefix tuning, prompt tuning and related methods on top of Hugging Face models.

## Definition

**PEFT**: A library that implements LoRA, prefix tuning, prompt tuning and related methods on top of Hugging Face models.

In short: Hugging Face library for parameter-efficient fine-tuning.

## When it is used

Applying and managing adapters in training and inference code.

## Where it fits

PEFT belongs to **Fine-tuning** in the [Generative AI and LLMs](/topics/generative-ai-llms) topic. These are the other terms in the same group:

- **[Fine-tuning](/glossary/fine-tuning)**: Further training of a pretrained model on new data so it performs a specific task, domain or style better.
- **[Full fine-tuning](/glossary/full-fine-tuning)**: Continues training with all model parameters trainable, rather than a small add-on.
- **[SFT](/glossary/sft)**: Trains a model on curated prompts and ideal responses so it follows instructions in the desired style.
- **[LoRA](/glossary/lora)**: Freezes the model and learns small low-rank update matrices for selected layers, so only a small fraction of parameters change.
- **[QLoRA](/glossary/qlora)**: Combines 4-bit quantization of the frozen base with LoRA adapters, which cuts memory enough to fine-tune large models on one GPU.
- **[DPO](/glossary/dpo)**: Optimizes a model directly on preferred versus rejected answers, without training a separate reward model or running reinforcement learning.
- **[RLHF](/glossary/rlhf)**: Trains a reward model from human preference comparisons and then optimizes the language model against it with reinforcement learning.

## Learn more

The full guide to **[PEFT](/tools/peft)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [PatchTST](/glossary/patchtst) · Next term: [Perceiver IO](/glossary/perceiver-io)
