# What is Fine-tuning? Definition and meaning

Further training of a pretrained model on new data so it performs a specific task, domain or style better.

## Definition

**Fine-tuning**: Further training of a pretrained model on new data so it performs a specific task, domain or style better.

In short: Teach a trained model new habits.

## When it is used

Adapting language, vision and tabular models to company data, formats, tone, tools and preferences.

## Where it fits

Fine-tuning belongs to **Fine-tuning** in the [Generative AI and LLMs](/topics/generative-ai-llms) topic. These are the other terms in the same group:

- **[Full fine-tuning](/glossary/full-fine-tuning)**: Continues training with all model parameters trainable, rather than a small add-on.
- **[SFT](/glossary/sft)**: Trains a model on curated prompts and ideal responses so it follows instructions in the desired style.
- **[LoRA](/glossary/lora)**: Freezes the model and learns small low-rank update matrices for selected layers, so only a small fraction of parameters change.
- **[QLoRA](/glossary/qlora)**: Combines 4-bit quantization of the frozen base with LoRA adapters, which cuts memory enough to fine-tune large models on one GPU.
- **[PEFT](/glossary/peft)**: A library that implements LoRA, prefix tuning, prompt tuning and related methods on top of Hugging Face models.
- **[DPO](/glossary/dpo)**: Optimizes a model directly on preferred versus rejected answers, without training a separate reward model or running reinforcement learning.
- **[RLHF](/glossary/rlhf)**: Trains a reward model from human preference comparisons and then optimizes the language model against it with reinforcement learning.

## Learn more

The full guide to **[Fine-tuning](/tools/fine-tuning)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Few-shot learning](/glossary/few-shot-learning) · Next term: [FinTech](/glossary/fintech)
