# What is ORPO? Definition and meaning

Merges supervised fine-tuning and preference optimization into one stage with no reference model.

## Definition

**ORPO**: Merges supervised fine-tuning and preference optimization into one stage with no reference model.

In short: Odds-ratio preference optimization.

## When it is used

Cheaper single-stage alignment.

## Learn more

The full guide to **[ORPO](/tools/orpo)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Orchestrator-workers](/glossary/orchestrator-workers) · Next term: [OWASP](/glossary/owasp)
