Glossary
What is ORPO? Definition and meaning
Merges supervised fine-tuning and preference optimization into one stage with no reference model.
Definition
ORPO: Merges supervised fine-tuning and preference optimization into one stage with no reference model.
In short: Odds-ratio preference optimization.
When it is used
Cheaper single-stage alignment.
Learn more
The full guide to ORPO explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Orchestrator-workers · Next term: OWASP