Glossary
What is DoRA? Definition and meaning
Splits each weight into magnitude and direction and applies low-rank updates to the direction, which narrows the gap to full fine-tuning.
Definition
DoRA: Splits each weight into magnitude and direction and applies low-rank updates to the direction, which narrows the gap to full fine-tuning.
In short: Weight-decomposed low-rank adaptation.
When it is used
A drop-in upgrade to LoRA when extra quality matters.
Learn more
The full guide to DoRA explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Domain-driven design · Next term: Double DQN