Glossary
What is Axial attention? Definition and meaning
Applies attention along one axis at a time, which keeps cost manageable on two-dimensional data.
Definition
Axial attention: Applies attention along one axis at a time, which keeps cost manageable on two-dimensional data.
In short: Attention along rows and columns separately.
When it is used
Letting a model reason over both rows and columns of a table.
Learn more
The full guide to Axial attention explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: AWS Lake Formation · Next term: Axolotl