Özer Cem KELAHMETKELAHMET
Glossary

What is Axial attention? Definition and meaning

Applies attention along one axis at a time, which keeps cost manageable on two-dimensional data.

Definition

Axial attention: Applies attention along one axis at a time, which keeps cost manageable on two-dimensional data.

In short: Attention along rows and columns separately.

When it is used

Letting a model reason over both rows and columns of a table.

Learn more

The full guide to Axial attention explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: AWS Lake Formation · Next term: Axolotl

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open