# What is Linear algebra? Definition and meaning

The mathematics of vectors and matrices that underlies neural networks and embeddings.

## Definition

**Linear algebra**: The mathematics of vectors and matrices that underlies neural networks and embeddings.

In short: Vectors, matrices and their operations.

## When it is used

Attention, embeddings, decompositions and efficient GPU computation.

## Learn more

The full guide to **[Linear algebra](/tools/linear-algebra)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [LIME](/glossary/lime) · Next term: [Linear regression](/glossary/linear-regression)
