# Transformers

Neural networks built on self-attention, letting every element of the input weigh every other element.

## What it is used for

The backbone of language models, vision transformers and tabular foundation models.