# Self-supervised learning

Creates its own training signal by masking, corrupting or transforming the input and asking the model to recover or relate it.

## What it is used for

Pre-training foundation models on unlabelled text, images and tables, before any task-specific labels are used.