Glossary · Big data
What is Prefect? Definition and meaning
A Python workflow orchestrator where decorated functions become flows and tasks with retries, caching and monitoring.
Definition
Prefect: A Python workflow orchestrator where decorated functions become flows and tasks with retries, caching and monitoring.
In short: Orchestration that feels like plain Python.
When it is used
Data pipelines, ML jobs and automation scripts.
Where it fits
Prefect belongs to Orchestration in the Big data topic. These are the other terms in the same group:
- Dagster: A Python orchestrator where pipelines are defined as data assets with dependencies, lineage and checks.
Learn more
The full guide to Prefect explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Predictive maintenance · Next term: Prefix tuning