Glossary · Big data
What is Dagster? Definition and meaning
A Python orchestrator where pipelines are defined as data assets with dependencies, lineage and checks.
Definition
Dagster: A Python orchestrator where pipelines are defined as data assets with dependencies, lineage and checks.
In short: Orchestrating data assets, not just tasks.
When it is used
Modern data platforms, dbt projects and ML pipelines.
Where it fits
Dagster belongs to Orchestration in the Big data topic. These are the other terms in the same group:
- Prefect: A Python workflow orchestrator where decorated functions become flows and tasks with retries, caching and monitoring.
Learn more
The full guide to Dagster explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Curriculum scheduling · Next term: Data catalog