Glossary · Big data
What is Apache Beam? Definition and meaning
A programming model and SDKs for data pipelines that run unchanged on several execution engines.
Definition
Apache Beam: A programming model and SDKs for data pipelines that run unchanged on several execution engines.
In short: Write once, run batch or streaming.
When it is used
Portable batch and streaming ETL, especially on Google Cloud Dataflow.
Where it fits
Apache Beam belongs to Streaming in the Big data topic. These are the other terms in the same group:
- Amazon Kinesis: AWS services for ingesting, storing and delivering streaming data in real time.
- Apache Pulsar: A distributed pub-sub messaging and streaming system that separates brokers from storage (BookKeeper).
Learn more
The full guide to Apache Beam explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Apache Arrow · Next term: Apache Flink