Glossary · Big data
What is Apache Hudi? Definition and meaning
An open table format and data platform that supports record-level upserts, deletes and incremental queries on lake storage.
Definition
Apache Hudi: An open table format and data platform that supports record-level upserts, deletes and incremental queries on lake storage.
In short: Updates and deletes on the data lake.
When it is used
Near-real-time ingestion and CDC into lakehouses.
Where it fits
Apache Hudi belongs to Storage and formats in the Big data topic. These are the other terms in the same group:
- Hadoop HDFS: An open-source framework for distributed storage (HDFS) and processing (MapReduce, YARN) on clusters of commodity servers.
- Apache Hive: A data warehouse system that runs SQL over files in distributed storage and keeps table metadata in the Hive Metastore.
- Apache Parquet: An open, compressed columnar file format that stores data by column for efficient analytical reads.
- Apache Arrow: A language-independent in-memory columnar format with libraries for zero-copy exchange, IPC and RPC (Flight).
Learn more
The full guide to Apache Hudi explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Apache Hive · Next term: Apache Iceberg