Glossary · Big data
What is Apache Parquet? Definition and meaning
An open, compressed columnar file format that stores data by column for efficient analytical reads.
Definition
Apache Parquet: An open, compressed columnar file format that stores data by column for efficient analytical reads.
In short: Columnar files for fast analytics.
When it is used
Data lakes, lakehouse tables, warehouses and ML datasets.
Where it fits
Apache Parquet belongs to Storage and formats in the Big data topic. These are the other terms in the same group:
- Hadoop HDFS: An open-source framework for distributed storage (HDFS) and processing (MapReduce, YARN) on clusters of commodity servers.
- Apache Hive: A data warehouse system that runs SQL over files in distributed storage and keeps table metadata in the Hive Metastore.
- Apache Hudi: An open table format and data platform that supports record-level upserts, deletes and incremental queries on lake storage.
- Apache Arrow: A language-independent in-memory columnar format with libraries for zero-copy exchange, IPC and RPC (Flight).
Learn more
The full guide to Apache Parquet explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Apache Kafka · Next term: Apache Pulsar