Özer Cem KELAHMETKELAHMET
Glossary · Big data

What is Hadoop HDFS? Definition and meaning

An open-source framework for distributed storage (HDFS) and processing (MapReduce, YARN) on clusters of commodity servers.

Definition

Hadoop HDFS: An open-source framework for distributed storage (HDFS) and processing (MapReduce, YARN) on clusters of commodity servers.

In short: The original big data platform.

When it is used

Legacy data lakes and on-premises big data processing.

Where it fits

Hadoop HDFS belongs to Storage and formats in the Big data topic. These are the other terms in the same group:

  • Apache Hive: A data warehouse system that runs SQL over files in distributed storage and keeps table metadata in the Hive Metastore.
  • Apache Hudi: An open table format and data platform that supports record-level upserts, deletes and incremental queries on lake storage.
  • Apache Parquet: An open, compressed columnar file format that stores data by column for efficient analytical reads.
  • Apache Arrow: A language-independent in-memory columnar format with libraries for zero-copy exchange, IPC and RPC (Flight).

Learn more

The full guide to Hadoop HDFS explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: Guardrails AI · Next term: HashiCorp Vault

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open