# What is NVIDIA H100? Definition and meaning

A GPU with Transformer Engine and fast interconnect, widely used for training and inference.

## Definition

**NVIDIA H100**: A GPU with Transformer Engine and fast interconnect, widely used for training and inference.

In short: Hopper-generation datacenter GPU.

## When it is used

Large-model training and serving.

## Where it fits

NVIDIA H100 belongs to **Hardware** in the [MLOps and AI infrastructure](/topics/mlops-ai-infrastructure) topic. These are the other terms in the same group:

- **[CUDA](/glossary/cuda)**: A programming model and toolkit for running general-purpose code on NVIDIA GPUs.
- **[NCCL](/glossary/nccl)**: A library that implements fast all-reduce and other communication between GPUs.
- **[Cloud TPU](/glossary/cloud-tpu)**: Google's custom accelerators for machine-learning workloads.
- **[NVIDIA H200](/glossary/nvidia-h200)**: A Hopper GPU with 141 GB of HBM3e memory.
- **[NVIDIA B200](/glossary/nvidia-b200)**: A GPU with a new architecture, larger memory and support for lower-precision formats.

## Learn more

The full guide to **[NVIDIA H100](/tools/nvidia-h100)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [NVIDIA B200](/glossary/nvidia-b200) · Next term: [NVIDIA H200](/glossary/nvidia-h200)
