# What is KServe? Definition and meaning

A standard custom resource for serving models with autoscaling, canary rollouts and transformers.

## Definition

**KServe**: A standard custom resource for serving models with autoscaling, canary rollouts and transformers.

In short: Model serving on Kubernetes.

## When it is used

Production inference on Kubernetes.

## Where it fits

KServe belongs to **MLOps** in the [MLOps and AI infrastructure](/topics/mlops-ai-infrastructure) topic. These are the other terms in the same group:

- **[MLflow](/glossary/mlflow)**: A tool for experiment tracking, model registry and deployment.
- **[Kubeflow](/glossary/kubeflow)**: A toolkit for pipelines, training operators and serving on Kubernetes.
- **[Weights & Biases](/glossary/weights-and-biases)**: A platform that logs metrics, artifacts and sweeps for machine-learning runs.
- **[BentoML](/glossary/bentoml)**: A framework that packages models as services with dependencies and deploys them.
- **[Ray Serve](/glossary/ray-serve)**: A serving library built on Ray that composes models and scales them across a cluster.
- **[SageMaker](/glossary/sagemaker)**: A managed service for building, training and deploying models on AWS.
- **[Vertex AI](/glossary/vertex-ai)**: A managed platform for training, tuning and deploying models and agents.
- **[Feature store](/glossary/feature-store)**: A system that defines, stores and serves ML features consistently for offline training and online inference.
- **[Model monitoring](/glossary/model-monitoring)**: Continuous tracking of input data, predictions and outcomes of deployed models to detect drift and performance decay.
- **[Model cards](/glossary/model-cards)**: Structured documentation of a model's purpose, training data, evaluation, limitations and ethical considerations.

## Learn more

The full guide to **[KServe](/tools/kserve)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Knowledge distillation](/glossary/knowledge-distillation) · Next term: [KTO](/glossary/kto)
