Özer Cem KELAHMETKELAHMET
Glossary · Machine learning

What is Ensemble learning? Definition and meaning

A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.

Definition

Ensemble learning: A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.

In short: Many models, fewer mistakes.

When it is used

Tabular prediction, competitions, risk scoring, forecasting and uncertainty estimation for neural networks.

Where it fits

Ensemble learning belongs to Classic models in the Machine learning topic. These are the other terms in the same group:

  • SVM: A model that finds the maximum-margin boundary, optionally in a kernel-induced feature space.
  • Random forest: Averages many decorrelated trees, each trained on a random sample of rows and features.
  • XGBoost: A fast, regularized gradient-boosting library for tabular data.
  • LightGBM: A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
  • CatBoost: A boosting library that handles categorical variables with ordered target statistics.
  • Clustering: Partitions data into groups of similar points, as with k-means or density-based methods.
  • Isolation forest: Isolates points with random trees, so anomalies are separated in fewer splits.

Learn more

The full guide to Ensemble learning explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.

Previous term: EMR Serverless · Next term: EU AI Act

Last updated Nov 18, 2026
Type to search.
    ↑↓ navigate↵ open