What is Ensemble learning? Definition and meaning
A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.
Definition
Ensemble learning: A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.
In short: Many models, fewer mistakes.
When it is used
Tabular prediction, competitions, risk scoring, forecasting and uncertainty estimation for neural networks.
Where it fits
Ensemble learning belongs to Classic models in the Machine learning topic. These are the other terms in the same group:
- SVM: A model that finds the maximum-margin boundary, optionally in a kernel-induced feature space.
- Random forest: Averages many decorrelated trees, each trained on a random sample of rows and features.
- XGBoost: A fast, regularized gradient-boosting library for tabular data.
- LightGBM: A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
- CatBoost: A boosting library that handles categorical variables with ordered target statistics.
- Clustering: Partitions data into groups of similar points, as with k-means or density-based methods.
- Isolation forest: Isolates points with random trees, so anomalies are separated in fewer splits.
Learn more
The full guide to Ensemble learning explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: EMR Serverless · Next term: EU AI Act