Glossary · Machine learning
What is XGBoost? Definition and meaning
A fast, regularized gradient-boosting library for tabular data.
Definition
XGBoost: A fast, regularized gradient-boosting library for tabular data.
In short: Gradient-boosted decision trees.
When it is used
A strong default baseline for tabular prediction and benchmarking.
Where it fits
XGBoost belongs to Classic models in the Machine learning topic. These are the other terms in the same group:
- SVM: A model that finds the maximum-margin boundary, optionally in a kernel-induced feature space.
- Random forest: Averages many decorrelated trees, each trained on a random sample of rows and features.
- Ensemble learning: A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.
- LightGBM: A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
- CatBoost: A boosting library that handles categorical variables with ordered target statistics.
- Clustering: Partitions data into groups of similar points, as with k-means or density-based methods.
- Isolation forest: Isolates points with random trees, so anomalies are separated in fewer splits.
Learn more
The full guide to XGBoost explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: World models · Next term: XTab