Glossary · Machine learning
What is LightGBM? Definition and meaning
A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
Definition
LightGBM: A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
In short: Fast gradient boosting by Microsoft.
When it is used
Large tabular datasets with many features.
Where it fits
LightGBM belongs to Classic models in the Machine learning topic. These are the other terms in the same group:
- SVM: A model that finds the maximum-margin boundary, optionally in a kernel-induced feature space.
- Random forest: Averages many decorrelated trees, each trained on a random sample of rows and features.
- Ensemble learning: A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.
- XGBoost: A fast, regularized gradient-boosting library for tabular data.
- CatBoost: A boosting library that handles categorical variables with ordered target statistics.
- Clustering: Partitions data into groups of similar points, as with k-means or density-based methods.
- Isolation forest: Isolates points with random trees, so anomalies are separated in fewer splits.
Learn more
The full guide to LightGBM explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Learning to rank · Next term: LIME