Glossary · Machine learning
What is Random forest? Definition and meaning
Averages many decorrelated trees, each trained on a random sample of rows and features.
Definition
Random forest: Averages many decorrelated trees, each trained on a random sample of rows and features.
In short: An ensemble of decision trees.
When it is used
A robust baseline with little tuning.
Where it fits
Random forest belongs to Classic models in the Machine learning topic. These are the other terms in the same group:
- SVM: A model that finds the maximum-margin boundary, optionally in a kernel-induced feature space.
- Ensemble learning: A family of methods that train several models and combine their predictions into one, usually more accurate and more stable, answer.
- XGBoost: A fast, regularized gradient-boosting library for tabular data.
- LightGBM: A gradient-boosting framework that grows trees leaf-wise and uses histogram splits for speed.
- CatBoost: A boosting library that handles categorical variables with ordered target statistics.
- Clustering: Partitions data into groups of similar points, as with k-means or density-based methods.
- Isolation forest: Isolates points with random trees, so anomalies are separated in fewer splits.
Learn more
The full guide to Random forest explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.