# What is Linear regression? Definition and meaning

A model that predicts a numeric target as a weighted sum of input features, fitted by minimising squared error.

## Definition

**Linear regression**: A model that predicts a numeric target as a weighted sum of input features, fitted by minimising squared error.

In short: Predicting a number with a straight line.

## When it is used

Baselines, forecasting, pricing and explaining effects of variables.

## Where it fits

Linear regression belongs to **ML foundations** in the [Machine learning](/topics/machine-learning) topic. These are the other terms in the same group:

- **[Logistic regression](/glossary/logistic-regression)**: A linear model that outputs class probabilities through the logistic (sigmoid) function.
- **[Decision trees](/glossary/decision-trees)**: A model that splits data step by step on feature thresholds, forming a tree of decisions that ends in predictions.
- **[Gradient boosting](/glossary/gradient-boosting)**: An ensemble method that adds decision trees one at a time, each fitted to the remaining errors of the current model.
- **[k-nearest neighbors](/glossary/k-nearest-neighbors)**: A method that predicts by finding the k closest training examples and using their labels or values.
- **[Naive Bayes](/glossary/naive-bayes)**: A probabilistic classifier that applies Bayes' theorem assuming features are independent given the class.
- **[Principal component analysis](/glossary/principal-component-analysis)**: A linear method that finds orthogonal directions of maximum variance and projects data onto the top ones.
- **[t-SNE](/glossary/t-sne)**: A non-linear method that projects high-dimensional data to 2D or 3D, preserving local neighbourhoods for visualisation.
- **[Cross-validation](/glossary/cross-validation)**: A method that rotates which part of the data is held out for testing, averaging results across folds.

## Learn more

The full guide to **[Linear regression](/tools/linear-regression)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [Linear algebra](/glossary/linear-algebra) · Next term: [LLaMA-Factory](/glossary/llama-factory)
