# Mixture-of-Experts

A layer with many expert networks where a router activates only a few per token, growing capacity without growing compute.

## What it is used for

Scaling model capacity efficiently in large language and foundation models.