# What is Colossal-AI? Definition and meaning

A library that combines multiple parallelism strategies and memory optimizations for large models.

## Definition

**Colossal-AI**: A library that combines multiple parallelism strategies and memory optimizations for large models.

In short: A unified system for large-model parallel training.

## When it is used

Distributed training and inference of large models.

## Learn more

The full guide to **[Colossal-AI](/tools/colossal-ai)** explains how it works, when to use it and how it compares with the alternatives, with examples. The [glossary](/glossary) lists every term on the site from A to Z.

Previous term: [ColBERT](/glossary/colbert) · Next term: [Computer use](/glossary/computer-use)
