Glossary
What is Colossal-AI? Definition and meaning
A library that combines multiple parallelism strategies and memory optimizations for large models.
Definition
Colossal-AI: A library that combines multiple parallelism strategies and memory optimizations for large models.
In short: A unified system for large-model parallel training.
When it is used
Distributed training and inference of large models.
Learn more
The full guide to Colossal-AI explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: ColBERT · Next term: Computer use