Glossary
What is DeepEval? Definition and meaning
An open-source framework that runs metric-based tests on model outputs inside a test suite.
Definition
DeepEval: An open-source framework that runs metric-based tests on model outputs inside a test suite.
In short: Unit-test style evaluation for LLM apps.
When it is used
Regression testing of prompts, RAG systems and agents.
Learn more
The full guide to DeepEval explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Deduplication · Next term: DeepSeek V4.1