Glossary · Generative AI and LLMs
What is Langfuse? Definition and meaning
A platform for tracing, prompt management, scoring and cost tracking of LLM applications.
Definition
Langfuse: A platform for tracing, prompt management, scoring and cost tracking of LLM applications.
In short: Open-source LLM observability and evaluation.
When it is used
Observability of production LLM and agent systems.
Where it fits
Langfuse belongs to LLM observability and evaluation in the Generative AI and LLMs topic. These are the other terms in the same group:
- LangSmith: A platform from LangChain for tracing runs, building datasets and evaluating prompts and agents.
- Phoenix: A tool for tracing LLM applications with OpenTelemetry and running evaluations on the traces.
- Braintrust: A platform for running experiments, scoring outputs and tracking quality over time.
- PromptFoo: A command-line tool that runs test cases and comparisons across prompts and models, including security tests.
- lm-evaluation-harness: EleutherAI's framework that runs a large library of academic benchmarks against a model with a unified interface.
Learn more
The full guide to Langfuse explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.