Glossary
What is TRPO? Definition and meaning
Constrains each policy update with a KL-divergence trust region, giving monotonic-improvement guarantees in theory.
Definition
TRPO: Constrains each policy update with a KL-divergence trust region, giving monotonic-improvement guarantees in theory.
In short: Trust-region policy optimization.
When it is used
Situations where very conservative, stable policy updates matter; PPO is its simpler descendant.
Learn more
The full guide to TRPO explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.