# RLHF

Trains a reward model from human preference comparisons and then optimizes the language model against it with reinforcement learning.

## What it is used for

Aligning assistants with human preferences on helpfulness and safety.