Reward model
A model trained on human comparisons to give a score to an output, such as an answer. It stands in for human judgement during reinforcement learning, so people do not have to rate every output.
Introduced by
RLHF origin, 2017
Used by
- RLHF for summarisation, 2020
- InstructGPT, 2022
- HH-RLHF, 2022
- ChatGPT, 2022
- Llama 2, 2023
- DeepSeek-R1, 2025