"DeepSeek-R1 combines rule-based rewards for verifiable reasoning tasks with model-based rewards for more general tasks."
The researchers distinguish accuracy and formatting rewards for mathematics, coding, and logical reasoning from model-based evaluation of more general responses. Their reward architecture demonstrates why objectively testable problems provide a different optimization signal from open-ended language-generation tasks.
View Source