"RLHF can improve instruction following and truthfulness while still relying on imperfect learned signals of human preference."
OpenAI's InstructGPT research reports improvements in instruction following and factual reliability after human-feedback training. The work establishes that RLHF can improve model behaviour while retaining the distinction between human intentions and the reward signal used during optimisation.
View Source