"During standard language-model pretraining, statements are not accompanied by explicit true-false labels."
OpenAI's research explains that pretraining learns from examples of language without receiving explicit correctness labels for each statement. This creates a fundamental difference between predicting plausible text and identifying whether a generated statement corresponds to reality.
View Source