"With sufficient scale, text synthesis began to look suspiciously like human understanding, while language models demonstrated abilities across different tasks."
The GPT-3 paper documents performance across translation, question-answering, and other language tasks with little or no task-specific adaptation. It also reports that human evaluators had difficulty distinguishing some generated news articles from human-written ones, providing empirical support for the appearance of understanding described in the manuscript.
View Source