"Text-only language models learn from incomplete records of the world, inheriting some of the missing information and biases contained in those records."
OpenAI's early GPT research explicitly identifies limitations arising from learning about the world through text, noting that books and internet documents provide incomplete and sometimes inaccurate information. This directly supports the book's map-versus-territory and dark-information arguments.
View Source