"The social hierarchies and historical biases present in our writings can be recovered from the statistical relationships learned by language models."
Caliskan, Bryson, and Narayanan demonstrated that embeddings trained on ordinary web text reproduce several associations also documented in human psychological studies. The study establishes that historical cultural associations are embedded in language data and can be acquired through statistical learning without explicit instructions to reproduce them.
View Source