"Language models learn latent statistical structure underlying human-generated text, including structures associated with harmful social biases."
Resnik argues that the learning mechanisms responsible for the usefulness of contemporary LLMs also acquire problematic patterns from human language. His position paper explains why mitigating harmful bias is difficult when the relevant associations are intertwined with the broader representations learned by the model.
View Source