"IBM researchers were among the earlier pioneers of statistical language modelling, long before Transformers entered the scene."
IBM researchers investigated statistical word classification and adaptive language models decades before the Transformer architecture emerged. This demonstrates the continuity between older statistical approaches to language and modern AI systems.
View Source