"Modern large language models are far more powerful than Word2vec, but they still convert written language into numerical representations and learn patterns from text."
Vaswani and colleagues introduced the Transformer architecture, which processes numerical token representations using attention mechanisms. Modern language models use considerably more sophisticated architectures than Word2vec, but the underlying use of learned mathematical representations preserves the connection described in the manuscript.
View Source