Format Online paper / PDF
Location PART 2 - FOUR HIDDEN CHIMNEYS CHAPTER 5: HISTORY NEVER ENDS History never ends - Root

"The Transformer architecture behind today’s LLM boom arrived in 2017."

I'm talking about today's neural LLM wave, not pretending language models were invented after 2004 - the Transformer paper landed in 2017 and introduced the architecture at the center of the current boom.

View Source
Source title Attention Is All You Need
Source authors Ashish Vaswani; Noam Shazeer; Niki Parmar; Jakob Uszkoreit; Llion Jones; Aidan N. Gomez; Lukasz Kaiser; Illia Polosukhin
Source year 2017
Confidence high
Importance mid
Back to evidence PREVIOUSNEXT