Format Online paper / PDF
Location PART 1 - TONS OF PUNKS, ONE BIG JERK CHAPTER 4: KEYSTROKES AND BRUSHSTROKES A Pint Is All You Need

"The 2017 paper Attention Is All You Need proposed the Transformer architecture based solely on attention mechanisms, dispensing with recurrence and convolution."

The paper introduced the Transformer architecture and explicitly described it as based on attention rather than recurrent or convolutional networks.

View Source
Source title Attention Is All You Need
Source authors Ashish Vaswani; Noam Shazeer; Niki Parmar; Jakob Uszkoreit; Llion Jones; Aidan N. Gomez; Lukasz Kaiser; Illia Polosukhin
Source year 2017
Confidence high
Importance mid
Back to evidence PREVIOUSNEXT