Ashish Vaswani
First Author on the Transformer
Attention Is All You Need
Rating
96Impact score
Domains
TransformersAttentionSequence modelling
Scouting report
Lead author of the 2017 paper that threw out recurrence and convolution and kept only attention. Every large language model since is a transformer, which makes those eight pages the most consequential architecture paper of the century so far. Later co-founded Adept and then Essential AI.
Curator’s note
One paper, and the shape of every model you have used since.
Sources
- 01Attention Is All You Need (2017) arxiv.org
- 02Essential AI essential.ai