#005 · Gods of AIIconicLocked in

Richard S. Sutton

The Bitter Lesson

Reinforcement learning, and the essay that keeps being right

Rating

95Impact score
Research98
Systems built76
Openness92
Influence96
FromUSA / Canada
Era1988–present

Domains

Reinforcement learningTemporal-difference learningAGI

Scouting report

Invented temporal-difference learning and co-wrote Reinforcement Learning: An Introduction, the textbook the whole field learned from and which is free online. His 2019 essay “The Bitter Lesson” — that general methods plus compute beat handcrafted human knowledge — has become the most-cited two pages in modern AI. Shared the 2024 Turing Award.

Curator’s note

Wrote the shortest, most annoying, most consistently vindicated thing in AI.

Portrait

Painted from a photograph of Richard S. Sutton by Numenta, licensed CC BY 3.0.

Sources