Pavel Sokolovsky

Bitter Lesson

tech, startups, internet · Oct 2025

A bitter lesson for the bitter lesson fanboys.

This is a really great interview by Dwarkesh Patel, who I think is really on a roll the past ~year. “Richard Sutton is the father of reinforcement learning, winner of the 2024 Turing Award, and author of The Bitter Lesson. And he thinks LLMs are a dead end.” ~ learn more

tech, startups, internet · Aug 2025

The bitter lesson vs the garbage can.

“And that is the Bitter Lesson — encoding human understanding into an AI tends to be worse than just letting the AI figure out how to solve the problem, and adding enough computing power until it can do it better than any human. The lesson is bitter because it means that our human understanding of problems built from a lifetime of experience is not that important in solving a problem…