The bitter lesson vs the garbage can.
“And that is the Bitter Lesson — encoding human understanding into an AI tends to be worse than just letting the AI figure out how to solve the problem, and adding enough computing power until it can do it better than any human. The lesson is bitter because it means that our human understanding of problems built from a lifetime of experience is not that important in solving a problem…