Gary Marcus decides he deserves a victory lap.

After news of GPT improvements slowing down broke, the famous machine learning scientist who some call a skeptic writes: “For years I have been warning that “scaling” — eeking out improvements in AI by adding more data and more compute, without making fundamental architectural changes — would not continue forever.” My view is that all educated opinions are worth reading, and he certainly has one. ~ learn more