Are emergent abilities of large language models a mirage?

This paper argues that by choosing the specific tests and measures that most researchers gravitate toward, they bias the results to look like emergence. “Specifically, nonlinear or discontinuous metrics produce apparent emergent abilities, whereas linear or continuous metrics produce smooth, continuous, predictable changes in model performance.” ~ learn more