Emergent abilities of large language models.

The concept of emergence is a few decades old at least. It’s fascinating. From an article I shared last year: “When electrons or atoms or individuals or societies interact with one another or their environment, the collective behavior of the whole is different from that of its parts.” This paper discusses that same phenomenon which is now visible in language models of sufficient scale. ~ learn more