LLM daydreaming.

LLM daydreaming. Humans do something that LLMs don’t, and that might be exactly why we are creative and they are not. But, what if… “A reason may be that they lack some fundamental aspects of human thought: they are frozen, unable to learn from experience, and they have no “default mode” for background processing, a source of spontaneous human insight. To illustrate the issue, I describe such insights, and give an example concrete algorithm of a day-dreaming loop (DDL): a background process that continuously samples pairs of concepts from memory.” ~ learn more