Large Language Monkeys: Why Noise Yields No Knowledge

Send us Fan Mail There is an old claim that a truly random source contains all knowledge: give monkeys enough time at typewriters and Shakespeare falls out. In 2024 two Sydney mathematicians did the arithmetic and found the universe ends first. But the idea has a modern tail. We now have language models that can spot meaningful text instantly, so why not let randomness generate and an LLM extract? This episode works through why that fails, and why the failure is precise: in a random stream, t...