The Papers That Moved AI: From AlexNet to This Year's Fights

Beyond "Attention Is All You Need": the papers that changed what the AI field believed was possible, and the ones from the past year that researchers actually argued about. The classics: AlexNet, word2vec, Bahdanau's 2014 attention paper (the real origin of attention), scaling laws, GPT-3 and in-context learning, Chinchilla, diffusion and chain-of-thought. Then the past twelve months: Tsinghua's challenge to the idea that RL teaches reasoning, a seven-million-parameter recursive model on ARC-AGI, reward hacking that turned into sabotage, DeepSeek reopening residual connections, memory and even text tokens, the Artificial Hivemind finding that all chatbots sound alike, and Recursive Language Models.

Episode 6070 — myweirdprompts.com/n/6070 (permanent short link: myweirdprompts.com/568125)