NVIDIA Ultra-CC Beats Top Human at IOI 2026

This episode examines "Post-Training Language Models for Gold-Medal Performance in Coding Competitions" from NVIDIA, whose Ultra-CC system scored 535.4 out of 600 at the 2026 International Olympiad in Informatics — beating not just the gold cutoff of 361.12 but the top human competitor's 498.27, live and under real contest conditions. The discussion breaks down why IOI-style problems are a harder test than typical coding benchmarks, since they demand inventing novel algorithms rather than recognizing familiar patterns, with partial credit across subtasks revealing the difference between no idea, the right idea with wrong complexity, and a fully correct solution. It covers the four-stage training pipeline behind the result: curating 22,000 competitive programming problems, distilling teacher-model reasoning traces for supervised fine-tuning, applying reinforcement learning from verifiable code-execution rewards via GRPO, and using a test-time strategy called GenCorrect to refine candidate solutions before submission. The episode also contrasts the two models built, a smaller mixture-of-experts Nano-CC with RL and a much larger Ultra-CC trained only with SFT, tracing the underlying architecture and training ideas back to foundational work like Shazeer's mixture-of-experts paper, Switch Transformer, InstructGPT, and DeepSeek's R1. Listeners interested in how far AI reasoning has come against elite human problem-solvers will find the specific mechanics behind this milestone result compelling.

Sources:

1. Post-Training Language Models for Gold-Medal Performance in Coding Competitions — Aleksander Ficek, Sean Narenthiran, Mehrzad Samadi, Somshubra Majumdar, Boris Ginsburg, 2026

http://arxiv.org/abs/2609.02849

2. Competitive programming with large reasoning models (o1-ioi, o3) — OpenAI et al., 2025

https://scholar.google.com/scholar?q=Competitive+programming+with+large+reasoning+models+%28o1-ioi%2C+o3%29

3. Scaling test-time compute to achieve IOI gold medal with open-weight models (GenCluster) — Mehrzad Samadi, Aleksander Ficek, Sean Narenthiran, et al., 2026

https://scholar.google.com/scholar?q=Scaling+test-time+compute+to+achieve+IOI+gold+medal+with+open-weight+models+%28GenCluster%29

4. Nemotron-cascade 2: Post-training LLMs with cascade RL and multi-domain on-policy distillation — Zhuolin Yang et al., 2026

https://scholar.google.com/scholar?q=Nemotron-cascade+2%3A+Post-training+LLMs+with+cascade+RL+and+multi-domain+on-policy+distillation

5. Large Language Models Cannot Self-Correct Reasoning Yet — Jie Huang, Xinyun Chen, Swaroop Mishra, et al., 2024

https://scholar.google.com/scholar?q=Large+Language+Models+Cannot+Self-Correct+Reasoning+Yet