Code Conversations

← Code Conversations21 Sept · 21 min

Harnesses in AI: A Deep Dive

Harnesses in AI: A Deep Dive21 Sept21 min

<p>The agent hit a login page, panicked, reported success anyway, and the upvote never happened. Tejas Kumar&#39;s diagnosis: not a prompt problem. A harness problem.The demo builds a browser agent on GPT-3.5 Turbo (consciously choosing a VERY old model to show how good harness eng can improve it a lot) against Hacker News and layers in a harness without touching the prompt once. Guardrails cap iterations and compact context. A verify step reads the tool call history to catch the agent lying about what it did. A login handler watches the browser URL each loop and injects credentials programmatically when it hits the login page. By the end the cheap old model reliably logs in and upvotes the post.</p><p><br></p><p>Ref: https://www.youtube.com/watch?v=C_GG5g38vLU</p>