Agentic Conversations (formally mlops.community)

← Agentic Conversations (formally mlops.community)20 Aug · 29 min

How Predictive Analytics Stops Budget Overruns Before They Happen?

How Predictive Analytics Stops Budget Overruns Before They Happen?20 Aug29 min

<p>Every engineer at Wayfair can now see, in real time, exactly what their code costs, and that&#39;s on purpose. <em>Brent Eubanks</em>, FinOps Architect at <a href="https://www.wayfair.com" target="_blank" rel="noopener noreferer">Wayfair</a>, walks us through what happens when you stop treating AI spend as a finance problem and start treating it as an engineering one.The story that sticks with you: a team was burning $400k a month on an LLM-driven workflow, until they flipped the whole thing on its head - hard-coded logic doing the heavy lifting, AI called in only when it&#39;s actually needed. New spend: $80k. It&#39;s the kind of move that only makes sense once you realize more agentic autonomy isn&#39;t always the win it&#39;s sold as.From there we get into the machinery Wayfair has built to make cost ownership feel less like a punishment and more like a superpower: guardrails baked straight into coding copilots, predictive alerts that catch a team blowing its budget before the month even ends, a &quot;spend captain&quot; system that pushes budget decisions down to the people closest to the work, and a genuinely strange new question every tech leader is starting to ask: if you were staffing a company with a team of AI agents instead of people, what would that org chart even look like?Wayfair: <a href="https://www.wayfair.com" target="_blank" rel="noopener noreferer">https://www.wayfair.com</a>Brent Eubanks: <a href="https://www.linkedin.com/in/brenteubanks" target="_blank" rel="noopener noreferer">https://www.linkedin.com/in/brenteubanks</a>Demetrios: <a href="https://www.linkedin.com/in/dpbrinkm" target="_blank" rel="noopener noreferer">https://www.linkedin.com/in/dpbrinkm</a>Timestamps:[00:00] Intro &amp; teaser [01:14] Meet Brent (FinOps Architect, Wayfair) [02:34] Making AI adoption easy for developers [03:30] Three-area cost governance framework [04:45] Automated FinOps guardrails in pull requests [07:29] Predictive analytics: 400% over budget warnings [08:26] The 400% spender: asset or liability? [10:06] The &quot;spend captain&quot; model [12:13] The goal: 1000x more token use in two years [13:05] The thought experiment [15:08] The $400k workflow rebuilt for $80k [16:42] Hardcoded first, LLM as fallback [19:49] Engineers now own their full cost stack [20:13] The FinOps companion that works overnight [24:10] Guardrails injected before the pull request [26:17] Recurring tasks become automated skills [27:46] Sankey diagram: cost per agent step in real time [28:40] &quot;The bill didn&#39;t blow up - that doesn&#39;t happen by accident&quot;</p>