Beyond The Pilot: Enterprise AI in Action

← Beyond The Pilot: Enterprise AI in Action8 Jul · 15 min

Routing Wars: Which Model Gets the Workload?

Routing Wars: Which Model Gets the Workload?8 Jul15 min

66% of enterprise AI teams are actively engineering toward zero human oversight — but only 4.5% fully trust their automated evals. Half have already shipped an agent that passed evals and still failed a real customer.

VentureBeat's latest research exposes a dangerous gap between deployment ambition and evaluation maturity. The most-used eval platform is OpenAI's native tooling. The second most common answer: no dedicated eval platform at all. Meanwhile, 51% of enterprises are relying on a hyperscaler's built-in guardrails as their primary AI security layer — not a deliberate security architecture.

Fable's 19-day market absence changed the conversation. Enterprises that had built production workflows on frontier models got a wake-up call about single-vendor dependency. The result: GLM 5.2 is gaining serious developer traction as an open alternative competitive with Opus 4.8, and Tencent's new Hai 3 — less than half the size — is drawing attention for agentic workloads that don't require cutting-edge coding performance. Sam and Matt break down why companies like Shopify, LinkedIn, and Pinterest were already on open models, and why others are now catching up fast.

On infrastructure: neo-clouds are currently used by just 2% of respondents, but 45% name them as their top planned investment area over the next 12 months. The market hasn't calcified. Matt and Sam preview what they expect to hear at VentureBeat Transform from engineering leaders at Intuit, Brex, Instacart, and Mastercard — including how Intuit bootstrapped and pivoted its agent architecture mid-build, and why agent conversations are generating higher-quality behavioral data than traditional user research ever did.

🎙️ HOSTS: Matt Marshall · Sam Witteveen | VentureBeat

__

If you enjoy these conversations, you need to be in Menlo Park this July.

VB Transform 2026 is VentureBeat's flagship enterprise AI event, built entirely around one question: How do you orchestrate AI autonomy at scale? July 14–15, Hotel Nia. Real projects, proprietary research, no fluff.

50% off for listeners with code BEYONDTHEPILOT: https://bit.ly/4fK4F6z

Chapters:

00:00 Research data drop: eval gaps, zero-HITL targets, and hyperscaler security dependency