Inside the AI Stack of an $8.3B AI Company’s Product Team | Together AI

Today’s Episode

90% of teams have adopted AI, yet 56% of CEOs say they saw no major financial benefit. Both metrics are accurate, and I’m pretty sure you fall somewhere between them.

With new AI tools flooding the market every week, it is safe to say that every team has its own AI setup by now. But are any of those setups in sync with each other?

I’ve been building this argument in stages. First, Carl Vellotti showed you how to build a personal OS, and Hannah layered it with building a team OS. Jiaona and Mikhail vouch for a full-blown company OS as well.

So, today you get a screen share.

My guests are the product team at Together AI that raised $800M at an $8.3B valuation and sells inference and fine-tuning to developers. Charles Zedlewski is their CPO who brought Necoline, Pavneet, and Hassan on the call to talk about how to build a shared context repo.

Their customers are already agents and their engineers are already agent-first. Their product team had no choice but to catch up.

Brought to you by

Arize - Ship AI agents and features faster with fewer regressions.

Get a full year of Arize, Bolt.new, Airtable, Speechify, Descript, Magic Patterns, Linear, Dovetail and Mobbin at bundle.aakashg.com.

10 Key takeaways

1. Individual productivity can move a company backwards - The team's starting question was not how to make each person faster. It was whether everyone generating unlimited code and content actually added up to progress. Charles called the failure mode flooding your coworkers' context windows, where everyone launches slop at each other.