117. Multi-Terabyte GPUs the Only Answer for AI Scaling

<p>Are multi-terabyte GPUs and massive frontier models really the answer to enterprise AI, or are we hitting a hard wall of soaring memory costs and power constraints? </p><p>In this episode of the Tech Field Day Podcast, host Alastair Cooke sits down with technical experts Ron Pagani Jr., Andy Banta, and Brian Martin to examine whether brute-force hardware scaling remains sustainable. </p><p>The panel debates scale-up vs. scale-out architectures, emphasizing how smart software optimizations—such as persistent KV caching (MinIO MemKV, Solidigm) and intelligent data layers (CTERA)—can eliminate redundant GPU computation and lower costs. </p><p>They also explore agentic microservices, power and cooling bottlenecks, and why right-sizing AI models for production is critical for achieving real-world enterprise ROI.</p><p>Panelists: </p><p><a href="https://techfieldday.com/people/andy-banta/ " target="_blank" rel="noopener noreferer">Andy Banta</a>, Consultant </p><p><a href="https://techfieldday.com/people/brian-martin/" target="_blank" rel="noopener noreferer">Brian Martin</a>, AI and Data Center Lead at Signal65</p><p><a href="https://techfieldday.com/people/ron-pagani-jr/ ">Ron Pagani Jr.⁠</a>, Founder of Open Technology Partners</p><p>Hosts:</p><p><a href="https://techfieldday.com/people/tom-hollingsworth/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tom Hollingsworth⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, Event Lead for Tech Field Day</p><p><a href="https://techfieldday.com/people/alastair-cooke/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Alastair Cooke⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, Event Lead at Tech Field Day</p><p><a href="https://techfieldday.com/people/stephen-foskett/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Stephen Foskett⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, President and Organizer of <a href="https://techfieldday.com/event/aifd7/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tech Field Day⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a></p><p>Follow the Tech Field Day Podcast <a href="https://x.com/TechFieldDayPod">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on X/Twitter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a> or <a href="https://bsky.app/profile/techfielddaypod.bsky.social">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a> and use the Hashtag #TFDPodcast to join the discussion. Listen to more episodes <a href="https://techfieldday.com/podcast">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on the podcast page of the website⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>.</p><p>Follow <a href="https://techfieldday.com/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Tech Field Day⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a> for more information on upcoming and current event coverage <a href="https://x.com/techfieldday/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on X/Twitter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, <a href="https://bsky.app/profile/techfieldday.com">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, and <a href="https://www.linkedin.com/company/tech-field-day">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠on LinkedIn⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>, or <a href="https://techfieldday.com/">⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠visit our website⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠</a>. </p>