Service Design Show

← Service Design Show30 juil. · 1 h 13 min

Why Mindless AI Is the Real Danger / Ovetta Sampson / Episode #259

Why Mindless AI Is the Real Danger / Ovetta Sampson / Episode #25930 juil.1 h 13 min

<p>Are you tired of the relentless AI marketing hype but know you can&#39;t afford to ignore it? Discover how to stop blindly applying AI and start mastering it as a malleable &quot;design material&quot; to build impactful, user-centered services .</p><p>It’s time to stop buying into the stories big tech companies want us to believe about what Artificial Intelligence can and can’t do. Slapping AI mindlessly onto every project doesn&#39;t just create bad user experiences. It can do real harm.</p><p>To set a better example for the service design industry, host Marc sits down with Ovetta Sampson. With a resume that includes Director of UX for Machine Learning at Google and AI design leadership roles at Microsoft and Capital One, Ovetta doesn&#39;t just talk theory. She runs Right AI to help teams adopt AI safely, responsibly, and effectively. In this conversation, she breaks down exactly how to understand AI&#39;s unique properties, navigate its limitations, and mold it into exactly what you need.</p><p>In This Episode:</p><ul><li>The Design Material Mindset: How to stop fearing AI and start shaping it like clay to get the outcomes you want.</li><li>Steering the Machine: Practical techniques for guiding generic LLMs to reliably produce high-quality, specific results.</li><li>The Context Crisis: Why understanding your users&#39; real-world context is about to become more important than ever before.</li><li>When &quot;Wrong&quot; Becomes Dangerous: Why AI will always make mistakes, and how to identify the exact point where those errors become harmful.</li><li>Breaking the Model: Why you need to start &quot;messing around&quot; and intentionally trying to break AI tools to build your own grounded mastery.</li></ul><p><br></p><p>If you found value in this episode, please hit the Subscribe button on YouTube, Spotify, or Apple Podcasts so you never miss a conversation. Share this episode with a fellow service designer who needs to hear this!</p><p>As always, enjoy, and keep making a positive impact!</p><p>~ Marc</p><p><br></p><p>[ 1. GUIDE ]</p><p>00:00 Intro and AI Sycophancy </p><p>03:15 Mindless vs. Mindful AI </p><p>06:45 Dangers of Automation Bias </p><p>10:00 The Humanizing Trap </p><p>17:45 Design as a Verb </p><p>24:30 Emergent AI Behavior </p><p>27:30 AI Confidence Levels </p><p>36:15 The Illusion of AI Memory </p><p>39:00 Principle 1 of Mindful AI </p><p>43:30 Library vs. Netflix Analogy </p><p>49:45 Designing for Failure </p><p>55:15 The Socio-Technical