← The Cash Flow Contractor23 juil. · 55 min

302 - Private, Local AI: A Contractor's Guide to Open Source Models

302 - Private, Local AI: A Contractor's Guide to Open Source Models23 juil.55 min

Écouter sur SpotifyFonctionne aussi dans ton navigateur

11 autres apps

You want to put AI to work in your business, but every time you start, the same worry stops you: what happens to your data once it's in there? For a lot of contractors, that single fear is the only thing standing between them and real time savings. In this episode, Khalil and Martin break down the three real security risks with AI, why paying for a team account changes what happens to your data, and when a private, local model is actually worth it. They get into open-source models, HIPAA-sensitive work, tokens and API costs, and what an AI agent really is. If you've been holding off because you don't trust AI with your information, this is the conversation that shows you the way around it. Key Topics & Timestamps<ul><li>00:39 - Episode Intro</li><li>01:09 - Sunsetting GrowthKits</li><li>01:54 - Benali Goes AI</li><li>03:55 - HIPAA and Secure AI Needs</li><li>09:04 - Security Risks and Local Models</li><li>28:33 - Skip Fine-Tuning</li><li>28:59 - Local Models and Privacy</li><li>30:20 - Tokens and API Costs</li><li>34:35 - Open Source Model Trust</li><li>38:35 - Agents and Adoption</li></ul> Memorable Quotes<ul><li>"If it's free, you are the product." — Khalil</li><li>"If you're comfortable putting it into a paid Google Drive, you should be comfortable putting it into Claude." — Khalil</li><li>"A lot of roles will go away, but jobs will not go away." — Khalil</li><li>"We are doing it. It's not theoretical." — Martin</li><li>"Just get started, and then all of a sudden you start thinking more and more, and then you're in the game." — Martin</li></ul> Key Takeaways<ol><li>Stop using free AI tools for company work. Free versions train on everything you upload, and your employees are almost certainly doing it right now without a policy in place.</li><li>Move to paid team or organization accounts. On an org account, training on your data is off by default, which is the baseline protection most contractors actually need.</li><li>Write an AI policy and train your team on it. Treat unmanaged AI use like a phishing risk; one person uploading client data to a free account is all it takes.</li><li>For most contractors, a paid team account is enough. If you're comfortable putting a file in a paid Google Drive, you're safe putting it in Claud