← The Cash Flow Contractor23. Juli · 55 Min.

302 - Private, Local AI: A Contractor's Guide to Open Source Models

302 - Private, Local AI: A Contractor's Guide to Open Source Models23. Juli55 Min.

In Spotify hörenFunktioniert auch im Browser

5 weitere Apps

You want to put AI to work in your business, but every time you start, the same worry stops you: what happens to your data once it's in there? For a lot of contractors, that single fear is the only thing standing between them and real time savings. In this episode, Khalil and Martin break down the three real security risks with AI, why paying for a team account changes what happens to your data, and when a private, local model is actually worth it. They get into open-source models, HIPAA-sensitive work, tokens and API costs, and what an AI agent really is. If you've been holding off because you don't trust AI with your information, this is the conversation that shows you the way around it. Key Topics & Timestamps<ul><li>00:39 - Episode Intro</li><li>01:09 - Sunsetting GrowthKits</li><li>01:54 - Benali Goes AI</li><li>03:55 - HIPAA and Secure AI Needs</li><li>09:04 - Security Risks and Local Models</li><li>28:33 - Skip Fine-Tuning</li><li>28:59 - Local Models and Privacy</li><li>30:20 - Tokens and API Costs</li><li>34:35 - Open Source Model Trust</li><li>38:35 - Agents and Adoption</li></ul> Memorable Quotes<ul><li>"If it's free, you are the product." — Khalil</li><li>"If you're comfortable putting it into a paid Google Drive, you should be comfortable putting it into Claude." — Khalil</li><li>"A lot of roles will go away, but jobs will not go away." — Khalil</li><li>"We are doing it. It's not theoretical." — Martin</li><li>"Just get started, and then all of a sudden you start thinking more and more, and then you're in the game." — Martin</li></ul> Key Takeaways<ol><li>Stop using free AI tools for company work. Free versions train on everything you upload, and your employees are almost certainly doing it right now without a policy in place.</li><li>Move to paid team or organization accounts. On an org account, training on your data is off by default, which is the baseline protection most contractors actually need.</li><li>Write an AI policy and train your team on it. Treat unmanaged AI use like a phishing risk; one person uploading client data to a free account is all it takes.</li><li>For most contractors, a paid team account is enough. If you're comfortable putting a file in a paid Google Drive, you're safe putting it in Claude or ChatGPT.</li><li>Consider a private, local model when you handle HIPAA data, trade secrets, or heavy API costs. You can run an open-source model on a server you control with zero data retention.</li><li>Skip fine-tuning your own model. Almost no contractor has the thousands of past projects it takes to justify it, so focus on using AI well and building tooling around it instead.</li><li>Find the time and money to start now. Raising prices is usually the fastest way to fund it, and the efficiency gains pay it back.</li></ol> Resources<ul><li><a href="https://ollama.com" target="_blank" rel="noopener noreferer">Ollama</a></li><li><a href="https://www.quo.com" target="_blank" rel="noopener noreferer">Quo</a></li></ul><ul><li>Need help with podcast production? We recommend <a href="https://www.demandcast.co" target="_blank" rel="noopener noreferer">Demandcast</a></li></ul> More from Martin<ul><li><a href="http://theprofitproblem.com" target="_blank" rel="noopener noreferer">theprofitproblem.com</a></li><li><a href="http://annealbc.com" target="_blank" rel="noopener noreferer">annealbc.com</a></li><li><a href="martin@annealbc.com" target="_blank" rel="noopener noreferer">Email Martin</a></li><li><a href="https://resources.annealbc.com/meetings/martin94/free-consultation?uuid=58b9653c-3843-471a-971d-0075f91d6bf4" target="_blank" rel="noopener noreferer">Meet With Martin</a></li><li><a href="https://www.linkedi