Local AI on Unraid - The Stuff Nobody Tells You

<p>Local AI on your Unraid server isn&#39;t just chatbots, it&#39;s image generation, music, voice cloning, photo recognition, automatic transcription, and so much more, all running on hardware you already own. But where do you even start? </p><p>In this video I walk through the whole landscape of local AI for Unraid users. What it actually is, the two completely different types you can run, and what hardware you really need to get going. This isn&#39;t a setup guide. Think of it as your mental map of local AI, so when you do start installing things, you&#39;ll actually understand what you&#39;re doing and why.</p><p>We cover generative vs predictive AI, the three reasons people run AI locally (privacy, cost, control), real working examples on my own server, and a full walkthrough of the hardware tiers from CPU to high-end GPU, including which card I&#39;d actually recommend you buy first and why.</p><p><br></p><p><strong>Key Links</strong></p><p>🔗 <a href="https://frigate.video" target="_blank" rel="noopener noreferer">Frigate</a> (open source NVR with AI object detection).</p><p>🔗 <a href="https://demo.frigate.video" target="_blank" rel="ugc noopener noreferrer">Frigate live demo</a>.</p><p>🔗 <a href=" ⁠https://speaches.ai" target="_blank" rel="ugc noopener noreferrer">Speaches</a> (Whisper + Kokoro container).</p><p>🔗 <a href="https://ollama.com" target="_blank" rel="ugc noopener noreferrer">Ollama</a>.</p><p>🔗 <a href="⁠https://openwebui.com" target="_blank" rel="ugc noopener noreferrer">Open WebUI</a>.</p><p>🔗 <a href="https://github.com/Comfy-Org/ComfyUI" target="_blank" rel="ugc noopener noreferrer">ComfyUI</a>.</p><p><br></p><p>▶️ Related videos on the channel.</p><p>🔗 <a href="https://www.youtube.com/watch?v=_82_Z-R5dFQ" target="_blank" rel="ugc noopener noreferrer">A-Eye</a> (local photo renaming with AI).</p><p>🔗 <a href="https://www.youtube.com/watch?v=Kv2oBjA-61A" target="_blank" rel="ugc noopener noreferrer">Paperless AI</a> (auto-tagging your documents).</p><p><br></p><p>💬 Want me to make a follow-up video benchmarking all of those GPUs with proper AI benchmark software? Drop a comment below and let me know.</p><p><br></p><p><strong>Hardware Recs</strong></p><p><a href="https://amzn.to/4tMBlzV" target="_blank" rel="ugc noopener noreferrer">USB Edge TPU ML Accelerator</a>.</p><p><a href="https://amzn.to/3PwVuM8" target="_blank" rel="ugc noopener noreferrer">NVIDIA RTX 3060 12GB</a>.<a href=" https://amzn.to/3RizUvG" target="_blank" rel="ugc noopener noreferrer">NVIDIA RTX 5070</a>.</p><p><br></p><p>⏱️ <strong>Timestamps</strong></p><p><strong></strong><a href="https://www.youtube.com/watch?v=i6peeTVX_vg" target="_blank" rel="ugc noopener noreferrer">0:00</a> - Cold open: what local AI can actually do</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=133s" target="_blank" rel="ugc noopener noreferrer">2:13</a> - Welcome and what this video is (and isn&#39;t)</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=140s" target="_blank" rel="ugc noopener noreferrer">2:20</a> - Everything you just saw was generated locally</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=153s" target="_blank" rel="ugc noopener noreferrer">2:33</a> - What is local AI? Privacy, cost, control</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=180s" target="_blank" rel="ugc noopener noreferrer">3:00</a> - Generative vs predictive AI explained</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=205s" target="_blank" rel="ugc noopener noreferrer">3:25</a> - Frigate demo (predictive AI in action)</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=302s" target="_blank" rel="ugc noopener noreferrer">5:02</a> - The Google Coral and edge AI</p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=322s" target="_blank" rel="ugc noopener noreferrer">5:22</a> - Quick tip: USB Coral vs PCIe Coral </p><p><a href="https://www.youtube.com/watch?v=i6peeTVX_vg&t=350s" target="_blank"