Hey. Just today i’ve managed to hear about this. I did watch the video covering it from the man himself, however my interest with AI at the moment is only theoretical, so i didn’t try it myself.
I’ve heard it’s like a local Claw or ChatGPT + Claude but better and privacy-friendly.
Those in the know and who tried it, what are your opinions?
Just pointing out that like all local AI models, you’ll likely be limited by your hardware. Pewdiepie spent a fortune to build his AI capable “home” server.
eteszi 3 This is not a local AI model, it’s a local interface for an AI. Overall, it looks good.
If you want to play with local AI and you have a beefy PC or Laptop, get “LM Studio” or “Ollama”. I’m using Ollama Server on a home server myself. Server hardware is expensive, if you want anything useful. So I recommend to start learning by doing before buying.
For Models: I liked “Ministral-3-8b/14b”, “Mistral-Small-3.1/24b”, “Gemma-4-26b”, “Qwen3.6-27b” best, so far.
For a starting out on your own PC/Laptop: “Ministral-3-8b” and “Gemma-4-4b” deliver a good experience.
If you have an existing PC maybe buy an NVIDIA T4 and use it for the LLM.
With RTX30/40/50 GPUs I had not a really great experience.
Good local LLMs are coming. You won’t need 96 GB of RAM and killer GPU anymore in maybe a year or two.