I’ve been fielding various inquiries from friends and family about LLM tools, what they do and how to run them locally.
The realities of set up, onboarding and education have generally been too high a barrier for any of them to really get into it fully.
But today- with the introduction of Intel’s “AI Playground” suite, I’ve got both my brother and my buddy/euchre partner running inference and stable diffusion after maybe 20 minutes of setup.
Intel cooked with this one. It’s gonna bring local LLM tools to a lot more people.
It’s also working awesome on my Arc B50 and the CUDA version on my 5090 is holding its own.