Hi there, I’m fairly new to ML, Ai and honestly computer science as a whole, but I’ve been really interested in learning more about how this stuff all works, and have been trying to get a small model to run on my 8GB M2 laptop, with medium success
I’ve seen a lot of talk about the Qwen3.8-27B and how its a very powerful model that can be run on comparatively small machines.
Mostly what I’m asking is that I’d like to set up some sort of Agentic AI on my laptop that can help with programming, and I’m not sure what model to pick, whether to run it locally, pay for it to be run on the cloud, find somewhere free to run it on the cloud, etc.
Is it likely that good models that are worth using are going to be able to be run on less powerful computers like mine in the near future?
Any help appreciated, mostly just kind of curious!
Thanks