cd /news/large-language-models/problems-with-local-llms · home › topics › large-language-models › article
[ARTICLE · art-144609] src=dotnetperls.com ↗ pub= topic=large-language-models verified=true sentiment=· neutral

Problems with Local LLMs

A developer's comparison found that generating complicated Rust functions on a local LLM took 30 to 60 minutes of 100% CPU and 100% GPU usage at an estimated electricity cost of $0.02 to $0.04, while the same generations on OpenRouter with Gemini 3.8 Flash, GLM 5.3 Flash, or Claude Sonnet 5.5 cost about the same and usually finished within 2 minutes. The author concludes cloud-based AI is faster, cheaper, and higher quality for code generation, at the cost of data privacy and possible model refusals.

key takeaway

Local generation of complicated Rust functions consumed 30-60 minutes of full CPU and GPU load at $0.02-$0.04 in electricity, roughly matching OpenRouter's price for Gemini 3.8 Flash, GLM 5.3 Flash, or Claude Sonnet 5.5 but finishing in about 2 minutes instead.

read1 min views17 publishedOct 3, 2026

I am optimistic about the potential of running large language models on local systems. Local LLMs have many benefits, and I run them frequently, mostly for chat or information lookups.

But for more complex or difficult tasks, like generating complicated Rust functions, I feel that cloud-based LLMs are a better deal. In trying to generate code on my local PC, I was successful but it took up to 30 minutes or an hour of 100% CPU and 100% GPU work.

I estimated my cost in electricity and it came out to about $0.02 to $0.04 for the generations. This might make sense in some cases, but running the same generations on OpenRouter with a modern Flash model (Gemini 3.8 Flash, GLM 5.3 Flash, Claude Sonnet 5.5) is about the same price, and usually finishes within 2 minutes.

So cloud-based AI is both faster, cheaper, and also higher quality (based on a larger model). It does mean that your data is no longer "private" and if you are doing something questionable a model might refuse to generate text. There are drawbacks with both local and cloud, but often cloud is a better deal for code generation.

── more in #large-language-models 4 stories · sorted by recency
── more on @openrouter 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/problems-with-local-…] indexed:0 read:1min 2026-10-03 · —