cd /news/artificial-intelligence/show-hn-single-file-gguf-inference · home › topics › artificial-intelligence › article
[ARTICLE · art-119851] src=wasm-gguf.netlify.app ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Show HN: Single-File GGUF Inference

A developer released a single-file GGUF inference engine, tested with the Qwen2.5-Coder-0.5B-Instruct-Q3_K_L.gguf model (369 MB), enabling local inference from a single file.

read1 min views10 publishedSep 3, 2026

Tested on:

  Qwen2.5-Coder-0.5B-Instruct-Q3_K_L.gguf (369 MB)

Select a Qwen2.5 GGUF model file to start inference...

Engine Console

source & further reading
wasm-gguf.netlify.app — original article
── more in #artificial-intelligence 4 stories · sorted by recency
── more on @qwen2.5-coder-0.5b-instruct 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/show-hn-single-file-…] indexed:0 read:1min 2026-09-03 · —