cd /news/large-language-models/hermes-getting-so-good · home › topics › large-language-models › article
[ARTICLE · art-121591] src=discuss.huggingface.co ↗ pub= topic=large-language-models verified=true sentiment=↑ positive

Hermes getting so good

A Hugging Face forum user reported that the Hermes model, version V0.21, achieves 68 tokens per second on an older NVIDIA GeForce RTX 3090 GPU, with speeds occasionally reaching 84 tokens per second, and mentioned plans to upgrade to an NVIDIA DGX Spark next year. The post highlights the model's performance on consumer hardware, suggesting strong optimization for local inference.

read1 min views4 publishedSep 6, 2026
Hermes getting so good
Image: Discuss (auto-discovered)

Hugging Face Forums Hermes getting so good Beginners MartinPilarski September 4, 2026, 9:50pm 1 19480 1920×885 272 KB V0.21.. 19481 1920×885 345 KB My old 3090 68t/s … amazing 19483 1844×4000 1.2 MB MartinPilarski September 6, 2026, 9:24pm 2 goes up to 84 sometime, I already promised new body for my agent DGX spark in next year pipeline Related topics Topic Replies Views Activity Practical match for 128Gb Strix Halo with 2x3090s? (inference for coding) Beginners 4 891 May 21, 2026 How many tokens will an old 3090 produce? Beginners 1 190 August 26, 2026 Palit Gaming Pro 24GB OC 3090 + Palit X3060 8GB? is it worth bothering even? Beginners 1 107 August 26, 2026 How to add GB10 into NVIDIA hardware list in https://huggingface.co/settings/local-apps Site Feedback 2 217 January 27, 2026 Rtx 5090 35b nvfp4 🤗Transformers 3 210 July 18, 2026

source & further reading
discuss.huggingface.co — original article Rakarrack-0.6.1 port making progress! ( AI assisted ) Cloud Storage Poll Welcome to Haiku basic(Haiku Docs, Haiku slide and Haiku sheets)
── more in #large-language-models 4 stories · sorted by recency
── more on @hugging face 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/hermes-getting-so-go…] indexed:0 read:1min 2026-09-06 · —