cd /news/machine-learning/hugging-face-trl-fix-halves-a-qwen3-… · home › topics › machine-learning › article
[ARTICLE · art-169436] src=runtimewire.com ↗ pub= topic=machine-learning verified=true sentiment=↑ positive

Hugging Face TRL fix halves a Qwen3 H100 step in SDPA test

Hugging Face merged a TRL fix on November 13th, 2026 that keeps best-fit-decreasing packed examples as separate batch rows for standard attention models instead of flattening each packed batch into one long row by default. Contributor tests reported an H100 SDPA training step for Qwen3 falling from 2.06 to 1.02 seconds, and on AWS Trainium2 the revised code produced step timings where the previous path crashed.

read1 min views1 publishedNov 14, 2026
Hugging Face TRL fix halves a Qwen3 H100 step in SDPA test
Image: Runtimewire (auto-discovered)

Hugging Face contributor tests report an H100 SDPA step falling from 2.06 to 1.02 seconds; on Trainium2, the revised code produced step timings where the previous path crashed.

        By [RuntimeWire Staff](https://runtimewire.com/author/runtimewire-staff)
        · Published 

Hugging Face, the open-source AI company co-founded by Clement Delangue, Julien Chaumond and Thomas Wolf, merged a TRL fix on November 13th, 2026 that halves a reported Qwen3 training step on an H100 and produced step timings on AWS Trainium2 where the previous layout crashed. The merged pull request keeps best-fit-decreasing packed examples as separate batch rows for standard attention models, instead of flattening each packed batch into one long row by default.…

── more in #machine-learning 4 stories · sorted by recency
── more on @hugging face 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/hugging-face-trl-fix…] indexed:0 read:1min 2026-11-14 · —