cd /news/ai-research/ascendgym-a-cost-aware-kernel-optimi… · home › topics › ai-research › article
[ARTICLE · art-170294] src=arxiv.org ↗ pub= topic=ai-research verified=true sentiment=· neutral

AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUs

Researchers released AscendGYM, a benchmark for evaluating how well AI models and agents optimize existing kernels on Ascend NPUs, with an initial suite of 48 kernels across three difficulty levels. AscendGYM pairs each kernel with test cases whose data types and tensor shapes come from real-world training and inference tasks, supports model and model-harness evaluation modes, and introduces the Speedup-Token Score (STS) metric to measure performance gains relative to token cost. The benchmark is available at https://github.com/SLAI-AITP/AscendGYM.

read1 min views1 publishedNov 16, 2026

arXiv:2611.17621v1 Announce Type: new Abstract: Kernel optimization is essential for efficient large language model (LLM) training and inference on Ascend NPUs. Existing Ascend kernel benchmarks primarily focus on kernel generation, with less emphasis on the ability of agents to optimize existing implementations under input configurations drawn from real workloads. To address this requirement, we introduce AscendGYM, a benchmark whose initial suite comprises 48 kernels across three difficulty levels. Each kernel is paired with test cases whose data types and tensor shapes are collected from real-world training and inference tasks. Consequently, performance improvements on AscendGYM map directly to the corresponding workloads. In terms of usability, two evaluation modes are supported in AscendGYM: model evaluation and model-harness evaluation. The kernel optimization capabilities of both trained models and custom agents are allowed to be measured. It provides a complete execution environment that closely reproduces how Ascend kernels are invoked in practical pipelines. For model evaluation, it additionally includes a built-in harness equipped with search orchestration and experience accumulation. Finally, we propose a new metric, the Speedup-Token Score (STS), which quantifies performance gains relative to token cost. By jointly considering speedup and cost, STS enables the assessment of practical kernel optimization capability of a model or harness under an acceptable budget. AscendGYM is available at https://github.com/SLAI-AITP/AscendGYM.

── more in #ai-research 4 stories · sorted by recency
── more on @ascendgym 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/ascendgym-a-cost-awa…] indexed:0 read:1min 2026-11-16 · —