CONNECT WITH US
Web3 & Blockchain

Web3 & Blockchain

AscendGYM: Benchmarking Kernel Optimization on Ascend NPUs

Blockchain.News logo

Published on

Add as a preferred source on Google
AscendGYM: Benchmarking Kernel Optimization on Ascend NPUs

AscendGYM introduces a cost-aware benchmark for kernel optimization on Ascend NPUs, featuring real-world workloads, STS metric, and open-source tools.

The AI Training Platform Team, led by Bingwei Zhang, Jing Li, Amir Abdullin, and others, has introduced AscendGYM, a new benchmark designed to evaluate kernel optimization capabilities on Ascend NPUs. Published on arXiv on November 18, 2026, the project aims to address gaps in existing benchmarks by focusing on real-world workloads and cost-aware performance metrics.

AscendGYM provides a suite of 48 kernels categorized into three difficulty levels. These kernels are paired with test cases derived from real-world training and inference tasks, ensuring that performance improvements directly translate to practical applications. The benchmark supports two evaluation modes: model evaluation and model-harness evaluation. Both modes allow for the assessment of trained models and custom agents within a complete execution environment that closely replicates real-world Ascend kernel pipelines.

A notable innovation is the introduction of the Speedup-Token Score (STS), a metric that balances performance speedup against token cost. This enables users to evaluate kernel optimization capabilities under predefined budget constraints, making the benchmark particularly relevant for cost-sensitive AI deployments.

The AscendGYM project is open-source and hosted on GitHub at https://github.com/SLAI-AITP/AscendGYM. The repository includes task definitions, evaluation tools, and documentation to facilitate adoption. Users can prepare tasks, conduct correctness tests, measure performance, and analyze results through a unified interface. The execution environment supports both official AscendForge images and self-hosted services, ensuring flexibility for diverse user needs.

Additionally, an interactive leaderboard allows participants to compare results across models, harnesses, and operators.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.