A developer released a PyTorch implementation of the Kimi K3 architecture from the arXiv paper 'Kimi K3: Open Frontier Intelligence' (arXiv:2607.24653v1), reproducing the paper's Table 1 parameter cou…
Kimi K3, a 2.8-trillion-parameter open-weight model from Moonshot AI, is the largest open-weight model to date, scaling up their earlier Kimi Linear architecture from 48B parameters. The architecture …
NVIDIA released Nemotron 3 Super, a 120-billion-parameter hybrid model that scores 60.47% on SWE-Bench Verified, beating GPT-OSS-120B by nearly 20 points while delivering 2.2 times the inference throu…
NVIDIA released Nemotron 3 Ultra, a 550B-parameter hybrid Mamba-Transformer model with 55B active parameters, achieving up to 6x higher inference throughput than state-of-the-art LLMs while maintainin…