Xiaomi released MiMo-V2.6-Pro on September 22, 2026, with full open weights on Hugging Face under an MIT license, scoring 46 on Artificial Analysis' Intelligence Index v4.3.2 — the highest score ever …
Shrijith Venkatramana, an engineer building the LiveReview AI code review tool, published a technical explainer on LLM quantization showing that activation outliers concentrated in a handful of featur…
The Allen Institute for AI (Ai2) released a family of Open Coding Agents built with a method called SERA that lets researchers finetune a 32B model on a private codebase in just a couple of GPU days, …
Tim Dettmers et al. in their 2022 LLM.int8() paper found that large outlier features emerge across all transformer layers as models scale, causing naive INT8 quantization to break down. They introduce…
A developer details practical QLoRA fine-tuning using Axolotl and Unsloth, explaining how parameter-efficient methods like LoRA and QLoRA enable training multi-billion parameter models on a single con…
The author quit their FAANG job in 2024 to become an independent researcher and built a $48K GPU server called "grumbl" with six RTX 6000 Ada GPUs. They chose these GPUs over A100s and H100s based on …