Tim Dettmers

Tim Dettmers et al. in their 2022 LLM.int8() paper found that large outlier features emerge across all transformer layers as models scale, causing naive INT8 quantization to break down. They introduce…

A developer details practical QLoRA fine-tuning using Axolotl and Unsloth, explaining how parameter-efficient methods like LoRA and QLoRA enable training multi-billion parameter models on a single con…

The author quit their FAANG job in 2024 to become an independent researcher and built a $48K GPU server called "grumbl" with six RTX 6000 Ada GPUs. They chose these GPUs over A100s and H100s based on …