BitsAndBytes

mentions 2 type Organization feed RSS

// recent coverage 2 mentions

18:30

2026-07-15

hello-fri-end.github.io

machine-learning

Early Breakthroughs in Transformer Quantization

Tim Dettmers et al. in their 2022 LLM.int8() paper found that large outlier features emerge across all transformer layers as models scale, causing naive INT8 quantization to break down. They introduce…

07:14

2026-05-20

dev.to

large-language-models

I Thought Fine-Tuning LLMs Needed Expensive GPUs. I Was Wrong.

The author successfully fine-tuned a 1.1 billion parameter TinyLlama model using QLoRA on consumer hardware, training only 0.2% of the model's parameters via low-rank adapter matrices. The project inv…

// co-occurs with top 8 entities

Tim Dettmers 1 LLM.int8() 1 TinyLlama 1 QLoRA 1 PEFT 1 TRL 1 Hugging Face 1 FastAPI 1

// topics top 6 topics

machine learning 2 large language models 2 ai research 1 artificial intelligence 1 open source 1 developer tools 1