Linear probes tell you where quantization will hurt
A Northeastern University researcher found that linear probes can identify which layers of a transformer model are critical for a task, enabling selective quantization that preserves 99–100% of full-precision accuracy at…