Pythia-410M

EleutherAI's Pythia-410M model, trained on The Pile corpus, shows that neural network knowledge forms through gradual accretion rather than sudden ignition, with Paris reaching 15% probability as capi…

An independent researcher tested four widely used quantization saliency metrics (AWQ, GPTQ, OWQ, SpQR) by directly perturbing weight channels in small LLMs and measuring real damage. The study found t…