BLiMP

Researchers introduced Pollux, a new class of decoder-only LLMs that use native Leech-lattice quantization to achieve 0.76 bits per parameter, compressing a 1B-class model into 76 MB of SRAM. The mode…

Researchers testing GPT-2 style models on 'impossible' languages found that while the models showed gradual decline in grammatical sensitivity, they struggled significantly with generative production,…

Researchers at arXiv trained GPT-2 models on 'impossible' languages and found that while grammatical sensitivity degrades gradually, generative production fails significantly, suggesting transmission …