enwik8

Researchers at arXiv introduced the first Diffusion Language Model (DLM)-based framework for lossless text compression, achieving state-of-the-art results on the enwik8 benchmark. The new approach ove…

Support Vector Attention (SV-Attention), a new approach to memory in machine learning, achieves certified token deletion with a rare-item recall of 0.86 compared to 0.32 for other methods, according t…

Researchers introduced Hankel Reduced order Model (HRM) adapters, a state space model-based fine-tuning method that outperforms LoRA on long-context tasks like QuALITY and QMSum by leveraging FFT-base…