Landauer

A new open-source PyTorch optimizer, the Riemannian Thermodynamic Optimizer, outperforms Adam on non-linear benchmarks by treating loss landscapes as physical topologies with Landauer dissipation and …

Researchers introduced Pollux, a new class of decoder-only LLMs that use native Leech-lattice quantization to achieve 0.76 bits per parameter, compressing a 1B-class model into 76 MB of SRAM. The mode…