Sakana (auto-discovered)

Sakana AI has formally established the Recursive Self-Improvement (RSI) Lab, a dedicated research group tasked with developing autonomous AI systems that can improve themselves through continuous, evo…

Researchers have developed DiffusionBlocks, a method that trains neural networks by dividing them into blocks and training only one block at a time, reducing memory requirements to roughly 1/B of stan…

Researchers from NVIDIA have developed a new sparse data format and custom GPU kernels, called TwELL, that reshape unstructured sparsity in transformer language models to align with GPU architecture, …