Sakana AI’s Error Diffusion Trains Dale-Compliant Dual-Stream Networks, Reaching 96.7% MNIST and 61.7% CIFAR-10 Without Backpropagation

Sakana AI developed Error Diffusion, a training method that adheres to Dale's principle and avoids backpropagation's weight transport requirement, achieving 96.7% accuracy on MNIST and 61.7% on CIFAR-10 using dual-stream excitatory/inhibitory networks. The approach scales to reinforcement learning and reveals task-dependent ablation effects, offering a biologically plausible alternative for neural network training.

Backpropagation relies on weight transport, which biological circuits likely cannot implement. Sakana AI's Error Diffusion sidesteps that constraint, training dual-stream excitatory/inhibitory networks that obey Dale's principle. This piece breaks down how modulo error routing scales the rule from MNIST to CIFAR-10 and reinforcement learning, and what its task-dependent ablations reveal. The post Sakana AI’s Error Diffusion Trains Dale-Compliant Dual-Stream Networks, Reaching 96.7% MNIST and 61.7% CIFAR-10 Without Backpropagation https://www.marktechpost.com/2026/07/17/sakana-ais-error-diffusion-trains-dale-compliant-dual-stream-networks-reaching-96-7-mnist-and-61-7-cifar-10-without-backpropagation/ appeared first on MarkTechPost https://www.marktechpost.com .