04:00
2026-08-26
arxiv.org
machine-learning
Every Layer Counts: An Exponential $L_2$ Depth Hierarchy for ReLU Networks
A new proof establishes an exponential depth hierarchy for ReLU neural networks, showing that each additional ReLU layer can save exponentially many neurons. For every ℓ ≥ 3, a globally [0,1]-valued, …