Effectively Does a Model Use Its Memory (2025)
Researchers introduced Effective State-Size (ESS), a proxy metric for memory utilization in deep learning sequence models, in a paper accepted at ICML 2025. The work shows that any equivalent recurrence must materialize …