WideNDepth

A researcher has introduced WideNDepth (WND), a neural architecture that separates knowledge storage from iterative reasoning, and reports that a ~100K parameter WND model outperforms a ~600K Transfor…