Why and When Neural Networks Improve Local Approximation in Optimization
A new arXiv study (2608.24963v1) shows that neural network surrogates improve derivative-free optimization only under three conditions—role, radius, and room—and that these factors, not training accuracy, determine succe…