arXiv:2610.06952v1 Announce Type: new Abstract: Neural PDE solvers can achieve low prediction errors, but do they reproduce the dynamics of the systems they model? Prediction scores alone offer an incomplete answer: they measure agreement with reference solutions but provide limited insight into how errors accumulate, nearby states diverge, or extreme events arise. We propose an evaluation framework that directly examines these behaviors in deterministic and stochastic neural solvers. By evolving ensembles of nearby initial states and comparing them with direct numerical simulation, we assess three complementary aspects of learned dynamics: error formation, ensemble geometry, and extreme events. Experiments on two-dimensional Kolmogorov flow reveal limitations that conventional scores can obscure. Smaller trajectory errors can reflect weaker error amplification despite less accurate local updates. Models can match an ensemble's overall spread and effective dimension while failing to capture the spatial directions where nearby states diverge. Similarly, matching overall event frequencies can conceal failures to predict persistent extreme events. These findings show that improved prediction accuracy does not necessarily imply greater dynamical fidelity. Our framework makes this distinction measurable, providing concrete criteria for evaluating whether advances in neural PDE solvers better capture the underlying dynamics.
Do Neural PDE Solvers Learn the Right Dynamics?
A new arXiv paper (2610.06952v1) proposes an evaluation framework showing that neural PDE solvers with low prediction errors can still fail to reproduce the underlying dynamics of the systems they model. Testing on two-dimensional Kolmogorov flow, the authors found that smaller trajectory errors can reflect weaker error amplification despite less accurate local updates, and that models can match an ensemble's overall spread and effective dimension while missing the spatial directions where nearby states diverge. The framework assesses error formation, ensemble geometry, and extreme events, offering concrete criteria for judging whether advances in neural PDE solvers better capture underlying dynamics.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.