# Schrödinger's Code Repository: Have LLMs Learned SWE-bench or Memorized It? > Source: > Published: 2026-09-24 02:30:07+00:00 Repository-level coding benchmarks have become the standard for evaluating coding agents, yet they inherently suffer from data leakage because they are built upon popular open-source repositories repeatedly used for training. Consequently, strong performance may reflect memorization of canonical rep