07:17
2026-08-21
dev.to
machine-learning
Your compiled DSPy program re-sends up to 20 few-shot demos on every single call
A developer found that DSPy's compiled programs re-send up to 20 few-shot demonstrations on every inference call, adding significant token overhead that is invisible in the source code. The default op…