Why Context Still Tricks Big Language Models
Large language models exhibit hidden vulnerabilities to irrelevant context at the per-example level, despite appearing robust in aggregate. A new analysis reveals that even random gibberish can unpredictably boost or deg…