18:57
2026-08-13
engineering.atspotify.com
artificial-intelligence
When Can LLMs Replace Humans in A/B Tests?
A new paper from researchers at an undisclosed institution finds that using OpenAI's gpt-4o-mini to predict click-through rates in A/B tests recovered only 39% of the observed human treatment effect i…