A new benchmark called ExplorationBench measures how well AI systems explore in verifiable alien worlds, according to the benchmark's authors, who frame scientific discovery as beginning where known problems end. The authors state that evaluating exploration is difficult for two reasons: verifying whether a genuinely new hypothesis holds, and deterring (the source text is truncated at this point).
Scientific discovery begins where known problems end. There, AI systems must engage in exploration: framing hypotheses, designing experiments, and iterating on the results. However, evaluating this ability is difficult: (1) how to verify whether a genuinely new hypothesis holds, and (2) how to deter
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.