cd /news/artificial-intelligence/worldbench-culturally-grounded-bench… · home topics artificial-intelligence article
[ARTICLE · art-118673] src=machinebrief.com ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

WorldBench: Culturally Grounded Benchmark for Multilingual Agents

Researchers introduced WorldBench, a multilingual benchmark of 1,600 persona-grounded everyday tasks across seven languages and eight cultures, finding that frontier models achieve only 49.2% Constrained Task Success (CTS), revealing brittleness in multilingual agentic scenarios. The benchmark, detailed in an arXiv paper (2609.01056v1), extends prior metrics with CTS to evaluate task completion and environment preservation, showing large gaps between correctness and state preservation across models.

read1 min views1 publishedSep 2, 2026

arXiv:2609.01056v1 Announce Type: new Abstract: Despite the growing use of LLM-powered agents to solve multi-step tasks in complex environments, existing benchmarks rarely test state preservation, performance across languages, and application to realistic, grounded scenarios. To address these concerns, we present WorldBench: a comprehensive, multilingual benchmark of genuine, persona-grounded everyday workflows, where agents can act in a sandbox via structured actions. WorldBench comprises 1,600 tasks across seven languages and eight cultures, filtered and refined through feedback from human annotators with language- and culture-specific expertise. For evaluation, we extend metrics from previous works and introduce Constrained Task Success (CTS), which combines natural language instructions and testbeds to score task completion, minimal modification, and other complementary metrics through deterministic and LLM-as-a-Judge evaluations. Our experiments show that frontier models reach only 49.2% CTS, with all models demonstrating large gaps between correctness and environment preservation. We thereby show that current agents remain brittle in multilingual, agentic scenarios, especially for long-horizon tasks and under state-preservation constraints

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @worldbench 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/worldbench-culturall…] indexed:0 read:1min 2026-09-02 ·