EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making

Researchers introduced EVOKE, a post-training method that elicits pretrained world knowledge in LLM agents by holding environment state and interaction history fixed while ranking the same candidate actions under alternative goals, according to an arXiv paper (2609.38334v1). Evaluated across diverse tasks in three backbones, EVOKE improved task performance, generalization to unseen environments, and data efficiency. The work argues that typical post-training provides little pressure for world-knowledge elicitation because single-goal supervision drives policies toward superficial contextual habits.

arXiv:2609.38334v1 Announce Type: new Abstract: Large language models LLMs are increasingly deployed as agents for multi-step decision-making, yet transfer poorly to unseen environments. World-model methods address this by training agents to predict future observations, at the cost of additional training and errors that compound when predictions are used for planning. However, for LLM agents operating in digital environments, much of this world knowledge is already internalized during pretraining, which shifts the problem from acquiring it to eliciting it. We argue that typical post-training provides little pressure for such elicitation, since supervision under a single goal at each visited state inadvertently drives policies to rely on superficial contextual habits. We introduce EVOKE, a post-training method that supplies this pressure through goal diversity at fixed states. Motivated by theory showing that an agent competent across diverse goals must encode a world model recoverable from its action preferences, EVOKE holds the environment state and interaction history fixed and ranks the same candidate actions under alternative goals, forcing action preferences to change, so that a policy relying on contextual habits or single-goal correlations cannot order them correctly. This implicitly elicits the policy's pretrained world knowledge to inform decisions. We evaluate EVOKE across diverse tasks in three backbones, demonstrating improved task performance, unseen environment generalization, and data efficiency. We further conduct controlled analyses to better understand what drives these gains. These findings offer a new perspective on eliciting internalized world knowledge for transferable action through direct decision supervision.