cd /news/artificial-intelligence/position-not-provenance-separating-r… · home topics artificial-intelligence article
[ARTICLE · art-81322] src=arxiv.org ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Position, Not Provenance: Separating Reasoning Mediation from Sycophancy in Medical Vision-Language Models

A new study from arXiv (2607.27304v1) introduces CoT-Mediate, a behavioral framework to test whether medical vision-language models (VLMs) causally use their generated chain-of-thought reasoning. Evaluating LLaVA-Med and MedGemma on 1,000 VQA-RAD samples each, the study finds that prefix-forced continuation yields higher mediation faithfulness than re-prompting, and that contextual position, not stated provenance, primarily determines whether models follow their reasoning.

read1 min views1 publishedJul 31, 2026

arXiv:2607.27304v1 Announce Type: new Abstract: Medical vision-language models (VLMs) generate chain-of-thought (CoT) reasoning before answering clinical questions, but whether this reasoning causally influences predictions remains unclear. We present CoT-Mediate, a behavioral framework that perturbs a single clinically meaningful attribute within a model's own generated reasoning and measures whether the resulting prediction follows the edited reasoning. Our framework combines a dual-arm protocol comparing re-prompted evidence with prefix-forced continuation, together with a provenance-controlled intervention that varies only the attributed source of identical reasoning to disentangle reasoning mediation from sycophancy. We evaluate LLaVA-Med and MedGemma on 1,000 VQA-RAD samples each. Prefix-forced continuation consistently yields higher mediation faithfulness than re-prompting, while the provenance analysis reveals distinct model-specific deference behaviors. Across both models, removing visual evidence increases reliance on injected reasoning, whereas laterality is the least faithfully tracked clinical attribute. These results show that the mechanism used to inject reasoning substantially affects measured faithfulness and that contextual position, rather than stated provenance, is the primary determinant of whether medical VLMs use their generated reasoning.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @arxiv 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/position-not-provena…] indexed:0 read:1min 2026-07-31 ·