{"slug": "autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded", "title": "AutoSupervision: Closing the Feedback Loop in Scientific Workflows with Grounded Revision Verification", "summary": "Researchers introduced AutoSupervision, a framework that evaluates whether scientific manuscript revisions address reviewer feedback using grounded evidence, built from 56,000 Nature Communications articles and their review records. Experiments show that while LLMs like GPT-5.5 score 0.754 in characterizing reviewer concerns, evidence-based verification remains a bottleneck, with the best model reaching only 0.501.", "body_md": "arXiv:2607.27845v1 Announce Type: new\nAbstract: Recent advances in large language models (LLMs) have enabled AI systems to assist scientific research and peer review. However, an essential capability for reliable AI-assisted scientific workflows remains underexplored: verifying whether reviewer feedback leads to meaningful and evidence-supported manuscript improvements. We introduce AutoSupervision, which evaluates whether scientific manuscript revisions genuinely address reviewer concerns through grounded evidence. AutoSupervision leverages transparent peer-review records as a natural source of supervision, where reviewer comments specify scientific concerns, author responses describe claimed resolutions, and revised manuscripts provide evidence of changes. Given reviewer comments, author responses, and revised manuscripts, models must characterize reviewer concerns, determine whether concerns have been addressed, and identify supporting manuscript evidence. We construct AutoSupervision from 56,000 Nature Communications articles and corresponding review records. Then we conducted experiments on LLMs, the ablation study, and the case study. Our results show that while LLMs perform well in characterizing reviewer concerns, with GPT-5.5 achieving a score of 0.754, evidence-based verification remains the primary bottleneck, with the best-performing model reaching only 0.501.", "url": "https://wpnews.pro/news/autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded", "canonical_source": "https://www.machinebrief.com/news/autosupervision-closing-the-feedback-loop-in-scientific-work-0nl2", "published_at": "2026-07-31 04:00:00+00:00", "updated_at": "2026-07-31 04:37:47.374779+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research"], "entities": ["AutoSupervision", "Nature Communications", "GPT-5.5"], "alternates": {"html": "https://wpnews.pro/news/autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded", "markdown": "https://wpnews.pro/news/autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded.md", "text": "https://wpnews.pro/news/autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded.txt", "jsonld": "https://wpnews.pro/news/autosupervision-closing-the-feedback-loop-in-scientific-workflows-with-grounded.jsonld"}}