{"slug": "handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a", "title": "Handshake AI’s VIALS benchmark gets an independent leaderboard, and the results reveal a 99x cost gap between top models", "summary": "Artificial Analysis launched VIALS-AA on November 6, 2026, an independent leaderboard implementing Handshake AI's VIALS benchmark to test vision-language models on life-sciences imagery across 161 visual question-answering tasks. Gemini 4 Carbon (high) leads at 64%, ahead of GPT-6 Astra (max) at 63% and Claude Opus 5.5 (max with fallback) at 61%, while GPT-6 Luna (max) completes the task set for $0.02 versus $1.77 for Grok 4.7 (xhigh) — a nearly 99x cost gap within a similar performance tier. The leading open-weights model, Kimi K3.1 Pro, scored 45%, roughly 19 percentage points behind the top proprietary systems, and fourteen tasks triggered safety refusals because models misread scientific imagery as sensitive content.", "body_md": "# Handshake AI’s VIALS benchmark gets an independent leaderboard, and the results reveal a 99x cost gap between top models\n\nPhoto: Ludovic Delot / Pexels\n\nArtificial Analysis' VIALS-AA ranks vision-language models on scientific image interpretation, exposing wide performance and pricing gaps across leading AI systems.\n\nReading a gel blot or interpreting a microscopy image requires the kind of domain knowledge that takes researchers years to develop. VIALS-AA, launched by Artificial Analysis on November 6, 2026, is a direct attempt to close that measurement gap.\n\nThe leaderboard is an independent implementation of Handshake AI’s VIALS benchmark, built specifically to stress-test vision-language models on life sciences and biotech imagery: gel blots, molecular structures, microscopy slides, and similar artifacts that show up constantly in real research workflows but almost never in standard AI evaluations.\n\n## Who’s leading and what it costs them\n\nAcross 161 visual question-answering tasks, Gemini 4 Carbon (high) currently holds the top position with a score of 64%, measured as the proportion of tasks answered correctly across three repeated runs. GPT-6 Astra (max) sits just behind at 63%, with Claude Opus 5.5 (max with fallback) at 61%.\n\nGPT-6 Luna (max) completes the full task set for $0.02. Grok 4.7 (xhigh) runs the same gauntlet for $1.77. That is a price difference of nearly 99 times for models operating in broadly the same performance tier.\n\nThe comparison between GPT-6.1 Sol (max) and Claude Opus 5.5 makes the tradeoff even starker. Sol scores 59% at approximately $0.06 per task. Opus 5.5 scores 61% for approximately $1.64 per task, a 29x cost difference for a 2-percentage-point edge in accuracy.\n\n### AI, tech, and the markets they move—in one daily briefing.\n\nDaily. Free. Join 34,000+ readers across crypto, finance, and policy.\n\n## The open-weights gap and the safety refusal problem\n\nKimi K3.1 Pro, the benchmark’s leading open-weights model, scored 45%, approximately 19 percentage points behind the top-performing proprietary systems.\n\nSeparate from the accuracy scores, fourteen tasks across the benchmark triggered safety refusals from various models. The affected tasks were not flagged for being dangerous; they were flagged because models misread scientific imagery as potentially sensitive content and declined to engage.\n\nThe evaluation itself runs through the Stirrup harness, which allows models to execute code and inspect images programmatically rather than just receiving them as static inputs. Performance is measured using a pass^3 metric, meaning a model must answer correctly on all three attempts at a given task to get credit.\n\n## Why this benchmark exists now\n\nHandshake AI published the original VIALS dataset in August 2026, with a revision following on September 19. The dataset was made publicly available with the explicit goal of building evaluation infrastructure for real-world scientific image interpretation.\n\nArtificial Analysis built VIALS-AA as an independent implementation, running the benchmark continuously across a broad set of frontier models rather than as a one-time published result.\n\n**Disclosure:** This article was edited by Diego Almada Lopez. For more information on how we create and review content, see our [Editorial Policy](https://cryptobriefing.com/editorial-policy/).", "url": "https://wpnews.pro/news/handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a", "canonical_source": "https://cryptobriefing.com/vials-aa-leaderboard-visual-reasoning-life-sciences/", "published_at": "2026-11-06 17:20:20+00:00", "updated_at": "2026-11-06 17:50:57.908727+00:00", "lang": "en", "topics": ["ai-research", "large-language-models", "computer-vision", "ai-safety", "ai-products"], "entities": ["Artificial Analysis", "Handshake AI", "VIALS-AA", "Gemini 4 Carbon", "GPT-6 Astra", "Claude Opus 5.5", "GPT-6 Luna", "Kimi K3.1 Pro"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a", "markdown": "https://wpnews.pro/news/handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a.md", "text": "https://wpnews.pro/news/handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a.txt", "jsonld": "https://wpnews.pro/news/handshake-ais-vials-benchmark-gets-an-independent-leaderboard-and-the-results-a.jsonld"}}