{"slug": "vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for", "title": "VIDRAFT's Open Discovery Challenge: Benchmarking LLMs on Real Drug Discovery for Malaria & TB", "summary": "VIDRAFT, a Korean deep-tech AI/science research company, has launched the Open Discovery Challenge, a public drug discovery competition hosted on Hugging Face that evaluates AI-generated molecular candidates against real pharmacological criteria. Within three days, the challenge drew over 2,000 submissions, and early data reveals measurable performance gaps among major LLM families, with Claude models leading in median scores for both malaria and tuberculosis seasons.", "body_md": "TL;DR:VIDRAFT, a Korean deep-tech AI/science research company, has launched theOpen Discovery Challenge— a public, open-science drug discovery competition hosted on Hugging Face that scores AI-generated molecular candidates against real pharmacological criteria (efficacy potential, toxicity, target binding, ADME, and preclinical/clinical simulation). Within three days of launch it drew 2,000+ candidate submissions, and early data already reveals measurable performance gaps between major LLM families on genuine scientific tasks — not canned benchmarks.\n\nThe **Open Discovery Challenge** is VIDRAFT's publicly hosted AI drug-discovery competition, live on Hugging Face. Unlike traditional AI benchmarks that measure accuracy on fixed question sets, this challenge asks participants — developers, researchers, or curious generalists — to use any available AI (OpenAI, Claude, Gemini, DeepSeek, Qwen, KIMI, or their own models) to **propose novel molecular structures** as drug candidates for specific diseases.\n\nSubmissions are evaluated against a multi-factor scoring pipeline covering:\n\nTwo disease seasons are currently active:\n\nBoth diseases were deliberately chosen for their public-health impact: they disproportionately affect low-income populations where market incentives for private pharmaceutical R&D are structurally weak — a classic market-failure scenario the project aims to address with open science and AI.\n\nAt a conceptual level, the challenge treats drug discovery as a **scientific agent evaluation problem** rather than a pure model benchmark:\n\nThe key architectural insight is that **the unit of competition is not the raw LLM — it is the full \"science agent\" stack**: model + prompt engineering + tool integrations + research strategy. This framing directly reflects the observed score variance in early data (see Benchmarks below).\n\nVIDRAFT provides an AI drug development guide so that participants without a pharmaceutical background can still meaningfully contribute.\n\nEarly data from the first 2,000+ submissions surfaces several patterns worth noting:\n\n**By LLM family (median scores, as reported):**\n\n| Model Family | Malaria Season (median) | TB Season (median) |\n|---|---|---|\n| Claude family | 43.7 | 39.9 |\n| DeepSeek / Qwen / KIMI (Chinese open models) | 37.7 | 37.7* |\n| OpenAI family | 31.7 | 30.9 |\n| Gemini family | 17.1 | — |\n\n**Reported as a combined group median across both seasons; TB-specific figure not separately broken out in the source.*\n\n**Key takeaways for engineers:**\n\nThe challenge is explicitly positioned as a living dataset; as submission volume grows, the organizers expect it to serve as a meaningful, continuously updated benchmark for general AI scientific reasoning.\n\nThe Open Discovery Challenge is publicly accessible via Hugging Face. Navigate to the VIDRAFT organization page on Hugging Face to find the challenge space and submission instructions. VIDRAFT also provides an AI drug development guide within the challenge to help non-specialists participate.\n\nNo specific CLI commands, API endpoints, or repository URLs were disclosed in the source article at time of writing. Check the VIDRAFT Hugging Face organization page directly for the most current access instructions.\n\n**Q: Do I need to be a pharmaceutical researcher to participate?**\n\nA: No. VIDRAFT explicitly designed the challenge for anyone who can use a modern AI model. They provide an AI drug development guide within the challenge space to help non-specialist participants structure their workflow and understand the evaluation criteria.\n\n**Q: Is this replacing wet-lab chemistry, or is it purely computational?**\n\nA: At this stage it is a **computational simulation and scoring** pipeline — submissions are evaluated by VIDRAFT's automated pharmacological scoring system (efficacy, toxicity, binding, ADME, preclinical/clinical simulation), not by physical synthesis or lab assay. It is best understood as a rigorous AI-native filtering stage for candidate generation, not a replacement for experimental validation downstream.\n\n**Q: Can I use open-weight / self-hosted models rather than commercial APIs?**\n\nA: Yes. The challenge explicitly supports submissions generated by open models including DeepSeek, Qwen, and KIMI, as well as participant-developed AI systems.\n\n**Q: Why malaria and TB specifically?**\n\nA: Both diseases carry enormous global health burdens but are concentrated in low-income populations with limited purchasing power, creating a market-failure dynamic where private pharmaceutical R&D incentives are insufficient relative to public need. VIDRAFT framed these as the ideal starting point for a public-interest open-science project.\n\n*Originally reported by 전자신문 (2026-08-18) — source article.*", "url": "https://wpnews.pro/news/vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for", "canonical_source": "https://dev.to/ai_openfree_b23025ef075cf/vidrafts-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for-malaria-tb-4fej", "published_at": "2026-08-18 11:01:39+00:00", "updated_at": "2026-08-18 11:13:51.530151+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-products", "ai-agents"], "entities": ["VIDRAFT", "Hugging Face", "OpenAI", "Claude", "Gemini", "DeepSeek", "Qwen", "KIMI"], "alternates": {"html": "https://wpnews.pro/news/vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for", "markdown": "https://wpnews.pro/news/vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for.md", "text": "https://wpnews.pro/news/vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for.txt", "jsonld": "https://wpnews.pro/news/vidraft-s-open-discovery-challenge-benchmarking-llms-on-real-drug-discovery-for.jsonld"}}