{"slug": "northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery", "title": "Northeastern students find AI isn’t a cure all for drug discovery", "summary": "Northeastern University graduate students found that popular open-source AI frameworks, including GPT Researcher and Agent Laboratory, are not yet capable of replacing human researchers in drug discovery, according to three capstone reports. The students tested eight models in their first report and five more advanced frameworks in their second, all of which failed to draft well-sourced scientific reports or replicate human-made algorithms, including one developed at Northeastern and a study by Novartis. Anton Sinitskiy, a teaching professor in the Applied AI program, said the results show AI's capabilities are 'very far from these overhyped statements.'", "body_md": "# Northeastern students find that AI isn’t the cure-all in drug discovery\n\nNortheastern University capstone students find AI still isn’t as capable as human researchers for drug discovery and development.\n\nThere’s been a lot of talk about artificial intelligence’s potential to transform drug research and discovery — and companies are spending billions in pursuit of that dream.\n\nIn 2025, the AI drug discovery market was valued at 2.3 billion and is projected to grow to $13.8 billion by 2033, according to market analysis firm [Grand View Research](https://www.grandviewresearch.com/industry-analysis/artificial-intelligence-drug-discovery-market).\n\nDemis Hassabis, chief scientist at the technology company Alphabet, has even made claims [that AI could help scientists discover](https://www.cbsnews.com/news/artificial-intelligence-google-deepmind-ceo-demis-hassabis-60-minutes-transcript/) a cure for most if not all human diseases within the 10 years.\n\nBut to what extent is this all backed by real science and technological advancement – and not just marketing hype?\n\nNortheastern graduate students in Anton Sinitskiy’s Applied AI capstone class are setting out to find the answer.\n\nOver the past academic year, three cohorts of students in the capstone course have tested a few of the most popular open source AI frameworks used for complex medical and biomedical research – including GPT Researcher and Agent Laboratory – to see if they could get to the bottom of the AI industry’s claims.\n\nAnd time and time again, the students have come to a similar conclusion — while AI can certainly be useful in some applications, there’s still a ways to it taking center stage in the drug discovery process, said Anton Sinitskiy, a teaching professor in the Applied AI program in the College of Professional Studies.\n\nToday’s models continue to make dangerous factual mistakes, are incapable of drafting well-sourced scientific reports on their own, and need constant hand holding.\n\nThat’s the takeaway from three scientific reports produced by students in the capstone class.\n\n“If you just listen to what is written in the media, on scientific papers, and marketing materials, it sounds like AI is capable of solving all problems, including drug design,” Sinitskiy said. “But unfortunately the truth is very far from these overhyped statements.”\n\nThe capstone class is one of the final courses students take in their graduate studies and is designed to challenge them to put into practice everything they’ve learned throughout their degree in a real-world context.\n\nIn the students’ [first report](https://www.biorxiv.org/content/10.64898/2026.01.05.697809v1.abstract), which was shared in January 2026, they analyzed eight open source models used for complex research to see if they were capable of reproducing human made algorithms designed for drug discovery.\n\nOne of the algorithms the students had the AI agents try to replicate was developed at Northeastern by a student working under Lei Xie, a Northeastern professor of pharmaceutical and biomedical sciences.\n\nThe human-made Northeastern model is useful in predicting properties of molecules when they interact during the drug development process, Sinitskiy said.\n\n## Editor’s Picks\n\nAll the open source models failed to even draft scientific reports and were incapable of reproducing the algorithm developed by Lei and his students, Sinitskiy explained.\n\nXie said the findings put into perspective “the scope” of these technologies. While AI can be useful in some contexts, it cannot “replace human intelligence,” he said.\n\nFor [the second report](https://www.biorxiv.org/content/10.64898/2026.06.24.734302v1.abstract), shared on June 27, the students performed similar tasks again using “five more advanced AI frameworks.” But this time, the models were asked to replicate the findings of a drug discovery report developed by the Swiss pharmaceutical company Novartis.\n\nThe Novartis study was chosen for the second report because it addressed the same topic that was tackled by Lei’s algorithm and was published by “a big pharma company known for its high quality research,” Sinitskiy said.\n\nWhile the students found that these more advanced models were slightly more capable of drafting original hypotheses and drafting full reports, they lacked depth and were rife with errors.\n\nFor Niventhini Senthilselvan, who completed Sinitskiy’s capstone course in the winter and is one of the student co-authors of the report, the experience highlighted the importance of not taking AI chatbot’s answers at face value.\n\n“It taught me to look beyond simply getting an answer from AI and ask deeper questions: How reliable is it? Why did the model produce it? And how can we improve it?,” she said.\n\nIt’s a particular valuable skill for the recent Northeastern graduate who works as an AI engineer in the telecommunications industry.\n\n“As AI becomes increasingly integrated into real-world decision-making, understanding not just an answer, but its reliability and uncertainty, is equally important,” she said.\n\nFor t[he most recent report](https://www.biorxiv.org/content/10.64898/2026.06.23.734132v1.abstract) published on June 29, students tested the models’ capacity to independently review scientific papers, large data sets, and formulas for analysis. Once again, they found that the models largely failed, producing inaccurate and misleading results.\n\nNotably, as part of this study, the researchers also conducted separate experiments where they worked collaboratively with the models to produce much more accurate and usable data, explained Jude Dcunha, a student co-author who completed Sinitskiy’s capstone course this spring.\n\nIn simple cases, AI can get you 95% of the way on its own, Dcunha noted. But in more complex cases “it can fail miserably, and you need to hold its hand.”\n\nSinitskiy noted that while students analyzed a handful of specific AI models, the goal of the research was to serve as an overview of “the current stage of affairs” rather than a deep breakdown of how specific models are totally inadequate.\n\n“It’s not an issue with one specific AI framework, but with the state of the field,” he said.\n\nBut it wasn’t all bad news. In some respects, AI can be a useful tool in completing repetitive tasks, statistical support and stress testing ideas, Sinitskiy said the research revealed.\n\n“The point is AI can do really important things, but you need to know what kind of things it can do, and you need to run it properly,” he said. “That’s what I’m teaching students in my courses to do.”", "url": "https://wpnews.pro/news/northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery", "canonical_source": "https://news.northeastern.edu/2026/08/26/ai-drug-discovery-study/", "published_at": "2026-08-26 17:52:29+00:00", "updated_at": "2026-08-26 18:14:05.168703+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-research", "ai-tools"], "entities": ["Northeastern University", "Anton Sinitskiy", "GPT Researcher", "Agent Laboratory", "Lei Xie", "Novartis", "Grand View Research", "Demis Hassabis"], "alternates": {"html": "https://wpnews.pro/news/northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery", "markdown": "https://wpnews.pro/news/northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery.md", "text": "https://wpnews.pro/news/northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery.txt", "jsonld": "https://wpnews.pro/news/northeastern-students-find-ai-isnt-a-cure-all-for-drug-discovery.jsonld"}}