cd /news/machine-learning/smilesgnn-interpretable-clinical-tox… · home › topics › machine-learning › article
[ARTICLE · art-139454] src=arxiv.org ↗ pub= topic=machine-learning verified=true sentiment=↑ positive

SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

SMILESGNN, a multimodal architecture that fuses a SMILES Transformer encoder with a GATv2 graph encoder via cross-attention, achieved AUC-ROC 0.987 and F1 0.906 on ClinTox with only 0.4M parameters, according to an arXiv paper (2609.28553v1). The SMILESGNN-PT variant, which uses a ChemBERTa-2 pretrained backbone, reached a mean AUC-ROC of 0.750 across the 12 tasks of Tox21, comparable to ChemBERTa-2 alone and a same-backbone concat-fusion baseline. The authors report that cross-attention is a practical fusion alternative that preserves competitive predictive performance while retaining an explicit graph branch for GNNExplainer-based substructure analysis of toxic predictions.

by read1 min views1 publishedSep 25, 2026

arXiv:2609.28553v1 Announce Type: new Abstract: Drug toxicity prediction is critical for reducing late-stage attrition in drug discovery, yet remains challenging due to severe class imbalance, scaffold-based generalization, and the clinical need for interpretable predictions. Single-modality approaches-SMILES Transformers or graph neural networks capture complementary aspects of molecular structure, while sequence-only models cannot directly provide graph-attributed explanations. We present SMILESGNN, a multimodal architecture that fuses a SMILES Transformer encoder and a GATv2 graph encoder via cross-attention, and SMILESGNN-PT, a variant using a ChemBERTa-2 pretrained backbone. The design retains an explicit graph branch within the predictive pipeline, supporting GNNExplainer-based analysis of substructures associated with toxic predictions. On ClinTox, SMILESGNN achieves AUC-ROC 0.987 and F1 0.906 with only 0.4M parameters, performing competitively with a strong SMILESTransformer and a larger ChemBERTa-2/GATv2 concat-fusion baseline. On Tox21 (12 tasks), SMILESGNN-PT obtains mean AUC-ROC 0.750, comparable to ChemBERTa-2 alone and the same-backbone concat-fusion baseline. Overall, the results suggest that cross-attention is a practical fusion alternative that preserves competitive predictive performance while enabling graph-based interpretability support.

── more in #machine-learning 4 stories · sorted by recency
── more on @smilesgnn 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/smilesgnn-interpreta…] indexed:0 read:1min 2026-09-25 · —