How Finely Can Vision-Language Models See Biology? Bio-VQA: A Benchmark for Taxonomic, Morphological, Spatial and Individual Reasoning
A new benchmark, Bio-VQA, finds that general visual capabilities in vision-language models do not transfer to biological organisms, with the best of 18 open-weight models counting animals exactly on only 41.7% of images …