PROBE

Researchers introduced PROBE, a framework for benchmarking and finetuning vision-language model (VLM) agents on Manipulation-Grounded Visual Question Answering (MG-VQA), where robots must physically m…

Current large language models like GPT-5 and Claude Opus-4.1 achieve only a 40% success rate on the PROBE benchmark for proactive AI agents, revealing significant limitations in autonomous problem-sol…