arXiv:2610.12575v1 Announce Type: new Abstract: Modern video-language models are increasingly treated as general-purpose video reasoners, yet it remains unclear whether they robustly capture temporal dynamics in safety-critical settings such as driving. We study this question through controlled ego-motion tasks that require identifying actions from driving videos. Across video-language models, we find that standard prompting, visual prompting, few-shot prompting, and chain-of-thought prompting remain unreliable and highly task- and model-dependent, with persistent class biases, although newer models show substantial task-specific few-shot gains. In contrast, lightweight LoRA finetuning and simple probes trained on intermediate visual features recover strong motion-discriminative performance, indicating that motion-relevant cues are often present inside the models but are not reliably used by the final video-to-language pathway. These results suggest that, in driving, current video-language models remain unreliable temporal reasoners and often behave more like frame-level, bias-driven recognizers than dependable temporal world models.
Mind the Temporal Gap: Evaluating Video Models for Temporal Understanding in Driving
A new arXiv paper (2610.12575v1) finds that modern video-language models remain unreliable temporal reasoners in safety-critical driving settings, with standard prompting, visual prompting, few-shot prompting, and chain-of-thought prompting all proving task- and model-dependent and showing persistent class biases. The authors report that lightweight LoRA finetuning and simple probes trained on intermediate visual features recover strong motion-discriminative performance, indicating motion-relevant cues exist inside the models but are not reliably used by the final video-to-language pathway. The paper concludes that current video-language models often behave more like frame-level, bias-driven recognizers than dependable temporal world models for driving.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.