arXiv:2609.00505v1 Announce Type: new Abstract: Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Standard datasets mask this limitation by enabling models to exploit static spatial shortcuts. To systematically evaluate this, we introduce XTE-Bench, a diagnostic probe revealing that even large-scale video-language models struggle with basic temporal reasoning, indicating that parameter scaling alone is insufficient to resolve this flaw. To address this, we propose Cross-Modal Temporal Edits (XTE), a self-supervised framework that injects precise temporal supervision. By performing synchronized video-text transformations, XTE generates hard temporal negatives without manual annotation. We instantiate this with ViTAL-X, a lightweight model that equips frozen image-text backbones with temporal awareness while preserving their foundational spatial knowledge. Across six temporal benchmarks, ViTAL-X achieves state-of-the-art performance. Utilizing only 0.4B parameters and 1M training clips, ViTAL-X outperforms 7B-parameter models and surpasses baselines trained on 600x more data. These results demonstrate that targeted, high-quality temporal alignment provides a highly efficient alternative to pure scaling.
ViTAL-X: Video-Text Alignment with Cross-Modal Temporal Edits
Researchers introduced ViTAL-X, a lightweight 0.4B-parameter model that achieves state-of-the-art performance on six temporal benchmarks, outperforming 7B-parameter models and baselines trained on 600x more data. The model uses Cross-Modal Temporal Edits (XTE), a self-supervised framework that injects temporal supervision into frozen image-text backbones, addressing temporal blindness in video-text models. The accompanying XTE-Bench diagnostic probe reveals that even large-scale video-language models struggle with basic temporal reasoning, indicating parameter scaling alone is insufficient.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.