arXiv:2610.36809v1 Announce Type: cross Abstract: Multimodal large language models have made substantial progress in visual question answering, but complex visual reasoning often requires locating and comparing multiple pieces of question-relevant visual evidence. Existing methods that move intermediate reasoning into the visual latent space usually follow a single linear reasoning trajectory, which can be limiting when multiple visual hypotheses or competing evidence regions are relevant. We propose Latent Visual Contrastive Reasoning, a branch-aware latent reasoning framework that generates multiple question-conditioned latent visual branches as soft hypotheses over image tokens. To train these branches, our method uses bounding-box evidence annotations to build target evidence representations and introduces a soft contrastive branch-evidence alignment objective. This objective encourages evidence-relevant branches to align with annotated visual regions while contrasting them against negative evidence. We instantiate our method on Qwen2.5-VL backbones and train it with standard supervised fine-tuning. Experiments on perception-intensive visual reasoning benchmarks show that the proposed method achieves overall improvements over the corresponding backbone and single-path latent reasoning baselines at both 3B and 7B scales.
Latent Visual Contrastive Reasoning with Multi-Branch Exploration
A team of researchers posting to arXiv (paper 2610.36809v1) proposed Latent Visual Contrastive Reasoning, a branch-aware latent reasoning framework that generates multiple question-conditioned latent visual branches as soft hypotheses over image tokens instead of following a single linear reasoning trajectory. The method uses bounding-box evidence annotations to build target evidence representations and a soft contrastive branch-evidence alignment objective that pulls evidence-relevant branches toward annotated visual regions while contrasting them against negative evidence, instantiated on Qwen2.5-VL backbones and trained with standard supervised fine-tuning. On perception-intensive visual reasoning benchmarks, the method improved over the corresponding backbone and single-path latent reasoning baselines at both 3B and 7B scales.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.