cd /news/computer-vision/lensvlm-selective-context-expansion-… · home topics computer-vision article
[ARTICLE · art-49549] src=machinelearning.apple.com ↗ pub= topic=computer-vision verified=true sentiment=↑ positive

LensVLM: Selective Context Expansion for Compressed Visual Representation of Text

Researchers propose LensVLM, an inference framework that enables Vision Language Models to scan compressed images and selectively expand only relevant ones, achieving up to 10.1× effective compression while maintaining accuracy comparable to full-text baselines across seven text QA benchmarks.

read1 min views2 publishedJul 7, 2026
LensVLM: Selective Context Expansion for Compressed Visual Representation of Text
Image: Apple ML Research

Vision Language Models (VLMs) offer the exciting possibility of processing text as rendered images, bypassing the need for tokenizing the text into long token sequences. Since VLM image encoders map fixed-size images to a fixed number of visual tokens, varying rendering resolution provides a fine-grained compression knob. However, accuracy deteriorates quickly as compression increases: characters shrink below the vision encoder’s effective resolution, making them indistinguishable. To address this, we propose LensVLM, an inference framework and post-training recipe that enables VLMs to scan compressed images, then selectively expand only the relevant images to their uncompressed form via learned tools. Building on Qwen3.5-9B-Base, LensVLM maintains accuracy comparable to the full-text upper bound at 4.3× effective compression and outperforms retrieval-based, text- and visual-compression baselines up to 10.1× effective compression across seven text QA benchmarks. LensVLM also generalizes to multimodal document and code understanding tasks, with the accuracy gain over baselines growing as compression increases. Our analysis validates this approach: training makes visual compression robust to rendering choices, and as compression grows the model increasingly relies on expanded content rather than unreliable visual reading. The analysis also yields practical tool-choice guidance: text expansion is preferable for rendered text, while high-resolution image expansion suits native documents whose layout cues carry task-relevant information.

── more in #computer-vision 4 stories · sorted by recency
── more on @lensvlm 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/lensvlm-selective-co…] indexed:0 read:1min 2026-07-07 ·