{"slug": "captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos", "title": "CaptionQA outperforms VideoQA on 10 of 12 models for long egocentric videos", "summary": "CaptionQA, a caption-based memory approach that segments egocentric video into 30-to-60-second windows, outperformed direct VideoQA on 10 of 12 models for videos longer than 20 minutes, according to an arXiv paper (2609.17688). The method delivered a 3.22-point mean accuracy gain in matched-frame controls, rising by up to 5.3 points when paired with a retrieve-and-verify architecture, offering wearable AI agent developers a way to cut visual-token costs by querying a lightweight text-caption index instead of raw video frames.", "body_md": "[arXiv](https://arxiv.org/abs/2609.17688)\n\n### CaptionQA outperforms VideoQA on 10 of 12 models for long egocentric videos\n\nWhich summary reads better? Pick one — models revealed after.Both summaries are AI-generated.\n\nTextual captions of egocentric video segmented into 30-to-60-second windows outperform direct video querying on videos longer than 20 minutes, delivering a 3.22-point accuracy gain that increases by up to 5.3 points when paired with a retrieve-and-verify architecture. For engineers building wearable AI agents, this means you can bypass expensive visual-token costs and long-context vision failures by storing and querying a lightweight text-caption index of video history instead of feeding raw video frames into vision-language models.\n\nOn egocentric videos longer than 20 minutes, caption-based memory beat direct video QA in 10/12 models with 30-second caption windows and kept a 3.22-point mean accuracy gain in matched-frame controls. For production wearable/agent systems, precomputing dense text captions as episodic memory is a practical way to reduce visual-token pressure and improve long-horizon recall, especially when paired with retrieve-and-verify for another accuracy boost of up to 5.3 points.", "url": "https://wpnews.pro/news/captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos", "canonical_source": "https://www.snipvote.com/story/cmu57go6k0006cy5jo7d4vmm2", "published_at": "2026-09-17 07:56:05.395008+00:00", "updated_at": "2026-09-17 07:56:06.786417+00:00", "lang": "en", "topics": ["computer-vision", "ai-agents", "ai-research", "large-language-models"], "entities": ["arXiv", "CaptionQA", "VideoQA"], "alternates": {"html": "https://wpnews.pro/news/captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos", "markdown": "https://wpnews.pro/news/captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos.md", "text": "https://wpnews.pro/news/captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos.txt", "jsonld": "https://wpnews.pro/news/captionqa-outperforms-videoqa-on-10-of-12-models-for-long-egocentric-videos.jsonld"}}