{"slug": "vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single", "title": "VACO: Vertex-Aligned Decoding for Dense Hand Contact Estimation from a Single Image", "summary": "A new decoder called VACO, presented in arXiv paper 2611.17755v1, sets a new state of the art on five benchmarks for dense hand contact estimation from a single RGB image by having each MANO vertex sample local image features at its projected location. A single VACO checkpoint improves F1 by +20.7 percentage points over the strongest prior direct predictor on Hi4D and generalizes to the held-out HOT3D and HOCap benchmarks with gains of +5.5 and +2.7 percentage points. The authors report that the resulting contact predictions also improve downstream hand-object interaction reconstruction.", "body_md": "arXiv:2611.17755v1 Announce Type: new \nAbstract: Dense hand contact estimation from a single RGB image is a foundational primitive for dexterous manipulation and 3D interaction analysis. Direct predictors typically decode the entire per-vertex contact map from one shared query, leaving individual vertices ungrounded in the image and smearing contact across adjacent, non-touching surfaces. We present VACO, a vertex-aligned decoder in which each MANO vertex samples local image features at its projected location. A hand-reconstruction backbone, jointly trained for reconstruction and contact, predicts these locations at inference without an auxiliary reconstructor. Training uses noise-perturbed ground-truth projections and end-to-end feature adaptation to improve robustness and contact-sensitive features. A single VACO checkpoint sets a new state of the art on five benchmarks spanning hand-object, hand-human, hand-scene, and bimanual interactions. It improves F1 by +20.7 pp over the strongest prior direct predictor on Hi4D and generalizes to the held-out HOT3D and HOCap, with gains of +5.5 and +2.7 pp. The resulting contact predictions also improve downstream HOI reconstruction.", "url": "https://wpnews.pro/news/vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single", "canonical_source": "https://arxiv.org/abs/2611.17755", "published_at": "2026-11-16 05:00:00+00:00", "updated_at": "2026-11-16 05:21:19.278117+00:00", "lang": "en", "topics": ["computer-vision", "ai-research", "machine-learning", "artificial-intelligence"], "entities": ["VACO", "MANO", "Hi4D", "HOT3D", "HOCap", "arXiv"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single", "markdown": "https://wpnews.pro/news/vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single.md", "text": "https://wpnews.pro/news/vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single.txt", "jsonld": "https://wpnews.pro/news/vaco-vertex-aligned-decoding-for-dense-hand-contact-estimation-from-a-single.jsonld"}}