cd /news/computer-vision/vaco-vertex-aligned-decoding-for-den… · home › topics › computer-vision › article
[ARTICLE · art-170304] src=arxiv.org ↗ pub= topic=computer-vision verified=true sentiment=↑ positive

VACO: Vertex-Aligned Decoding for Dense Hand Contact Estimation from a Single Image

A new decoder called VACO, presented in arXiv paper 2611.17755v1, sets a new state of the art on five benchmarks for dense hand contact estimation from a single RGB image by having each MANO vertex sample local image features at its projected location. A single VACO checkpoint improves F1 by +20.7 percentage points over the strongest prior direct predictor on Hi4D and generalizes to the held-out HOT3D and HOCap benchmarks with gains of +5.5 and +2.7 percentage points. The authors report that the resulting contact predictions also improve downstream hand-object interaction reconstruction.

by read1 min views1 publishedNov 16, 2026

arXiv:2611.17755v1 Announce Type: new Abstract: Dense hand contact estimation from a single RGB image is a foundational primitive for dexterous manipulation and 3D interaction analysis. Direct predictors typically decode the entire per-vertex contact map from one shared query, leaving individual vertices ungrounded in the image and smearing contact across adjacent, non-touching surfaces. We present VACO, a vertex-aligned decoder in which each MANO vertex samples local image features at its projected location. A hand-reconstruction backbone, jointly trained for reconstruction and contact, predicts these locations at inference without an auxiliary reconstructor. Training uses noise-perturbed ground-truth projections and end-to-end feature adaptation to improve robustness and contact-sensitive features. A single VACO checkpoint sets a new state of the art on five benchmarks spanning hand-object, hand-human, hand-scene, and bimanual interactions. It improves F1 by +20.7 pp over the strongest prior direct predictor on Hi4D and generalizes to the held-out HOT3D and HOCap, with gains of +5.5 and +2.7 pp. The resulting contact predictions also improve downstream HOI reconstruction.

── more in #computer-vision 4 stories · sorted by recency
── more on @vaco 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/vaco-vertex-aligned-…] indexed:0 read:1min 2026-11-16 · —