cd /news/computer-vision/harnessing-generative-image-models-f… · home topics computer-vision article
[ARTICLE · art-50498] src=arxiv.org ↗ pub= topic=computer-vision verified=true sentiment=↑ positive

Harnessing Generative Image Models for Training-Free Primitive Shape Abstraction

Researchers have developed a training-free method for 3D shape abstraction using generative image models, achieving state-of-the-art Chamfer distance on HumanPrim and Toys4K benchmarks with 5-9 primitives per object. The pipeline renders multi-view images, segments parts via a vision-language model and generative image model, then fits superquadrics without learned parameters, making it category-agnostic and orientation-invariant.

read1 min views1 publishedJul 8, 2026

arXiv:2607.05568v1 Announce Type: new Abstract: Representing 3D shapes as compact sets of geometric primitives is fundamental to robotics, simulation, and scene understanding. Generative image models trained at scale have recently emerged as generalist visual learners that can identify and segment object parts directly in the image domain, across arbitrary categories and without task-specific training. Adapting such models to downstream tasks typically requires fine-tuning; we ask whether their pretrained capability can instead be harnessed directly, without any training, and answer affirmatively with a training-free harness. Our pipeline renders multi-view images of a 3D object, uses a vision-language model to analyze its semantic parts, prompts a generative image model to paint a color-coded part segmentation mask, reprojects it onto the geometry, and fits a superquadric primitive to each part via parameter optimization. The approach contains no learned parameters: it is category-agnostic and orientation-invariant, properties that previous learning-based models struggled with. Its accuracy ceiling rises with future generative-model improvements, which we confirm with a ground-truth segmentation study showing that part segmentation, not primitive fitting, is the current accuracy bottleneck. On HumanPrim and Toys4K, our method achieves the lowest Chamfer distance among all evaluated methods, using 5--9 primitives per object on average.

── more in #computer-vision 4 stories · sorted by recency
── more on @humanprim 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/harnessing-generativ…] indexed:0 read:1min 2026-07-08 ·