{"slug": "figmatrace-capturing-creative-nuances-in-human-figma-design-workflows", "title": "FigmaTrace: Capturing Creative Nuances in Human Figma Design Workflows", "summary": "Researchers introduced FigmaTrace, a dataset of over 200 hours of human-captured video converted into 3,469 design trajectories using a novel design phase-based method, built on a taxonomy of 126 open-ended design tasks. Training four models on FigmaTrace improved performance comparable to frontier closed models such as Claude-Opus-5 and GPT-5.6-Sol on four out-of-distribution agentic GUI environments. The dataset and best model are open-sourced.", "body_md": "arXiv:2608.21460v1 Announce Type: new\nAbstract: Vision Language Models have recently shown improvements in several objective and verifiable domains such as object detection but continue to underperform on subjective and creative design tasks. A major contributor to this performance gap is the lack of high quality human workflow data that captures a diverse set of preferences and decisions that make human experts good at design tasks. In this work, we first define a unique, expert curated taxonomy of design skills and best practices which we further expand into a set of 126 open ended, subjective, long horizon tasks. Built on top of this and expert solutions, our dataset FigmaTrace contains over 200 hours of human captured video data converted into 3469 design trajectories using a novel design phase-based method. We use our dataset to train four models and show that training on FigmaTrace leads to a performance improvement comparable to frontier closed models such as \\textsc{Claude-Opus-5} and \\textsc{GPT-5.6-Sol} on four out of distribution agentic GUI environments. We further perform a useful ablation to attribute these performance improvements to a design phase-based video to trajectory conversion which outperforms prior length-based conversion approaches. Finally, we perform a qualitative analysis on the best performing \\textsc{Qwen3.8-27B} outputs to better correlate performance improvements to FigmaTrace's trends. We open source our dataset and the best model for the community.", "url": "https://wpnews.pro/news/figmatrace-capturing-creative-nuances-in-human-figma-design-workflows", "canonical_source": "https://arxiv.org/abs/2608.21460", "published_at": "2026-08-25 04:00:00+00:00", "updated_at": "2026-08-25 04:13:34.206123+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "computer-vision", "ai-research"], "entities": ["FigmaTrace", "Claude-Opus-5", "GPT-5.6-Sol", "Qwen3.8-27B"], "alternates": {"html": "https://wpnews.pro/news/figmatrace-capturing-creative-nuances-in-human-figma-design-workflows", "markdown": "https://wpnews.pro/news/figmatrace-capturing-creative-nuances-in-human-figma-design-workflows.md", "text": "https://wpnews.pro/news/figmatrace-capturing-creative-nuances-in-human-figma-design-workflows.txt", "jsonld": "https://wpnews.pro/news/figmatrace-capturing-creative-nuances-in-human-figma-design-workflows.jsonld"}}