{"slug": "fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in", "title": "FOVI-Dex: Foveation enables efficient perceptive learning of dexterous manipulation in simulation", "summary": "A research team's FOVI-Dex system, described in a paper on foveated rendering and perception, trains a language-conditioned visuotactile policy that controls a dexterous arm-hand to find and grasp a target object in clutter via online reinforcement learning without demonstrations. Compared with high-resolution fixed-camera control, FOVI-Dex uses 8.9 fewer vision tokens, supports 6 more parallel environments and achieves 4.4 higher training throughput, and at matched training budgets outperforms both the high-resolution baseline and a matched uniform active-camera baseline in simulation and the real world, with an outsized advantage in the real world.", "body_md": "Advanced physics simulators and rendering engines promise to support the next-generation of robotic reinforcement learning (RL), yet training perceptive policies remains challenging due to the high-costs of rendering and perception. We propose foveation as a solution to this challenge, coupling a novel foveated rendering solution with foveated perception, alongside a careful approach for ensuring transfer to foveated sampling of real uniform cameras. We train a language-conditioned visuotactile policy controlling a dexterous arm-hand to find and grasp a target object in clutter (FOVI-Dex), via online RL without demonstrations. In comparison to a high-resolution fixed-camera control, FOVI-Dex uses 8.9 less vision tokens, supporting 6 more parallel environments and 4.4 higher training throughput. At matched training budgets, this efficiency enables FOVI-Dex to outperform both the high-resolution baseline and a matched uniform active camera baseline, in both sim and real, with an outsized advantage in the real world.", "url": "https://wpnews.pro/news/fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in", "canonical_source": "https://research.nvidia.com/publication/2026-11_fovi-dex-foveation-enables-efficient-perceptive-learning-dexterous-manipulation", "published_at": "2026-11-10 03:17:38+00:00", "updated_at": "2026-11-10 03:49:24.884697+00:00", "lang": "en", "topics": ["robotics", "machine-learning", "ai-research", "computer-vision", "ai-safety"], "entities": ["FOVI-Dex"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in", "markdown": "https://wpnews.pro/news/fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in.md", "text": "https://wpnews.pro/news/fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in.txt", "jsonld": "https://wpnews.pro/news/fovi-dex-foveation-enables-efficient-perceptive-learning-of-dexterous-in.jsonld"}}