{"slug": "zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention", "title": "Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A Path to True Subquadratic Attention", "summary": "Zyphra AI introduced Zyphra Hierarchical Attention (ZHA), a tree-indexed sparse attention method that retrofits frozen LLMs using 4B tokens of distillation. Zyphra reports ZHA matches dense attention on reasoning and 256K retrieval benchmarks, positioning it as a path to true subquadratic attention.", "body_md": "Zyphra Hierarchical Attention (ZHA) is a tree-indexed sparse attention method that retrofits frozen LLMs with 4B tokens of distillation, matching dense attention on reasoning and 256K retrieval benchmarks.\n\nThe post [Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A Path to True Subquadratic Attention](https://www.marktechpost.com/2026/11/02/zyphra-hierarchical-attention-zha-sparse-attention/) appeared first on [MarkTechPost](https://www.marktechpost.com).", "url": "https://wpnews.pro/news/zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention", "canonical_source": "https://www.marktechpost.com/2026/11/02/zyphra-hierarchical-attention-zha-sparse-attention/", "published_at": "2026-11-03 01:09:49+00:00", "updated_at": "2026-11-03 03:22:01.704907+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research"], "entities": ["Zyphra AI", "Zyphra Hierarchical Attention", "ZHA", "MarkTechPost"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention", "markdown": "https://wpnews.pro/news/zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention.md", "text": "https://wpnews.pro/news/zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention.txt", "jsonld": "https://wpnews.pro/news/zyphra-ai-introduces-zyphra-hierarchical-attention-zha-a-path-to-true-attention.jsonld"}}