# Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A Path to True Subquadratic Attention

> Source: <https://www.marktechpost.com/2026/11/02/zyphra-hierarchical-attention-zha-sparse-attention/>
> Published: 2026-11-03 01:09:49+00:00

Zyphra Hierarchical Attention (ZHA) is a tree-indexed sparse attention method that retrofits frozen LLMs with 4B tokens of distillation, matching dense attention on reasoning and 256K retrieval benchmarks.

The post [Zyphra AI Introduces Zyphra Hierarchical Attention (ZHA): A Path to True Subquadratic Attention](https://www.marktechpost.com/2026/11/02/zyphra-hierarchical-attention-zha-sparse-attention/) appeared first on [MarkTechPost](https://www.marktechpost.com).