{"slug": "prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection", "title": "Prof-K: Probabilistic One-Pass Filtering for Efficient Top-k Selection", "summary": "Researchers introduced Prof-K, a probabilistic one-pass filtering algorithm for top-k selection that guarantees correctness with probability at least 1 - ε, achieving 1.5x-10x speedups over PyTorch topk and RadiK implementations. The method is distribution-agnostic and robust to adversarial inputs, with applications in machine learning workloads such as sparse autoencoder training.", "body_md": "arXiv:2608.12573v1 Announce Type: new\nAbstract: Top-k selection is a fundamental computational primitive with applications spanning databases, information retrieval, signal processing, and modern machine learning workloads, including sparse activations and attention pruning. As data sizes grow, existing approaches become inefficient: exact methods incur high memory and compute overhead, while approximate methods often rely on brittle heuristics that degrade under adversarial or heavy-tailed inputs. In this paper, we introduce Prof-K, a fast, scalable, and distribution-agnostic top-k algorithm with probabilistic correctness guarantees. Prof-K performs a single-pass filtering procedure: a small random sample estimates an adaptive threshold, the N input elements are streamed once into a compact buffer, and an exact top-k routine on this buffer recovers the true top-k elements with probability at least 1 - $\\epsilon$, where $\\epsilon$ > 0 is user specified. We derive high-probability guarantees for correctness and buffer size, together with an approximately optimal sample size that minimizes overhead as a function of N and k. Empirically, Prof-K achieves 1.5x-10x speedups over the highly optimized PyTorch topk and recent RadiK implementations, with the largest gains in the large-scale, small-to-moderate-k regime where prior methods struggle most. Unlike previous approaches, these guarantees hold independently of the input distribution, ensuring robustness to adversarial settings. By relaxing the recall target (e.g., recovering 95% of the true top-k values), Prof-K additionally provides a principled accuracy-speed trade-off. We further demonstrate its impact on training BatchTopK Sparse Autoencoders (SAEs), where top-k selection constitutes a significant portion of the training cost.", "url": "https://wpnews.pro/news/prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection", "canonical_source": "https://arxiv.org/abs/2608.12573", "published_at": "2026-08-14 04:00:00+00:00", "updated_at": "2026-08-14 04:16:16.294861+00:00", "lang": "en", "topics": ["machine-learning", "artificial-intelligence"], "entities": ["Prof-K", "PyTorch", "RadiK", "BatchTopK Sparse Autoencoders"], "alternates": {"html": "https://wpnews.pro/news/prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection", "markdown": "https://wpnews.pro/news/prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection.md", "text": "https://wpnews.pro/news/prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection.txt", "jsonld": "https://wpnews.pro/news/prof-k-probabilistic-one-pass-filtering-for-efficient-top-k-selection.jsonld"}}