SEO practitioner Dejan published a reproduction of Google's query fanout research, training a vector-based diffusion model that replaces text fanouts with embeddings for document retrieval and releasi…
A new arXiv preprint (arXiv:2609.04453v1) finds that expert pruning in Mixture-of-Experts (MoE) models fails under over-dispersed routing, where aggressive load-balancing makes router probabilities un…
Researchers introduced ELDR, an expert-locality-aware decode routing method for mixture-of-experts (MoE) models, which reduces median time-per-output-token by 5.9–13.9% across three MoE models and two…