pplx-garden

Perplexity has open sourced Lily, a Rust and Metal inference engine for Qwen3.6-35B-A3B on Apple Silicon, achieving a 77.4% prefill speedup via fused grouped GEMM and an 89% gain from GPU-only routing…

Perplexity AI open-sourced a Unigram tokenizer reimplemented in Rust that achieves 5x lower p50 latency than the Hugging Face tokenizers crate at production input lengths. The new tokenizer, available…