Perplexity has open-sourced Lily, a Rust and Metal local inference engine that outperforms Apple's MLX framework by 1.35x on decode throughput for Qwen3.6-35B-A3B on Mac, with prefill speeds of 4,156 …
Perplexity announced it will open source Lily, a local AI engine built for Apple silicon and the Qwen3.6-35B-A3B model, which uses a Rust runtime and custom Metal kernels without PyTorch or MLX. Perpl…
PipeNetwork released minimax-h3-mlx, a community MLX implementation of MiniMax-H3 for Apple Silicon, translating the 33-billion-parameter video-and-audio diffusion pipeline into native MLX. The reposi…
A developer's two-week experiment with an M5 Max MacBook Pro with 128 GB of unified memory found that DeepSeek V4 Flash weights ran at 6 tokens per second under mainline llama.cpp but 30 to 40 tokens …
A reviewer tested Siri AI on macOS 27 Golden Gate for 24 hours and found it improved but limited, especially for automating complex tasks like running benchmarks. The assistant could analyze screensho…