A developer released a portable profiler that measures Apple Neural Engine KernelDMA prefetch behavior across M1, M3, M4, and M5 chips by timing the private _ANEClient evaluateWithModel call (eval_us)…
Darkbloom, a service at darkbloom.dev, lets owners of M-Series Macs rent out idle compute to serve open-source language models, with estimated earnings of $146 to $602 per month depending on chip and …
A developer built an orchestration layer called agent-orchestra to manage Claude Code, OpenAI's Codex CLI, and local LLMs, using Git worktrees to isolate agent tasks and prevent merge conflicts. The s…
ExecuTorch's experimental MLX delegate, released in May 2026, enables PyTorch models to run on Apple Silicon GPUs. Testing Qwen3-0.6B on an M1 Max, MLX INT4 achieved 188.9 tokens/s, 4.52x faster than …
A developer benchmarked PyTorch 2.13's FlexAttention on an M1 Max Mac, finding up to 7.83x speedup over standard SDPA for sparse attention with 32,768 tokens and a 256-token local window. FlexAttentio…
A developer indexed 37 hours of video content using an NVIDIA RTX 4090 and local ML models in 24 hours, processing long podcast episodes, coding tutorials, and screen recordings. The RTX 4090 signific…
A developer indexed 669 GB of GoPro footage from a cycling journey using local machine learning models on an M1 Max computer, enabling search and direct timeline integration with DaVinci Resolve. The …
A developer successfully configured a local coding agent on macOS using Gemma 4 26B-A4B and Qwen3.6 35B-A3B models with llama.cpp, achieving 72.2 tokens per second generation speed through MTP specula…