Mozilla AI's benchmarking study of four local LLM servers — llama.cpp, llamafile, LM Studio, and Ollama — found that build flags and configuration choices drive up to 63% performance gains, while the …
A developer has detailed a methodology for building a fully offline, portable AI assistant that runs from a USB drive on an Apple M4 Mac mini with 16 GB RAM. The approach leverages llamafile and GGUF …
A developer has published a step-by-step guide for running a 4B-parameter LLM locally on a Windows 10 PC using Mozilla's llamafile tool and a Qwen3 model from Hugging Face. The guide details downloadi…
A developer has published a step-by-step guide for running a 4B parameter LLM locally on a Mac, using Mozilla's llamafile and a fine-tuned Qwen3 model from Hugging Face. The process involves downloadi…
Mozilla's llamafile v0.10.5 release adds support for two large local models: the 6GB Ternary Bonsai 27B and Poolside's 118B Laguna-S-2.1 coding MoE, by syncing with a more recent llama.cpp core. The u…
Kdeps, a new CLI coding agent that runs on open-weight models and is a member of the NVIDIA Inception program, allows developers to run AI workflows locally or deploy them as Docker, Kubernetes, or a …
Kdeps, a CLI coding agent that runs on llamafile and/or GGUF, enables building and deploying AI agents in YAML with workflow (DAG pipelines) and agent (autonomous LLM loop) modes. The open-source tool…
Mozilla.ai announced the release of transcribe.cpp, an open-source C/C++ speech-to-text inference library with GPU-accelerated support for multiple STT models. Developed through the Builders in Reside…