Hugging Face released Transformers v5.17.0 on September 9, adding seven model architectures in a single minor release, including Tencent's 780-billion-parameter mixture-of-experts model and Moonshot A…
Ollama, the open-source tool for running large language models locally, has released a new version that adds a 'launch' command to connect with AI agents and applications such as Claude Code, Codex, C…
GGML, a small math library created by Georgi Gerganov, underpins llama.cpp and is designed for CPU inference on constrained hardware, using a computation-graph-first approach that pre-allocates memory…
A developer has detailed a methodology for building a fully offline, portable AI assistant that runs from a USB drive on an Apple M4 Mac mini with 16 GB RAM. The approach leverages llamafile and GGUF …
Llama.cpp, the engine behind Ollama and LM Studio, has launched llama.app, an official website with a hardware-detecting one-line installer and a unified `llama` binary, backed by Hugging Face, which …
NVIDIA's DGX Spark, a $4,699 desktop AI supercomputer with 128GB unified memory, launched in 2025, offering one petaflop of FP4 performance. Benchmarks show it excels at prompt processing but lags in …
Georgi Gerganov, creator of llama.cpp, predicts that 90% of AI agents will move from cloud to local inference. He demonstrated running a 70B-parameter model locally with a single command, highlighting…
A Reddit post titled 'Stop using Ollama' gained 1,175 upvotes on r/LocalLLaMA, sparking community discussion about the local AI tool's shortcomings. Critics cite Ollama's failure to credit llama.cpp i…
Georgi Gerganov, creator of llama.cpp, reported that the Qwen3.6-27B model is highly capable for local coding tasks, using it daily on his M2 Ultra and RTX 5090 systems. He noted the model's utility f…