LM Studio, a free desktop application for running local large language models, serves models over an OpenAI-compatible API at http://localhost:1234/v1 and also speaks the Anthropic API, letting Claude…
A developer running an automated content pipeline on a Mac mini with 48GB of unified memory switched from a cloud LLM API to a local model after the provider's free tier rate limit dropped from 60 to …
LabLLM, a free native macOS app built with SwiftUI and Apple MLX, lets users train small GPT-style Transformer and LLM models from scratch on Apple Silicon (M1 or newer, macOS 14+). The beta supports …
Meta AI Research has released Muse Glimmer, a 30-billion-parameter open-weight model under the Apache 2.0 license, designed for on-device agentic execution on consumer GPUs. The model uses 4-bit dynam…
Pipe Network published an Apple MLX port of Moonshot AI's 2.8 trillion-parameter Kimi K3 model on July 28, reducing the model from roughly 1.56TB on disk to as little as 350GB, allowing a heavily prun…
Prince Canuma, maintainer of the mlx-vlm library, released Nativ, an MIT-licensed macOS app that provides a polished GUI for running local MLX models and exposes both OpenAI-compatible and Anthropic-c…
Prince Canuma, the maintainer of mlx-vlm, released Nativ, an MIT-licensed macOS app for local AI inference, on the day of its v0.0.1 launch. The app bundles an mlx-vlm server, pulls models from Huggin…
Christopher 'CJ' Pais, creator of the desktop dictation tool Handy, released transcribe.cpp on June 30 as an MIT-licensed C/C++ library that unifies local speech-to-text inference across macOS, Window…
A developer built a private mental health assistant using Llama 3 and Apple MLX that runs entirely on a MacBook, ensuring no data leaves the device. The system uses a 4-bit quantized version of Llama …