DropItDown, a free macOS app for Apple Silicon, converts any file dropped onto its menu-bar icon into clean Markdown locally, with on-device OCR for images. The Markdown is filed into a user-specified…
A developer built Squish, a local LLM inference server for Apple Silicon, after finding existing tools like Ollama too slow for generating git commit messages. Squish achieves up to 9.8× faster perfor…
A developer built CORE, a cognitive system using Cl(4,1) Conformal Geometric Algebra to make incoherence algebraically impossible. Unlike large language models that monitor and correct for coherence, …
Mariana Souza published a tutorial on quantizing and running Meta's Llama 3.2 3B model on Apple Silicon using llama.cpp with Metal GPU acceleration, achieving local inference with Q4_K_M quantization.…
A new open-source tool called mlx-chronos provides a standardized benchmark suite and community leaderboard for comparing local LLM inference engines on Apple Silicon Macs. The tool runs reproducible …
Poly Grid, a tiling multi-terminal grid for macOS, launches to let developers run AI coding agents like Claude Code and Codex in parallel, with features for broadcasting prompts and piping panes. The …
Flama 2.0 introduces a CLI tool that allows users to download, package, and serve large language models from HuggingFace with a single command, including a built-in chat interface and production-ready…
OpenAI's Whisper speech recognition model can run locally on a laptop CPU in real time, enabling offline dictation without sending audio to cloud servers. Off Grid AI Desktop is a free, open-source ap…
Off Grid AI Desktop is a free, open-source app that records and transcribes meetings locally on Mac or PC using OpenAI's Whisper model, ensuring audio never leaves the machine and eliminating per-minu…
Off Grid AI Desktop is a free, open-source app that runs chat, image generation, and voice directly on Apple Silicon Macs, using unified memory and Metal GPU acceleration. It supports models like llam…
Off Grid AI Desktop is a free, open-source app that runs large language models locally on Apple Silicon Macs, leveraging unified memory for GPU inference. The app supports models like Gemma and Qwen, …
A new guide compares the best Mac meeting notes apps for 2026, focusing on local AI tools that process data on-device versus cloud-based alternatives. The analysis highlights privacy, accuracy, and co…
Developer y-times-y released Y, an open-source desktop coding-agent app built with Electron that allows users to modify its own interface through a protected Modify surface while running local agents …
Palmier, Inc. released Palmier Pro, an open-source macOS video editor built with Swift that integrates AI generation and MCP-based agent collaboration directly into the timeline. The editor is free fo…
Alloy, a new PyTorch backend and inference engine for Apple Silicon, has been released as a technical preview. The open-source project compiles Python GPU kernels to Metal and supports LLM serving wit…
Apple introduced Core AI at WWDC 26 as the successor to Core ML, designed to run large language models and generative AI on-device using Apple Silicon. The framework segments Apple's ML ecosystem into…
Apple announced Core AI at WWDC26 as the successor to Core ML, a developer framework for running large language models and generative workloads optimized for Apple Silicon with on-device performance a…
Apple announced Core AI, a new framework for running generative AI models on-device, at WWDC 26. The framework supports large language models up to 70B parameters and runs exclusively on Apple Silicon…
Trace, a $9.99 offline transcription utility for macOS, captures system and microphone audio, performs speaker diarization, transcribes using a local speech model, and generates summaries via Apple In…
A developer built a private mental health assistant using Llama 3 and Apple MLX that runs entirely on a MacBook, ensuring no data leaves the device. The system uses a 4-bit quantized version of Llama …