Apple's upcoming M6 and M5 Ultra chips will redefine local AI by delivering massive increases in unified memory bandwidth and dedicated transformer silicon, according to a report. The new architecture…
Local-first workspace software can eliminate the need for cloud indexing by leveraging on-device AI and search capabilities, according to a guide from Neutron Tech. Modern hardware such as Apple Silic…
VoxHearth, an open-source macOS menu bar app for private dictation, records audio in memory, transcribes with a bundled Core ML model, and inserts text into the focused app, with no account, telemetry…
Maple-Preview, a 20B parameter Mixture-of-Experts transformer quantized to ternary weights, achieves 120 tokens per second on an iPhone, according to a developer preview. The model, which runs on Appl…
A developer with 18 years of iOS experience built AIAnalyzer, a Swift CLI tool that detects architectural code smells and offers AI-generated fix suggestions through a hybrid system that decides wheth…
DictaFlow's Local Offline Mode enables dictation on Windows, Apple silicon Macs, and iPhones without an internet connection using on-device models like NVIDIA's Parakeet TDT 0.6B v3, while competitor …
A developer built a Swift 6 actor topology that routes on-device inference requests between MLX's GPU compute and Core ML's ANE scheduler on Apple Silicon, achieving sub-50ms first-token latency on qu…
Swipe Cleaner, an iOS app built on the OpenNomos ecosystem, processes all photo cleaning tasks on-device using Apple's Core ML and Vision frameworks, ensuring no user data leaves the device. The app e…
A developer presents a hybrid edge AI architecture for mobile applications that performs intent classification locally using a lightweight machine learning model, reserving cloud-based LLMs for ambigu…
A developer built an AI-powered photo management app called Swipe Cleaner using SwiftUI and Core ML after struggling with storage issues on their iPhone. The app uses on-device processing with Vision …
Swipe Cleaner, part of the Opennomos ecosystem, processes all photo cleaning entirely on-device using Core ML, Vision, and Metal, with no network requests for photo processing. The app's architecture …
Apple's decade-long investment in custom silicon, including neural processing and unified memory, has positioned its devices as the preferred platform for AI developers, with Macs dominating frontier …
OpenAI Whisper has 12 unique checkpoint files, but the Python package exposes 14 local model names due to aliases for 'large' and 'turbo'. Additional confusion arises from runtimes and converted forma…
Researchers reverse-engineered the Apple Neural Engine (ANE), documenting its architecture, programming interface, and performance across A11-A18 and M1-M5 chips. The study reveals a direct user-space…
Apple is skipping the high-end M6 Pro and Max chips to fast-track its M7 family, aiming to deliver a massive leap in memory bandwidth and Neural Engine capacity for on-device AI. The base M7 will offe…
Duration AI successfully ran PrismML's Bonsai Image model on a 2020 iPhone 12 Pro using mlx-swift, generating 512x512 images in two to three minutes despite thermal throttling. The prototype demonstra…
Apple introduced Core AI at WWDC 26 as the successor to Core ML, designed to run large language models and generative AI on-device using Apple Silicon. The framework segments Apple's ML ecosystem into…
Apple announced Core AI at WWDC26 as the successor to Core ML, a developer framework for running large language models and generative workloads optimized for Apple Silicon with on-device performance a…
Apple announced Core AI, a new framework for running generative AI models on-device, at WWDC 26. The framework supports large language models up to 70B parameters and runs exclusively on Apple Silicon…
A developer built MailBroom, an iPhone email cleaner that runs AI entirely on-device, claiming it is 88% greener than cloud alternatives. The app processes emails locally using Core ML, avoiding data …