PrismML's 1-bit quantized Bonsai 27B model, weighing 3.9 GB, runs on a consumer GPU with an NVIDIA GeForce RTX 5060, achieving 10-20 tokens per second on average, but slower than smaller models like Q…
In a personal benchmark of local and frontier LLMs for his 'Digital Nervous System', the author tested Qwen 3.6 35B-A3B, Qwen 3.6 27B, Bonsai 27B, DeepSeek V4 Flash, Laguna 2.1S, Claude Sonnet 5, and …
Prism ML, a Caltech spinout, compressed the 27-billion-parameter Qwen 3.6 model to under 4GB, fitting entirely on a phone. Testing showed the compressed models lost specific factual knowledge but perf…
A developer testing Nanbeige 4.2, a 3-billion-parameter looped-transformer model from a Chinese company, found it well-suited for tool calling with a Rust MCP server, outperforming Gemma 4 12B in that…
Bonsai 27B is a 27-billion-parameter large language model using 1-bit quantization (BitNet b1.58 architecture) that compresses to roughly 4GB, enabling it to run entirely on a high-end smartphone or l…
PrismML CEO told CNBC that Apple is interested in the startup's technology, coinciding with the release of its Bonsai 27B model designed to run on iPhones, iPads, and Macs. The AI startup's press rele…
RightNow AI open-sourced bonsai-turbo, a batch-1 decode engine that runs PrismML's Bonsai 27B ternary LLM 1.76x faster than the official llama.cpp fork on an H100, achieving 151 tok/s (ternary) and 15…
PrismML released Bonsai 27B, a 27-billion-parameter AI model compressed to 3.9 GB that runs on an iPhone 17 Pro Max at 11 tokens per second, the first model at that capability tier to fit on a smartph…
PrismML has compressed a 27-billion-parameter AI model to under 4 GB, small enough to run on an iPhone, with the smallest version retaining 90 percent of original performance in benchmarks. Apple is r…
PrismML, a Caltech spinout, compressed Alibaba's Qwen3.6-27B AI model from 54 gigabytes to 3.9 gigabytes using 1-bit and ternary quantization, enabling it to run natively on an iPhone 17 Pro at 11 tok…
PrismML released Bonsai 27B, a 27-billion parameter AI model compressed to 3.9GB via native 1-bit training that runs on an iPhone 17 Pro at 11 tokens per second, but developers report tool-calling reg…
PrismML shipped Bonsai 27B, a 27B-parameter model based on Qwen3.6 27B, with a 1-bit variant packing to 3.9 GB that fits on an iPhone 17 Pro, clearing the memory gate that blocked prior builds of this…
PrismML released Bonsai 27B, claiming it is the first major AI model of its size that can run on an iPhone, iPad, or Mac, with a 1-bit version fitting in about 4 GB of memory. PrismML CEO Babak Hassib…