Bonsai 27B parameters. 1-bit weights. In your browser

A new AI model called Bonsai with 27 billion parameters and 1-bit weights can now run directly in a web browser, as demonstrated by the WebML Community on Hugging Face. The model's extreme quantization enables on-device inference without server-side computation.

Article URL: https://huggingface.co/spaces/webml-community/bonsai-webgpu-kernels Comments URL: https://news.ycombinator.com/item?id=49012329 Points: 1 Comments: 0