Show HN: Cactus v2 – On-device AI with cloud fallback
Cactus released version 2 of its on-device AI inference platform, featuring model confidence-based routing to cloud fallback, lossless 4-bit quantization, and GPU acceleration on Apple Metal. The plat…