Needle 3: Running a Tiny On-Device Tool-Calling AI Model
Cactus Compute released Needle 3, a single-file on-device foundation model that ships between 8 and 29 MB depending on layer depth and handles tool calling, structured extraction and text embeddings without a server roun…