Running a fitness app with local AI is a massive headache
A developer's field notes detail the implementation of on-device tool calling in a fitness app using the Needle 2 model, a 45M-parameter, 2-bit quantized model that runs entirely on CPU with about 28 …