Managing a small local AI budget (Mac M2 16gb)
Millfolio's local AI budget on a Mac M2 with 16GB RAM uses a batch-oriented design where the model's judgment is computed once and stored as tags, not run at query time. Tags come in three flavors—string, reference, and …