Put the LLM last: I replaced a 7B model with a tiny Go classifier
A developer replaced a 7-billion-parameter LLM with a tiny Go classifier for email triage, achieving sub-millisecond inference on CPU with no GPU. The system uses deterministic rules first, then a TF-IDF and logistic reg…