05:59
2026-08-25
dev.to
artificial-intelligence
A Wider Computer, Not a Bigger One: Modeling AI Inference Across Millions of Homes
An engineer modeled a distributed AI inference fleet across millions of homes, called HEARTH, and found that it is only economically viable for small models like 8B, not for larger ones like 32B or 70…