04:42
2026-08-02
news.ycombinator.com
large-language-models
Strangers pretrained a language model with HF PRs and a cron job
A group of researchers pretrained a 15M-parameter language model from scratch using a GitHub Actions cron job as the training coordinator and pull requests as gradients, with no dedicated cluster or b…