17:09
2026-08-16
sourcefeed.dev
artificial-intelligence
Fine-Tuning Can't Teach What Pretraining Never Saw
Researchers at the Max Planck Institute for Intelligent Systems, ELLIS Tübingen, and ETH Zürich built LittleLearner, a 5B-parameter language model pretrained exclusively on 88 billion tokens of U.S. e…