02:58
2026-07-16
discuss.huggingface.co
machine-learning
My latest ablation run: integrating Engram onto two backbones
A researcher at OLMo-core ran a 200-step, ~1.7B-parameter ablation comparing Engram on a standard Transformer versus a GDN hybrid backbone, finding that the Transformer achieved slightly lower loss an…