cd/entity/JenWei0312· home› entities› JenWei0312
grep -l @jenwei0312 /news/*.json | wc -l → 1

JenWei0312

mentions 1 type Organization feed RSS

// recent coverage 1 mentions

02:58
2026-07-16
discuss.huggingface.co
machine-learning

My latest ablation run: integrating Engram onto two backbones

A 200-step, ~1.7B-parameter ablation run in OLMo-core comparing Engram on a standard attention Transformer versus a 3 GDN-layer + 1 attention-layer hybrid found that Transformer + Engram reached sligh…

// co-occurs with top 7 entities
Engram 1 OLMo-core 1 Transformer 1 GDN 1 FLA 1 Triton 1 Weights & Biases 1
// topics top 4 topics
machine learning 1 neural networks 1 ai research 1 developer tools 1