02:03
2026-09-10
scaledcognition.com
machine-learning
Prompt Trees: Training-Time Prefix Caching
A new method called prompt trees encodes shared prefixes in transformer training in a single forward pass, delivering speedups of over 70x compared with training without prompt trees on realistic dataβ¦