03:00
2026-08-17
hiraditya.github.io
ai-infrastructure
Prefill and Decode Want Different Computers
AWS is pairing its Trainium chips with Cerebras CS-3 systems to split transformer inference into prefill and decode phases, with Trainium handling prefill and Cerebras handling decode, shipping as a pβ¦