Llama 70B

Etched AI, a chip startup founded in 2022, exited stealth on June 30, 2026, unveiling its transformer-only ASIC, Sohu, which the company claims delivers 500,000 tokens per second on an 8-chip server f…

VLLM's slack-aware preemption policies rescued urgent request attainment at high load in a benchmark on 6× A100 SXM4 80GB GPUs running Llama 70B, where the control policy collapsed to 0% urgent attain…

Etched, a chip startup founded by three Harvard dropouts, closed a $300 million Series C at a $10.3 billion valuation on July 23, led by Sequoia, to produce its Sohu ASIC that hardwires transformer mo…