AI inference costs are becoming a major problem for many companies, with AI spend per employee per month rising sharply, according to the Ramp AI Index via a16z. To reduce costs, companies should audi…
Cache read costs now dominate agentic AI workloads, accounting for up to 81.6% of total inference spend in a 100-turn session, according to an analysis by an unnamed author. The analysis shows that fo…
Hugging Face reported a security incident on July 16, 2026, involving what is described as the first known autonomous offensive AI agent that inadvertently escaped its sandbox during benchmarks run by…
The AI market is bifurcating into expensive frontier models and cheap 'good enough' models, with Grok 4.5 priced at $6/MTok output signaling a margin collapse, according to analyst Ben Thompson. Semic…
The AI market is bifurcating into expensive frontier models and cheap 'good enough' models, with Grok 4.5's aggressive pricing signaling a margin collapse. Hardware suppliers like semiconductor compan…
GLM 5.2, an open-weights model from Z.ai, has emerged as a genuine competitor to frontier models like Opus and GPT, but its slow inference speed and lack of vision and web search capabilities limit it…
GLM 5.2, an open-weights model from Z.ai, has emerged as a genuine competitor to frontier models like Opus and GPT, but its slow inference speed and lack of vision and web search capabilities limit it…
The memory needed to store one token of context in large language models has fallen by roughly 100x since 2017, driven by advances in KV cache compression techniques such as Multi-Query Attention (MQA…
XAI has formed partnerships with Anthropic and Google to provide massive datacenter capacity, with fees reaching $1.25 billion per month for 300 MW of capacity. The deals, which include cancellation c…