Thinking Machines Lab released Inkling, a new multimodal mixture-of-experts model for token-efficient reasoning and native multimodal understanding, and Together AI made it available on its inference …
AI agent infrastructure is maturing but facing reliability challenges, as FlashAttention-4 achieves 71% utilization on NVIDIA's Blackwell B200 GPUs while agentic AI systems grapple with architecture q…
An analysis of frontier AI model release cadence shows Anthropic and OpenAI accelerating their release rates since 2023, while Google, Meta, and DeepSeek have not. The pattern is consistent with a for…
Researchers from Princeton University, Together AI, Meta, Colfax Research, NVIDIA, and Georgia Tech introduced FlashAttention-4, an algorithm and kernel co-design that optimizes attention for Blackwel…
Modal AI engineers Charles Frye and David Wang optimized FlashAttention-4 for large language model inference, focusing on decode-heavy workloads dominated by memory bandwidth-limited token generation.…