Three independent benchmarks show that expensive AI defaults are rarely optimal: medium reasoning effort captures nearly all of Claude Opus 5's bug-fix gains, a three-model open-weight jury (GPT-OSS 1…
Baseten, an AI infrastructure company, has raised a $13 billion Series F round, becoming one of the new AI infrastructure decacorns. In a recent episode of the Latent Space podcast, Baseten's Philip K…
Baseten, an AI infrastructure company that recently raised a $1.5B Series F led by Altimeter Capital, Conviction Partners, and Spark Capital, is hiring an AI Inference Engineer in San Francisco with a…
NVIDIA Dynamo, an Apache-2.0 datacenter-scale inference orchestration layer from NVIDIA, sits above vLLM, SGLang, and TensorRT-LLM to coordinate multi-GPU clusters, with published benchmarks showing u…
Thinking Machines' Inkling, a 975B total / 41B active MoE model with Apache 2.0 license and 1M context, is being trialed via a bash wrapper alias 'claude-inkling' that bridges Anthropic's CLI to the O…
The latest version of the Model Context Protocol (MCP) introduces a stateless protocol core, shifting from a bidirectional stateful protocol to a request/response model, according to lead maintainers …
A Baseten inference engineer known as @waterloo_intern published a technical blog post titled '22,580: From GPT-2 to Kimi K3, Explained,' which has garnered 2.4 million views. The post provides runnab…
The marginal cost of AI inference will approach zero as open models rival frontier models, reshaping the business models of labs like OpenAI and Anthropic toward low-margin inference sales, according …
Baseten model performance engineer Michael Feil shipped Baseten Tokenizer, a Rust-backed package that cuts CPU time for preparing long prompts for Moonshot AI's Kimi K3 model, achieving up to 18x fast…
Baseten has launched day-0 API support for Kimi K3, a new open frontier model from Moonshot AI with 2.8 trillion parameters, making it the largest open model to date. The API runs on NVIDIA GB300 NVL7…
Moonshot AI's Kimi K3 and Kimi K3 Fast models are now available on Vercel's AI Gateway from US-based providers including Baseten and Fireworks, with Zero Data Retention (ZDR) support. The models run o…
Baseten leads the public GLM-5.2 inference speed table with 602.8 output tokens per second, roughly 31% faster than Blackbox AI at 460.4 tokens per second, according to Artificial Analysis median meas…
Baseten has built the fastest API for GLM-5.2, achieving peak speeds of 280 tokens per second and average speeds around 100 tokens per second, more than double the performance of the launch-day API as…
Sarah Guo, who became Greylock's youngest general partner at 28 and left four years later to found Conviction, staked her firm entirely on AI before ChatGPT launched, with pre-ChatGPT seed checks into…
Gas prices have risen above $4 per gallon, with potential for further increases due to developments in the war with Iran, according to Matt Smith, Director of Commodity Research at Kpler. Meanwhile, C…
Inference startups Fireworks, Baseten, and Together AI collectively raised $3.8 billion in four weeks, signaling that inference has become a control point in the AI industry, according to Forbes contr…
Nvidia on July 1 announced software optimizations that boost token throughput by up to 5x for DeepSeek V4 on Blackwell systems, with throughput improvements reaching 20x compared to baseline configura…
NVIDIA announced a new financing model combining revenue sharing with credit support to help AI cloud providers build GPU infrastructure for startups and enterprises. The initiative, detailed in a Jul…
A developer's benchmark of frontier AI models on a 3D modeling task found Anthropic's Opus 4.7 outperformed Gemini 3.1, GPT 5.5, and Kimi K2.6 in weighted score, speed, and cost, contradicting public …
Nvidia and LangChain released the NemoClaw for LangChain Deep Agents blueprint on July 8, combining Nvidia's Nemotron 3 Ultra model with LangChain's Deep Agents framework to achieve benchmark-leading …