Optimizing prompt cache
Prompt caching can reduce the cost per task for LLM API calls by reusing the expensive prefill computation for repeated input prefixes, with cache hits skipping the heavy computation and lowering time…
Prompt caching can reduce the cost per task for LLM API calls by reusing the expensive prefill computation for repeated input prefixes, with cache hits skipping the heavy computation and lowering time…
A developer has published a guide for configuring Anthropic's Claude Code CLI to route requests through OpenRouter, enabling the use of DeepSeek's v4 Flash model instead of Anthropic's default models.…
Figma's latest earnings show the company continues to thrive, reinforcing that SaaS remains viable in the AI era, while Amplitude also reported strong quarterly results. Meta introduced a new coding-f…
Netlify now supports open-weight AI models including DeepSeek, Qwen, GLM, and Kimi through partnerships with OpenRouter and OpenCode, giving every customer full model freedom via Agent Runners and AI …
AI has become a commodity, with DeepSeek V4 Flash costing $0.13 per million input tokens and $0.26 per million output tokens via OpenRouter, and TIME is serving AI crawlers a stripped-down markdown ve…
Protopia AI's Stained Glass Transform (SGT) lets users send obfuscated embeddings instead of raw text to hosted LLM endpoints, preserving utility while making the original prompt hard to reverse-engin…
Meta has shipped Muse Code, its first coding agent, in beta, alongside Muse Spark 1.2, a co-trained model with a 1 million-token context window. The agent, available via the Meta Model API, is priced …
Pokee AI released Pokee-Isaac 28B, a 28B-parameter proprietary non-decoder-only model claiming a 10M-token context that fits on a single RTX 4090 (24GB) in quantized form. Vendor-reported benchmarks i…
Nous Research's open-source Hermes Agent, an autonomous AI agent that runs as a persistent daemon and integrates with 20+ messaging platforms, offers a self-improving memory loop and 70 built-in tools…
BoundaryBench, a new open-source benchmark from the developer community, measures how much capability coding agents lose when running inside enterprise/NIST-derived hardened sandboxes, with live resul…
A developer has released LearnOS, an open-source, AI-native course platform that runs locally and generates personalized courses from current public material, contrasting with Coursera's $100M investm…
ModelPlane, a new OpenAI-compatible gateway, lets developers route AI requests across OpenAI, Anthropic, DeepSeek, OpenRouter, and custom services through a single API, with features like model groups…
Tencent has integrated its Hy3 large language model into the international edition of WorkBuddy, offering free access until Aug. 31, 2026, Pacific Time. Hy3 has 295 billion total parameters, 21 billio…
Tencent Cloud opened global access to its Hy3 reasoning model on August 5, integrating it into WorkBuddy, Tencent Design Miora, and Tencent Cloud TokenHub, alongside API access and downloadable weight…
DeepSeek V4 Flash ranked first in OpenRouter's weekly model-usage ranking for July 27 to Aug. 2, processing 7.22 trillion tokens on the multi-model aggregation platform. On Aug. 1, the model processed…
Researchers introduced JudgeArena, an open-source framework unifying major LLM-judge benchmarks (AlpacaEval, Arena-Hard, MT-Bench, and m-Arena-Hard) under a single interface with swappable judges and …
OpenAI is a deeply mismanaged company without a real competitive advantage, and its main differentiation is price, making models commodities, according to a Hacker News post. The post argues OpenAI's …
Tencent Holdings rolled out its flagship artificial intelligence model Hy3 to global developers, enterprises, and users through WorkBuddy, Tencent Design Miora, and TokenHub, with free access on WorkB…
RouterFuel, an open-source AI gateway, is now in open beta, offering a single async proxy layer for 330+ models via direct integration and OpenRouter, with features like vector-based caching that cuts…
A developer built a Go CLI that benchmarks LLMs via OpenRouter's API, testing accuracy, instruction following, tool calling, and JSON compliance. In a comparison of free-tier models, the smaller Ling …