Based on the article, the author tested four Chinese AI APIs—DeepSeek, Qwen, Kimi, and GLM—to determine which offers the best value for money. DeepSeek V4 Flash is highlighted as the top choice for En…
Modular has built a new data layer for LLM inference routing that solves the problem of querying cached blocks across hundreds of pods in microseconds. The company's architecture uses a specialized da…
A checklist the author uses when testing a new OpenAI-compatible LLM gateway, which helps catch integration failures before moving real workloads. For Chinese models like Qwen, DeepSeek, GLM, and Kimi…
Malte Buettner benchmarked bounding box accuracy for Document AI models using pages from the FlashAttention-3 paper, testing Qwen, Kimi, and Mistral via OpenRouter. The evaluation scored models on cov…
Modular announced that traditional HTTP-era load balancing algorithms like round-robin, consistent hashing, and least-connections are inadequate for large language model inference because GPU pods are…