Kimi K3 Architecture Notes
Kimi K3, a 2.8-trillion-parameter open-weight model from Moonshot AI, is the largest open-weight model to date, scaling up their earlier Kimi Linear architecture from 48B parameters. The architecture …
Kimi K3, a 2.8-trillion-parameter open-weight model from Moonshot AI, is the largest open-weight model to date, scaling up their earlier Kimi Linear architecture from 48B parameters. The architecture …
LM Studio Bionic, the agentic workflow platform for open models, now supports Moonshot AI's Kimi K3, a 2.8-trillion-parameter model with a 1-million-context window. The addition gives users access to …
DeepSeek V4 matches Claude Opus 4.8 on crowd approval at 57% and beats it on SWE-bench Verified (80.6% vs 69.2%), but costs 28.7x less at $0.87 per million output tokens versus $25. However, DeepSeek'…
Moonshot AI's new open-weights LLM Kimi K3 is not cheap, costing slightly less per task than OpenAI's top model but double the cost of GLM-5.2 and about 20 times more than DeepSeek V4, according to Ar…
A 1.6 trillion parameter model like DeepSeek V4 can run on a laptop by keeping 97% of its parameters asleep and streaming experts from disk, according to a technical analysis that includes a complete …
Moonshot AI will release the full open weights of its Kimi K3 model on Sunday, July 27 — a 2.8-trillion-parameter Mixture-of-Experts model with a 1-million-token context window and native vision that …
Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weight model with a 1-million-token context window, priced at $3/$15 per million input/output tokens — matching Claude Sonnet 4.x pricing an…
Nvidia on July 1 announced software optimizations that boost token throughput by up to 5x for DeepSeek V4 on Blackwell systems, with throughput improvements reaching 20x compared to baseline configura…
A developer introduced Logical Word Count, a cheap, tokenizer-free measure of text length that stays roughly proportional to LLM token counts across languages, code, and mixed content. The method uses…
Chinese developers are paying premium prices for OpenAI's GPT-5.6 via VPNs, despite it being blocked in mainland China, because the model's efficiency reduces total token usage and cost for complex ta…
GMI Cloud reported on July 7th that Tencent's Hy3 model outperformed GLM 5.1 and DeepSeek V4 in a small internal web design test, highlighting a shift in developer workflows toward task-specific open …
A developer has released an open-source starter kit that integrates DeepSeek V4 into Claude Code, featuring nine custom agents, seven behavior rules, security hooks, local OCR, and auto-backup. The ki…
NVIDIA's full-stack inference software, codesigned with its hardware, has reduced token costs by up to 5x on the DeepSeek V4 model in one month on the Blackwell platform. Companies like Baseten, Cogni…
DeepSeek announced the official release of DeepSeek V4 in mid-July, featuring a 1-million-token context window and enhanced performance in agent tasks, math, and code generation. The company will intr…
A developer warns that DeepSeek's response API is not compatible with OpenAI's Responses API, and that a common parsing mistake can silently drop the `reasoning_content` field. DeepSeek V4 models use …
A developer observed that after multiple context compactions in LLM sessions, output quality degrades non-linearly, with a brief improvement after the second compaction before declining. They built a …
A developer in a Discord group exhausted his Codex subscription in 11 days building a billing feature, while the author runs a full AI stack for $10-15/month. The author argues that benchmark scores o…
A developer built OpenCode Nexus, an open-source multi-agent workflow plugin for OpenCode that prevents context loss and enforces two-stage code reviews. The plugin uses four specialized agents—Orches…
Microsoft is shifting Copilot Cowork to usage-based pricing and testing a self-hosted version of DeepSeek V4 as a lower-cost alternative to Anthropic and OpenAI models, with a roughly 57x price gap pe…
HagiCode integrated Reasonix 1.x with DeepSeek V4, revealing a semantic migration challenge where startup parameters were reduced to a single `-model` flag, with credentials and policies moved to `rea…