Kimi K3.1 Pro for Code Analysis

A hands-on test of Kimi K3.1 Pro on OpenRouter found the model took about 4 minutes and cost roughly $0.08 to analyze a small Rust function and return a simpler version, a cost the tester called somewhat expensive for the task. The tester noted the Rust rewrite's measured performance gain was tiny, 0.1% in a micro-benchmark, and that Kimi K3.1 Pro's value lies in its planned availability as an open-weights model that can run locally rather than in online performance or cost. The tester said open-weight models like Kimi K3.1 appear to deliver comparable results, a concern for Anthropic.

When a new model is released, it is interesting to test it out to see how the LLM landscape is changing. If you are considering buying Anthropic IPO stock I am not this can also be worthwhile. I tried Kimi K3.1 Pro on OpenRouter and had it analyze a small Rust function . Kimi K3.1 Pro took about 4 minutes to analyze the code and returned a simpler version. It was not sure if the new Rust function would be faster, due to the complexities of compiler optimizations. The cost was about $0.08, which is somewhat expensive for this sort of task. • The performance gain from the Rust function when it can be measured is tiny 0.1% in a micro-benchmark . • The value of Kimi K3.1 Pro is not in its performance online, or its costs, but that it will be available as an open-weights model available to run locally. • As far as Anthropic goes, I would be concerned—open-weight models like Kimi K3.1 seem to have comparable results.