Kimi K3 is top-tier at cybersecurity

Moonshot AI's Kimi K3 model achieved top-tier performance on a private cybersecurity benchmark, outperforming competitors in recall, precision, and cost-efficiency. The evaluation also highlighted Sol's advanced cyber capabilities at a higher cost, while Fable refused to complete the benchmark entirely.

Based on internal evals: ▪️ Kimi K3 is top-tier at cybersecurity There is chatter on X that Moonshot benchmark-overfit. These are stealth evals. Model has raw IQ. ▪️ Sol is a leap ahead in cyber capability At a significantly higher cost, but quite remarkable still. ▪️ Fable refuses everything We couldn’t get it to complete the run at all. What’s interesting is that Sol in comparison was much more open to helping with defensive cyber hardening TL;DR: frontier, open-weight cybersecurity capability is here. Try it on deepsec.sh http://deepsec.sh for defensive purposes.We ran Kimi K3 on a private cybersecurity benchmark. TL;DR: Kimi K3 is the workhorse for cyber security tasks at great recall/precision/price. GPT 5.6 is best recall/precision but at 7x higher cost per run. For context,