Guillermo Rauch on X: "Based on internal evals:

▪️ Kimi K3 is top-tier at cybersecurity<br>There is chatter on X that Moonshot benchmark-overfit. These are stealth evals. Model has raw IQ.

▪️ Sol is a leap ahead in cyber capability<br>At a significantly higher cost, but quite remarkable still.

▪️ Fable" / X<br>Post

Log inSign up

Post

Guillermo Rauch

@rauchg

Based on internal evals:

▪️ Kimi K3 is top-tier at cybersecurity<br>There is chatter on X that Moonshot benchmark-overfit. These are stealth evals. Model has raw IQ.

▪️ Sol is a leap ahead in cyber capability<br>At a significantly higher cost, but quite remarkable still.

▪️ Fable refuses everything<br>We couldn’t get it to complete the run at all. What’s interesting is that Sol in comparison was much more open to helping with defensive cyber hardening

TL;DR: frontier, open-weight cybersecurity capability is here. Try it on deepsec.sh for defensive purposes.

span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0 min-w-0 overflow-hidden">Malte Ubl

@cramforce

11h

We ran Kimi K3 on a private cybersecurity benchmark.

TL;DR: Kimi K3 is the workhorse for cyber security tasks at great recall/precision/price. GPT 5.6 is best recall/precision but at 7x higher cost per run.

For context, Deepsec.sh is an open-source cyber harness Show more

span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">1:06 AM · Jul 19, 2026207.3KViews

69069<br>1210121<br>2K02K<br>7780778

Read 69 replies

New to X?<br>Sign up now to get your own personalized timeline!<br>Sign up with GoogleSign up with AppleCreate account<br>By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Relevant people<br>Guillermo Rauch@rauchgFollow

Don't miss what's happening<br>People on X are the first to know.

Log inSign up

Trending now