On Kimi K3: Its Capabilities And Related Discontents | Don't Worry About the Vase
Don't Worry About the Vase
Trying to dig out from minus a million points
Skip to content
Home<br>About
← Demis Hassabis on the New Coming Age
OpenAI Shares Some Alignment Problems →
On Kimi K3: Its Capabilities And Related Discontents
Posted on July 20, 2026 by TheZvi
Kimi K3 is a very good model with excellent benchmarks. Assuming its weights are released as planned it will become, purely in terms of raw capability, the strongest open model.
Do not get carried away. Do not judge Kimi K3 only its relative strengths. In aggregate it is several months behind the closed model frontier, at least four and my median guess is six, with the post-training closer and the pre-training farther out. This is less months than before, but the months are denser now.
It is somewhat distilled. It likely outperforms on benchmarks relative to practical performance. All its benchmarks are scored at maximum effort, typically a lot more tokens than are used in similar tests by Fable or Sol. Performance looks jagged. Kimi will be excellent at some things, less so at other things.
We will know more over the coming weeks. For now access is spotty and not that many people have actually had the chance to try Kimi K3, so I have larger error bars than usual around its capabilities. Alas, time waits for no one, so we press on.
It is the largest open model so far at 2.8T, on the upper end of possible sizes for Claude Opus and near the bottom of possible sizes for Mythos, which explains many of its gains. It is slow and appears hungry for tokens. A lot of the positive reactions are to this being a big model, which thus has at least a decent amount of ‘big model smell’ and generally trades being slower and more expensive for some performance gains. That’s a great move, but it should be a while before they can do it again.
Distillation from Claude is clearly part of the story, likely largely from Fable, and is clearly nothing close to the whole story. Clearly Moonshot would do this even if it helped only a little. The timing of them releasing a bigger model is suggestive.
It is again a good model, but once you correct for the overperformance on benchmarks and look at expected practical performance, it is not clear this is so different from what you would have expected from a Kimi K3 that had 2.8T parameters.
Consider that Kimi K3’s (preliminary unofficial) Epoch Capabilities Index is exactly on the Chinese trend line.
Kimi K3 is absolutely worth checking to see if it fits into your workflows. At this price point, for both the API and the subscription, it is not going to fill the role of the smaller cheaper open models, and I expect it to usually lose out in a fight with the top closed models, but there are going to be some places where Kimi K3 is a good choice.
Andrew Curran: Following the success of Kimi K3, Moonshot AI has informed investors that it plans an IPO in Hong Kong within the next six months, according to Bloomberg.
Good idea. Strike while the iron is hot.
Table of Contents
DeepSeek Moments: Here We Go Again.
We Had a Moment (Reprise from June 2025).
The Story Since Then.
The Kimi K3 Announcement, Pitch and Basic Facts.
On Modern Benchmaxxing.
Other People’s Benchmarks.
Benchmarks Are Not The Real World.
Technical Safeguards? What Are Those?
Things Kimi Can Do.
Things Kimi Cannot Do.
Things It Is Not Easy To Get Kimi To Do.
Open Weight Models Are Unsafe And Nothing Can Fix This.
Dean Ball Attempts To Be Constructive.
OpenAI Employees Are Relatively Bullish On This One.
Kimi K3 Is Relatively Strongest At Typical Agentic Coding and 3D.
Reactions.
Who Are You?
How Did They Do It?
Conclusion.
DeepSeek Moments: Here We Go Again
All discourse about Chinese models lives in the shadow of the DeepSeek moment.
There are a lot of people who really, really want another DeepSeek moment to happen.
These people really, really want to tell the story that Chinese open models are catching up to American closed models, that AI and inference will become commoditized.
Their motivations vary. They often want to affirm open models, or the importance of the ‘tech stack.’ Others simply want to see OpenAI and Anthropic go down, or know that such claims sell. Often the ultimate objective is to argue against all AI regulations, or anything that might ‘slow us down’ or cause us to ‘lose to China.’
It is actively suicidal to respond to ‘the Chinese have better models now’ with ‘then we had better sell them the compute so they can run them and also build even better ones.’ Yet every time, yes, people will argue that. Sigh.
Often they simply want to tell American AI to stop taking precautions, to stop being annoying and take down the classifiers, as in ‘genie is out of the bottle, so release the bigger genie with unlimited wishes, it’s the only way.’ People really would take major catastrophic risks rather than deal with...