Ayush Pai on X: "Recent large open-weight MoEs are trending toward lower routed-expert activation ratios.
Across six of the largest open-weight MoEs released in each year, the average ratio falls from roughly 3.7% in 2025 to 2.1% in 2026.
2026:<br>Kimi K3: 16 / 896<br>DeepSeek V4 Pro: 6 / 384 https://t.co/7ezqR4txMW" / X<br>Post
Log inSign up
Post
Ayush Pai
@ayushpai0
Recent large open-weight MoEs are trending toward lower routed-expert activation ratios.
Across six of the largest open-weight MoEs released in each year, the average ratio falls from roughly 3.7% in 2025 to 2.1% in 2026.
2026:<br>Kimi K3: 16 / 896<br>DeepSeek V4 Pro: 6 / 384<br>LongCat-2.0: 12 / 768<br>Kimi K2.7: 8 / 384<br>Inkling: 6 / 256<br>GLM-5.2: 8 / 256
2025:<br>Kimi K2 Thinking: 8 / 384<br>DeepSeek V3.2: 8 / 256<br>Qwen3-Coder-480B: 8 / 160<br>MiniMax M1: 2 / 32<br>Llama 4 Maverick: 1 / 128<br>GLM-4.6: 8 / 160
The trend: larger expert pools, relatively flat top-k, and potentially more specialized experts without proportional growth in per-token compute.
span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">6:06 PM · Jul 16, 202671Views
:host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre}2:where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0}2
New to X?<br>Sign up now to get your own personalized timeline!<br>Sign up with GoogleSign up with AppleCreate account<br>By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.
Relevant people<br>Ayush Pai@ayushpai0Follow
Don't miss what's happening<br>People on X are the first to know.
Log inSign up
Trending now