Artificial Analysis on X: "Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index and is cost and token efficient compared to its peers

Muse Spark 1.1 (xhigh) improves 8 points over Muse Spark 1.0 (43) in three months. It is effectively tied with GLM-5.2 (max), GPT-5.4 (xhigh), and https://t.co/f2NmTlrTDZ" / X<br>Post

Log inSign up

Post

Artificial Analysis

@ArtificialAnlys

Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index and is cost and token efficient compared to its peers

Muse Spark 1.1 (xhigh) improves 8 points over Muse Spark 1.0 (43) in three months. It is effectively tied with GLM-5.2 (max), GPT-5.4 (xhigh), and GPT-5.6 Luna (max) at 51, three points behind Grok 4.5 (high, 54), with the leading edge at Claude Fable 5 (60), GPT-5.6 Sol (max, 59), and Claude Opus 4.8 (max, 56).

The gains concentrate in Scientific Reasoning, coding, and knowledge; agentic knowledge work lags on GDPval-AA v2.

@AIatMeta shared access with us ahead of public release for benchmarking. Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!

Key Takeaways:<br>➤ Muse Spark 1.1 gains substantially on the first Muse Spark release. This was driven in particular by gains in agentic knowledge work (GDPval-AA v2) and coding (SciCode, TerminalBench). On Humanity's Last Exam, it reaches 45%, within a point of Claude Opus 4.8 (max, 46%) and ahead of GPT-5.5 (44%) and Grok 4.5 (high, 40%)<br>➤ The most token-efficient of the models effectively tied at 51 and among the cheaper models to run. Muse Spark 1.1 used 94M output tokens to run the Intelligence Index, fewer than GPT-5.4 (xhigh, 109M), GPT-5.6 Luna (max, 125M), and GLM-5.2 (max, 141M). We estimate ~$0.26 per Intelligence Index task at Meta's $1.25/$4.25 pricing - below GLM-5.2 ($0.37) and roughly 3x below GPT-5.4 ($0.89)<br>➤ The AA-Omniscience gain is driven by abstention rather than accuracy. The score more than quadrupled from 4 to 18 as the hallucination rate fell 35 points (73% to 38%), with the attempt rate down from 95% to 82% and accuracy roughly flat (45% to 41%)

Other model details:<br>➤ Context window: 1M tokens, up from 262k for Muse Spark 1.0<br>➤ Pricing: $1.25/$4.25 per 1M input/output tokens; cache hits discounted to $0.15 per 1M<br>➤ Output speed: ~114 tokens/s median on Meta's first-party API, with a ~21s time to first answer token<br>➤ Availability: Meta's first-party API at launch

span:not(:empty)~span:not(:empty)]:before:content-['·'] [&>span:not(:empty)~span:not(:empty)]:before:px-1 [&>span:not(:empty)~span:not(:empty)]:before:shrink-0">8:23 PM · Jul 10, 202683.2KViews

:host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre}15:where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0}15<br>:host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre}57:where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0}57<br>:host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre}663:where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0}663<br>:host{display:inline-block;direction:ltr;white-space:nowrap;line-height:1}span{display:inline-block}:host([data-will-change]) span{will-change:transform}.number,.digit{padding:round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) 0}.symbol{white-space:pre}105:where(number-flow-react){line-height:1}number-flow-react > span{font-kerning:none;display:inline-block;padding:calc(round(nearest, calc(var(--number-flow-mask-height, 0.25em) / 2), 1px) * 2) 0}105

Read 15 replies

New to X?<br>Sign up now to get your own personalized timeline!<br>Sign up with GoogleSign up with AppleCreate account<br>By signing up, you agree to the Terms of Service and Privacy Policy, including Cookie Use.

Relevant people<br>Artificial Analysis@ArtificialAnlysFollow

Trending now

Don't miss what's happening<br>People on X are the first to know.

Log inSign up