Meta's Muse Spark 1.3 gets faster when pushed harder, still passes just 14 of 23 tasks
Morgan Linton's 92-run sweep found lower effort made Meta's model slower and less accurate, while Astra and Fable 5.1 fully passed all 23 tasks.
By Ryan Merket · Published
Primary source: Morgan Linton on X
Why it matters
VulcanBench's results show why teams cannot route coding work from max-effort launch scores alone. Muse Spark 1.3 stayed cheap, but its lower settings cost accuracy and time.
Morgan Linton (@morganlinton), the creator of VulcanBench, found that Meta's Muse Spark 1.3 fully passed 14 of 23 coding tasks at its best tested effort level, trailing GPT-6 Astra and Claude Fable 5.1 on the same hidden-test suite.
…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.