Moonshot releases Kimi K3 report, detailing how a 2.8T open model runs
The July 27th report details hybrid attention, 16-of-896 expert routing and a serving stack that still demands data-center scale.
By Ryan Merket · Published
Primary source: X
Why it matters
K3 shows that open weights alone do not make a frontier model practical. Draft models, cache systems and accelerator-scale serving now shape distribution and cost.
Zhilin Yang's Moonshot AI released the full weights and technical report for Kimi K3 on July 27th, documenting the architecture and infrastructure behind a 2.8 trillion-parameter model that activates 104 billion parameters for each token.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.