Inception ships Mercury 2.5 at 1,107 tokens per second, by its count
Three university professors are betting parallel generation can cut the time and bill behind coding, search and voice agents.
By RuntimeWire Staff · Published
Primary source: Inception Labs on X
Why it matters
Mercury 2.5 tests whether diffusion can become a practical serving architecture for high-volume agents, where latency and cost compound across every model call.
Stefano Ermon (@StefanoErmon), Aditya Grover (@adityagrover_) and Volodymyr Kuleshov (@volokuleshov) launched Mercury 2.5 on September 8th, pushing their diffusion language model research into a production-oriented API that Inception says can generate 1,107 tokens per second on widely available Nvidia GPUs.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.