Alibaba says Qwen3.8-Max leads open-weight models on commerce agent benchmark
The Accio team's state-based benchmark reports Qwen3.8-Max completing 56 tasks through Accio, 47 through OpenClaw and 53 through Pi; Alibaba calls it the strongest overall open-weight result.
By RuntimeWire Staff · Published
Primary source: Qwen / Alibaba
Why it matters
Agent vendors need tests that inspect completed business state instead of polished transcripts. The Accio team's benchmark advances that approach, while Alibaba's self-reported two-pass open-weight margin, harness variance and lack of immutable public task-level bundles make auditability as important as leaderboard order.
Yukun Lian, Sicong Xie and ten colleagues on Alibaba International's Accio team built Commerce Agent Bench to test whether AI agents can finish commercial work inside stateful replicas of business software. Alibaba's Qwen3.8-Max, part of the Qwen3.8 model family, completed 56 of 107 tasks through Accio, 47 through OpenClaw and 53 through Pi.…