Baseten's Base Labs turns Qwen into decision models with 6.21M examples
Led by Max Kirkby, the lab reports top benchmark scores for two open-weight models built to return calibrated probabilities instead of generated answers.
By Ryan Merket · Published
Primary source: X
Why it matters
Base Labs is showing how a post-training team can turn an existing open model into a specialized decision system, and it has published enough of the method to make the benchmark claim testable. Whether those gains transfer to real workflows will matter more than the leaderboard position.
Max Kirkby and Base Labs, the research lab inside Baseten, released mammoth-1 and elephant-1 on October 21st, turning Qwen models into specialist systems that score choices rather than generate prose. The lab says its 27-billion-parameter mammoth-1 leads the Jev Decision Index, while its 9-billion-parameter elephant-1 ranks among the leaders at a smaller size.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.