Arena launches AutoEval to rank new AI models within an hour
The reward-model system uses millions of user preferences and scored above 0.98 correlation with Arena's later live rankings.
By Ryan Merket · Published
Primary source: Arena on X
Why it matters
AutoEval lets Arena convert years of human votes into immediate model rankings, helping labs compare checkpoints while preserving live evaluation as the final validation layer.
Arena co-founders Anastasios Angelopoulos (@ml_angelopoulos), Wei-Lin Chiang (@infwinston) and Ion Stoica launched AutoEval on July 30th, giving new AI models a preliminary Arena Score before enough people have voted to produce a stable live ranking.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.