ARC Prize verifies DeepSeek V4 Flash at 61.4% for $0.04 per task
ARC Prize's outside evaluation documents how Liang Wenfeng's open-weight model falls from 61.4% at Max effort to 46.0% at Low, with Max costing $0.04 per task.
By Ryan Merket · Published
Primary source: ARC Prize
Why it matters
ARC Prize's outside evaluation gives developers a checkpoint-specific measurement of DeepSeek V4 Flash's ARC-AGI-2 performance, reasoning-effort curve and benchmark cost.
ARC Prize verified DeepSeek V4 Flash 0731 at 61.4% on ARC-AGI-2's Semi-Private evaluation at maximum reasoning effort, with a reported cost of $0.04 per task. The result is tied to the July 31st checkpoint and includes three effort levels: 61.4% at Max, 56.0% at High and 46.0% at Low.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.