Google DeepMind paper trains an agent to rewrite its own harness

Posted on October 9th, Evo2 pairs code edits with performance feedback to train the model proposing and evaluating those edits.

By · Published · Updated

Primary source: X

Why it matters

Evo2 treats agent harness edits and their evaluation traces as training data, offering a path to improve an agent's workflow and the policy that maintains it without changing the task executor.

elvis (@omarsar0): Banger paper from Google DeepMind on co-evolving an agent's harness and its weights. (bookmark it) If you already log your harness changes a — Banger paper from Google DeepMind on co-evolving an agent's harness and its…

Google DeepMind researchers have published Evo2, a framework that trains an AI agent to improve the software harness around its model while also training the policy that edits and evaluates the harness. The paper, posted to arXiv on October 9th, reports gains on coding and memory benchmarks, including a 48.3% resolved rate on SWE-bench Verified.…

Reader comments

Conversation for this story loads after sign-in.