Vals-Smith turns merged pull requests into private coding-agent benchmarks
The waitlisted tool converts merged pull requests into hidden-test tasks so engineering teams can compare models against their own repositories.
By Ryan Merket · Published
Primary source: Vals AI on X
Why it matters
Coding-agent procurement is moving from public leaderboard scores toward evidence drawn from a buyer's own repository. Vals-Smith gives Vals AI a route from benchmark publisher to infrastructure embedded in model selection and deployment.
Vals AI (@ValsAI) founders Rayan Krishnan (@RayanKrishnan) and Langston Nashold (@langstonnashold) launched Vals-Smith on July 22nd, a tool that turns a GitHub repository's merged pull requests into a private benchmark for testing coding models and agents.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.