ViBench aims to rank AI models by app-building, not just coding tests

The public site and ACM paper frame ViBench as an end-to-end test of whether coding agents can deliver usable apps, not just pass SWE-style tasks.

By · Published

Primary source: X

Why it matters

Coding model leaderboards increasingly shape buying decisions for founders and engineering teams. Masad's ViBench push argues that the relevant test is not just code correctness, but whether a model can turn prompts into complete apps cheaply and reliably.

ViBench aims to rank AI models by app-building, not just coding tests — Masad says Opus 4.8 beats GPT 5.5 on price and performance for end-to-end app creation, despite GPT's SWE benchmark lead.

Amjad Masad (@amasad) introduced ViBench, a benchmark he says is designed to measure how well AI models build apps end-to-end, in a post on X on Wednesday.

https://x.com/amasad/status/2062226152790675805…

Reader comments

Conversation for this story loads after sign-in.