General-purpose LLMs beat specialized AI tools in Nature Medicine study
The paper tested OpenEvidence and UpToDate Expert AI against GPT-5.2, Gemini 3.1 Pro and Claude Opus 4.6 across three medical evaluations.
By RW Staff · Published
Primary source: nature.com
Why it matters
Clinical AI vendors sell specialization as the reason health systems should trust and pay for their tools. This study narrows that claim: on these benchmarks, the frontier models beat the specialist wrappers, making independent evaluation harder to avoid.
General-purpose frontier LLMs outperformed two specialized clinical AI tools across medical benchmarks in a Nature Medicine brief communication published June 12th.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.