Mercor maps AI benchmarks to jobs and finds most US work unmeasured
Its new map links 29 benchmarks to Labor Department occupations, but Mercor says the coverage estimate is provisional and depends on its selection rules.
By Ryan Merket · Published
Primary source: X
Why it matters
Mercor is making the benchmark gap measurable while acknowledging that its estimate is shaped by a small, selected set of tests. The map puts pressure on claims that benchmark scores alone describe AI's readiness for real jobs.
Mercor released an interactive map of AI benchmark coverage across US occupations on October 15th, reporting that its initial set of 29 benchmarks covers at least one task in 208 of 923 occupations. The company estimates that roughly 90% of US working hours fall on tasks without adequate coverage in those benchmarks. Mercor's post on X points users to the Benchmark Map, a research tool built around the Department of Labor's O*NET job taxonomy.…