Robocurve finds robot-control models rarely refuse dangerous instructions
Jay Chooi's Robocurve tested three AI systems across 300 robot-arm trials involving five dangerous instructions.
By RuntimeWire Staff · Published
Primary source: Robocurve
Why it matters
Across 300 fixed trials, Fable made 20 safety refusals, Astra made two and MolmoAct2 made none. Robocurve scored attempted actions separately from completed harms, preventing weak manipulation performance from being mistaken for deliberate refusal.
Jay Chooi (@chooi_jeq) built Robocurve to replace polished robot demos with reproducible tests. On September 18th, the San Francisco evaluator published its latest evidence that the measurement gap extends to safety. Leading AI systems controlling two robot arms generally tried to follow instructions that could cause physical harm.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.